2023-12-01T15:23:26.528 INFO:root:teuthology version: 0.0.1.dev212+g595fad1 2023-12-01T15:23:26.528 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/ubuntu_20.04 tasks/{0-install test/libcephfs_interface_tests}} --archive /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692 --owner scheduled_yuriw@teuthology --name yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/orig.config.yaml 2023-12-01T15:23:26.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:23:26.662 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692 branch: reef-release description: smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/ubuntu_20.04 tasks/{0-install test/libcephfs_interface_tests}} email: null first_in_suite: false job_id: '7473692' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 2 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: reef-release ceph: conf: client: debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 s3tests: force-branch: ceph-reef thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef-release sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 owner: scheduled_yuriw@teuthology priority: 55 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mds.a - mgr.x - osd.0 - osd.1 - - mon.b - mds.b - mon.c - mgr.y - osd.2 - osd.3 - - client.0 seed: 3539 sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 sleep_before_teardown: 0 suite: smoke suite_branch: reef-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: cleanup: true - ceph: log-ignorelist: - \(POOL_APP_NOT_ENABLED\) - ceph-fuse: null - workunit: clients: client.0: - libcephfs/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: wip-package-queries teuthology_sha1: 595fad1080bd379e3c0231a8e02595924c59a9da timestamp: 2023-12-01_15:11:02 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-01T15:23:26.662 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa; will attempt to use it 2023-12-01T15:23:26.663 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks 2023-12-01T15:23:26.663 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-01T15:23:26.666 INFO:teuthology.task.internal:Checking packages... 2023-12-01T15:23:26.707 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a6f82997ac57b70a895455dfed6256360a1e4c32' 2023-12-01T15:23:26.708 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-01T15:23:26.708 INFO:teuthology.packaging:ref: None 2023-12-01T15:23:26.708 INFO:teuthology.packaging:tag: None 2023-12-01T15:23:26.708 INFO:teuthology.packaging:branch: reef-release 2023-12-01T15:23:26.709 INFO:teuthology.packaging:sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T15:23:26.709 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=reef-release 2023-12-01T15:23:26.948 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1249-ga6f82997-1focal 2023-12-01T15:23:26.949 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-01T15:23:26.955 INFO:teuthology.task.internal:no buildpackages task found 2023-12-01T15:23:26.956 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-01T15:23:26.966 INFO:teuthology.task.internal:Saving configuration 2023-12-01T15:23:26.983 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-01T15:23:26.989 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T15:23:27.018 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:12:13.120736', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-12-01T15:23:27.039 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:12:13.119260', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-12-01T15:23:27.064 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:12:13.116679', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-12-01T15:23:27.064 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-01T15:23:27.070 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mds.a', 'mgr.x', 'osd.0', 'osd.1'] 2023-12-01T15:23:27.070 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mon.c', 'mgr.y', 'osd.2', 'osd.3'] 2023-12-01T15:23:27.071 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['client.0'] 2023-12-01T15:23:27.071 INFO:teuthology.run_tasks:Running task console_log... 2023-12-01T15:23:27.223 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa1352ade50>, signals=[15]) 2023-12-01T15:23:27.224 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-01T15:23:27.230 INFO:teuthology.task.internal:Opening connections... 2023-12-01T15:23:27.230 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2023-12-01T15:23:27.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:23:27.287 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2023-12-01T15:23:27.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:23:27.343 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2023-12-01T15:23:27.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:23:27.399 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-01T15:23:27.406 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2023-12-01T15:23:27.413 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2023-12-01T15:23:27.413 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2023-12-01T15:23:27.462 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu" 2023-12-01T15:23:27.462 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-01T15:23:27.463 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu 2023-12-01T15:23:27.463 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian 2023-12-01T15:23:27.463 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-01T15:23:27.463 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="20.04" 2023-12-01T15:23:27.463 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-01T15:23:27.463 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-01T15:23:27.463 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-01T15:23:27.463 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-01T15:23:27.463 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=focal 2023-12-01T15:23:27.463 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=focal 2023-12-01T15:23:27.464 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2023-12-01T15:23:27.493 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2023-12-01T15:23:27.500 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2023-12-01T15:23:27.500 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-12-01T15:23:27.548 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Ubuntu" 2023-12-01T15:23:27.548 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-01T15:23:27.548 INFO:teuthology.orchestra.run.smithi066.stdout:ID=ubuntu 2023-12-01T15:23:27.548 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE=debian 2023-12-01T15:23:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-01T15:23:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="20.04" 2023-12-01T15:23:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-01T15:23:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-01T15:23:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-01T15:23:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-01T15:23:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_CODENAME=focal 2023-12-01T15:23:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:UBUNTU_CODENAME=focal 2023-12-01T15:23:27.549 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-12-01T15:23:27.576 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-12-01T15:23:27.583 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-12-01T15:23:27.584 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-12-01T15:23:27.633 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Ubuntu" 2023-12-01T15:23:27.633 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-01T15:23:27.633 INFO:teuthology.orchestra.run.smithi146.stdout:ID=ubuntu 2023-12-01T15:23:27.633 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE=debian 2023-12-01T15:23:27.633 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-01T15:23:27.633 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="20.04" 2023-12-01T15:23:27.633 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-01T15:23:27.634 INFO:teuthology.orchestra.run.smithi146.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-01T15:23:27.634 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-01T15:23:27.634 INFO:teuthology.orchestra.run.smithi146.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-01T15:23:27.634 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_CODENAME=focal 2023-12-01T15:23:27.634 INFO:teuthology.orchestra.run.smithi146.stdout:UBUNTU_CODENAME=focal 2023-12-01T15:23:27.634 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-12-01T15:23:27.659 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-01T15:23:27.668 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-01T15:23:27.706 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-01T15:23:27.706 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2023-12-01T15:23:27.709 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2023-12-01T15:23:27.712 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2023-12-01T15:23:27.723 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-01T15:23:27.780 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-01T15:23:27.781 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2023-12-01T15:23:27.785 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2023-12-01T15:23:27.789 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2023-12-01T15:23:27.895 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-01T15:23:27.975 INFO:teuthology.run_tasks:Running task kernel... 2023-12-01T15:23:27.991 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-01T15:23:27.992 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-01T15:23:27.992 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-01T15:23:27.992 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-01T15:23:27.993 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-01T15:23:27.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T15:23:27.999 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2023-12-01T15:23:27.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T15:23:28.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T15:23:28.001 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-12-01T15:23:28.001 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2023-12-01T15:23:28.007 INFO:teuthology.orchestra.run.smithi146.stdout:5.4.0-124-generic 2023-12-01T15:23:28.007 INFO:teuthology.task.kernel:Running kernel on smithi146: 5.4.0-124-generic 2023-12-01T15:23:28.007 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get clean 2023-12-01T15:23:28.009 INFO:teuthology.orchestra.run.smithi063.stdout:5.4.0-124-generic 2023-12-01T15:23:28.009 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.4.0-124-generic 2023-12-01T15:23:28.009 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get clean 2023-12-01T15:23:28.048 INFO:teuthology.orchestra.run.smithi066.stdout:5.4.0-124-generic 2023-12-01T15:23:28.048 INFO:teuthology.task.kernel:Running kernel on smithi066: 5.4.0-124-generic 2023-12-01T15:23:28.048 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get clean 2023-12-01T15:23:28.144 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2023-12-01T15:23:28.157 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2023-12-01T15:23:28.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2023-12-01T15:23:28.316 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T15:23:28.316 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-12-01T15:23:28.316 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-12-01T15:23:28.342 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-12-01T15:23:28.378 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-12-01T15:23:28.439 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T15:23:28.443 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-12-01T15:23:28.451 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T15:23:28.495 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-12-01T15:23:28.533 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-12-01T15:23:28.653 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [680 kB] 2023-12-01T15:23:28.695 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,604 kB] 2023-12-01T15:23:28.746 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,604 kB] 2023-12-01T15:23:28.795 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [402 kB] 2023-12-01T15:23:28.802 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-12-01T15:23:28.802 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-12-01T15:23:28.818 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [680 kB] 2023-12-01T15:23:28.821 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [402 kB] 2023-12-01T15:23:28.824 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-12-01T15:23:28.825 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-12-01T15:23:28.825 INFO:teuthology.orchestra.run.smithi066.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,411 kB] 2023-12-01T15:23:28.838 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,411 kB] 2023-12-01T15:23:28.838 INFO:teuthology.orchestra.run.smithi066.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,994 kB] 2023-12-01T15:23:28.845 INFO:teuthology.orchestra.run.smithi066.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [336 kB] 2023-12-01T15:23:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-12-01T15:23:28.848 INFO:teuthology.orchestra.run.smithi066.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-12-01T15:23:28.848 INFO:teuthology.orchestra.run.smithi066.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [630 kB] 2023-12-01T15:23:28.853 INFO:teuthology.orchestra.run.smithi066.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [911 kB] 2023-12-01T15:23:28.861 INFO:teuthology.orchestra.run.smithi066.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [191 kB] 2023-12-01T15:23:28.862 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [336 kB] 2023-12-01T15:23:28.863 INFO:teuthology.orchestra.run.smithi066.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-12-01T15:23:28.863 INFO:teuthology.orchestra.run.smithi066.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-12-01T15:23:28.863 INFO:teuthology.orchestra.run.smithi066.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-12-01T15:23:28.863 INFO:teuthology.orchestra.run.smithi066.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-12-01T15:23:28.865 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-12-01T15:23:28.865 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [911 kB] 2023-12-01T15:23:28.871 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [630 kB] 2023-12-01T15:23:28.871 INFO:teuthology.orchestra.run.smithi066.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-12-01T15:23:28.875 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [191 kB] 2023-12-01T15:23:28.877 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-12-01T15:23:28.877 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-12-01T15:23:28.877 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-12-01T15:23:28.877 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-12-01T15:23:28.877 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-12-01T15:23:28.889 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-12-01T15:23:28.929 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [680 kB] 2023-12-01T15:23:28.934 INFO:teuthology.orchestra.run.smithi066.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [913 kB] 2023-12-01T15:23:28.943 INFO:teuthology.orchestra.run.smithi066.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-12-01T15:23:28.948 INFO:teuthology.orchestra.run.smithi066.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-12-01T15:23:28.948 INFO:teuthology.orchestra.run.smithi066.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,528 kB] 2023-12-01T15:23:28.966 INFO:teuthology.orchestra.run.smithi066.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-12-01T15:23:28.966 INFO:teuthology.orchestra.run.smithi066.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [353 kB] 2023-12-01T15:23:28.971 INFO:teuthology.orchestra.run.smithi066.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-12-01T15:23:28.971 INFO:teuthology.orchestra.run.smithi066.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [758 kB] 2023-12-01T15:23:28.974 INFO:teuthology.orchestra.run.smithi066.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,136 kB] 2023-12-01T15:23:28.982 INFO:teuthology.orchestra.run.smithi066.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [272 kB] 2023-12-01T15:23:28.983 INFO:teuthology.orchestra.run.smithi066.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-12-01T15:23:28.983 INFO:teuthology.orchestra.run.smithi066.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-12-01T15:23:28.984 INFO:teuthology.orchestra.run.smithi066.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-12-01T15:23:28.994 INFO:teuthology.orchestra.run.smithi066.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-12-01T15:23:28.995 INFO:teuthology.orchestra.run.smithi066.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-12-01T15:23:28.995 INFO:teuthology.orchestra.run.smithi066.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-12-01T15:23:28.995 INFO:teuthology.orchestra.run.smithi066.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-12-01T15:23:28.996 INFO:teuthology.orchestra.run.smithi066.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-12-01T15:23:29.017 INFO:teuthology.orchestra.run.smithi066.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-12-01T15:23:29.017 INFO:teuthology.orchestra.run.smithi066.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-12-01T15:23:29.017 INFO:teuthology.orchestra.run.smithi066.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-12-01T15:23:29.023 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,994 kB] 2023-12-01T15:23:29.074 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [913 kB] 2023-12-01T15:23:29.274 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,604 kB] 2023-12-01T15:23:29.408 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [913 kB] 2023-12-01T15:23:29.408 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,994 kB] 2023-12-01T15:23:29.438 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-12-01T15:23:29.452 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-12-01T15:23:29.452 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,528 kB] 2023-12-01T15:23:29.464 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [402 kB] 2023-12-01T15:23:29.478 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-12-01T15:23:29.479 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-12-01T15:23:29.480 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,411 kB] 2023-12-01T15:23:29.527 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-12-01T15:23:29.528 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [353 kB] 2023-12-01T15:23:29.532 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-12-01T15:23:29.548 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [336 kB] 2023-12-01T15:23:29.560 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-12-01T15:23:29.560 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [630 kB] 2023-12-01T15:23:29.571 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [911 kB] 2023-12-01T15:23:29.585 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-12-01T15:23:29.598 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-12-01T15:23:29.598 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,528 kB] 2023-12-01T15:23:29.670 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-12-01T15:23:29.670 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [353 kB] 2023-12-01T15:23:29.675 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-12-01T15:23:29.696 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [758 kB] 2023-12-01T15:23:29.774 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [191 kB] 2023-12-01T15:23:29.839 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [758 kB] 2023-12-01T15:23:30.203 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-12-01T15:23:30.208 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-12-01T15:23:30.216 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-12-01T15:23:30.218 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-12-01T15:23:30.219 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-12-01T15:23:30.289 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,136 kB] 2023-12-01T15:23:30.398 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [272 kB] 2023-12-01T15:23:30.419 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-12-01T15:23:30.420 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-12-01T15:23:30.421 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-12-01T15:23:30.423 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-12-01T15:23:30.423 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-12-01T15:23:30.423 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-12-01T15:23:30.426 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-12-01T15:23:30.429 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-12-01T15:23:30.429 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,136 kB] 2023-12-01T15:23:30.538 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [272 kB] 2023-12-01T15:23:30.558 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-12-01T15:23:30.560 INFO:teuthology.orchestra.run.smithi063.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-12-01T15:23:30.561 INFO:teuthology.orchestra.run.smithi063.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-12-01T15:23:30.562 INFO:teuthology.orchestra.run.smithi063.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-12-01T15:23:30.563 INFO:teuthology.orchestra.run.smithi063.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-12-01T15:23:30.563 INFO:teuthology.orchestra.run.smithi063.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-12-01T15:23:30.565 INFO:teuthology.orchestra.run.smithi063.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-12-01T15:23:30.568 INFO:teuthology.orchestra.run.smithi063.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-12-01T15:23:30.592 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-12-01T15:23:30.733 INFO:teuthology.orchestra.run.smithi063.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-12-01T15:23:30.756 INFO:teuthology.orchestra.run.smithi146.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-12-01T15:23:30.809 INFO:teuthology.orchestra.run.smithi146.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-12-01T15:23:30.898 INFO:teuthology.orchestra.run.smithi063.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-12-01T15:23:30.948 INFO:teuthology.orchestra.run.smithi063.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-12-01T15:23:32.670 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 18.3 MB in 3s (7,165 kB/s) 2023-12-01T15:23:32.773 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 18.3 MB in 3s (6,710 kB/s) 2023-12-01T15:23:33.385 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 18.3 MB in 3s (5,696 kB/s) 2023-12-01T15:23:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T15:23:34.140 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-01T15:23:34.213 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T15:23:34.258 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T15:23:34.284 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-01T15:23:34.378 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T15:23:34.415 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T15:23:34.415 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T15:23:34.587 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T15:23:34.588 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T15:23:34.592 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2023-12-01T15:23:34.592 INFO:teuthology.orchestra.run.smithi146.stdout: linux-generic linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-12-01T15:23:34.592 INFO:teuthology.orchestra.run.smithi146.stdout: linux-headers-generic linux-image-5.4.0-167-generic 2023-12-01T15:23:34.592 INFO:teuthology.orchestra.run.smithi146.stdout: linux-modules-5.4.0-167-generic linux-modules-extra-5.4.0-167-generic 2023-12-01T15:23:34.593 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2023-12-01T15:23:34.594 INFO:teuthology.orchestra.run.smithi146.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-12-01T15:23:34.594 INFO:teuthology.orchestra.run.smithi146.stdout:Recommended packages: 2023-12-01T15:23:34.594 INFO:teuthology.orchestra.run.smithi146.stdout: thermald 2023-12-01T15:23:34.657 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2023-12-01T15:23:34.657 INFO:teuthology.orchestra.run.smithi146.stdout: linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-12-01T15:23:34.657 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.4.0-167-generic linux-modules-5.4.0-167-generic 2023-12-01T15:23:34.657 INFO:teuthology.orchestra.run.smithi146.stdout: linux-modules-extra-5.4.0-167-generic 2023-12-01T15:23:34.657 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be upgraded: 2023-12-01T15:23:34.657 INFO:teuthology.orchestra.run.smithi146.stdout: linux-generic linux-headers-generic linux-image-generic 2023-12-01T15:23:34.714 INFO:teuthology.orchestra.run.smithi146.stdout:3 upgraded, 5 newly installed, 0 to remove and 280 not upgraded. 2023-12-01T15:23:34.714 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 77.0 MB of archives. 2023-12-01T15:23:34.714 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 380 MB of additional disk space will be used. 2023-12-01T15:23:34.714 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-167-generic amd64 5.4.0-167.184 [15.0 MB] 2023-12-01T15:23:34.788 INFO:teuthology.orchestra.run.smithi066.stdout:The following additional packages will be installed: 2023-12-01T15:23:34.788 INFO:teuthology.orchestra.run.smithi066.stdout: linux-generic linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-12-01T15:23:34.788 INFO:teuthology.orchestra.run.smithi066.stdout: linux-headers-generic linux-image-5.4.0-167-generic 2023-12-01T15:23:34.789 INFO:teuthology.orchestra.run.smithi066.stdout: linux-modules-5.4.0-167-generic linux-modules-extra-5.4.0-167-generic 2023-12-01T15:23:34.790 INFO:teuthology.orchestra.run.smithi066.stdout:Suggested packages: 2023-12-01T15:23:34.791 INFO:teuthology.orchestra.run.smithi066.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-12-01T15:23:34.791 INFO:teuthology.orchestra.run.smithi066.stdout:Recommended packages: 2023-12-01T15:23:34.791 INFO:teuthology.orchestra.run.smithi066.stdout: thermald 2023-12-01T15:23:34.844 INFO:teuthology.orchestra.run.smithi066.stdout:The following NEW packages will be installed: 2023-12-01T15:23:34.844 INFO:teuthology.orchestra.run.smithi066.stdout: linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-12-01T15:23:34.844 INFO:teuthology.orchestra.run.smithi066.stdout: linux-image-5.4.0-167-generic linux-modules-5.4.0-167-generic 2023-12-01T15:23:34.844 INFO:teuthology.orchestra.run.smithi066.stdout: linux-modules-extra-5.4.0-167-generic 2023-12-01T15:23:34.845 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be upgraded: 2023-12-01T15:23:34.845 INFO:teuthology.orchestra.run.smithi066.stdout: linux-generic linux-headers-generic linux-image-generic 2023-12-01T15:23:34.856 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T15:23:34.881 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-01T15:23:34.951 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T15:23:35.029 INFO:teuthology.orchestra.run.smithi066.stdout:3 upgraded, 5 newly installed, 0 to remove and 280 not upgraded. 2023-12-01T15:23:35.029 INFO:teuthology.orchestra.run.smithi066.stdout:Need to get 77.0 MB of archives. 2023-12-01T15:23:35.030 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 380 MB of additional disk space will be used. 2023-12-01T15:23:35.030 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-167-generic amd64 5.4.0-167.184 [15.0 MB] 2023-12-01T15:23:35.107 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-167-generic amd64 5.4.0-167.184 [10.5 MB] 2023-12-01T15:23:35.160 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T15:23:35.160 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T15:23:35.238 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-167-generic amd64 5.4.0-167.184 [39.2 MB] 2023-12-01T15:23:35.353 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2023-12-01T15:23:35.353 INFO:teuthology.orchestra.run.smithi063.stdout: linux-generic linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-12-01T15:23:35.353 INFO:teuthology.orchestra.run.smithi063.stdout: linux-headers-generic linux-image-5.4.0-167-generic 2023-12-01T15:23:35.354 INFO:teuthology.orchestra.run.smithi063.stdout: linux-modules-5.4.0-167-generic linux-modules-extra-5.4.0-167-generic 2023-12-01T15:23:35.354 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2023-12-01T15:23:35.355 INFO:teuthology.orchestra.run.smithi063.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-12-01T15:23:35.355 INFO:teuthology.orchestra.run.smithi063.stdout:Recommended packages: 2023-12-01T15:23:35.355 INFO:teuthology.orchestra.run.smithi063.stdout: thermald 2023-12-01T15:23:35.418 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2023-12-01T15:23:35.418 INFO:teuthology.orchestra.run.smithi063.stdout: linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-12-01T15:23:35.418 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.4.0-167-generic linux-modules-5.4.0-167-generic 2023-12-01T15:23:35.418 INFO:teuthology.orchestra.run.smithi063.stdout: linux-modules-extra-5.4.0-167-generic 2023-12-01T15:23:35.420 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be upgraded: 2023-12-01T15:23:35.420 INFO:teuthology.orchestra.run.smithi063.stdout: linux-generic linux-headers-generic linux-image-generic 2023-12-01T15:23:35.530 INFO:teuthology.orchestra.run.smithi063.stdout:3 upgraded, 5 newly installed, 0 to remove and 280 not upgraded. 2023-12-01T15:23:35.530 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 77.0 MB of archives. 2023-12-01T15:23:35.530 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 380 MB of additional disk space will be used. 2023-12-01T15:23:35.530 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-167-generic amd64 5.4.0-167.184 [15.0 MB] 2023-12-01T15:23:36.022 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.167.164 [1,900 B] 2023-12-01T15:23:36.022 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.167.164 [2,564 B] 2023-12-01T15:23:36.022 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167 all 5.4.0-167.184 [11.0 MB] 2023-12-01T15:23:36.149 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-167-generic amd64 5.4.0-167.184 [10.5 MB] 2023-12-01T15:23:36.184 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-167-generic amd64 5.4.0-167.184 [10.5 MB] 2023-12-01T15:23:36.349 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-167-generic amd64 5.4.0-167.184 [39.2 MB] 2023-12-01T15:23:36.388 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167-generic amd64 5.4.0-167.184 [1,367 kB] 2023-12-01T15:23:36.448 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.167.164 [2,428 B] 2023-12-01T15:23:36.469 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-167-generic amd64 5.4.0-167.184 [39.2 MB] 2023-12-01T15:23:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.167.164 [1,900 B] 2023-12-01T15:23:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.167.164 [2,564 B] 2023-12-01T15:23:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167 all 5.4.0-167.184 [11.0 MB] 2023-12-01T15:23:37.090 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 77.0 MB in 2s (43.1 MB/s) 2023-12-01T15:23:37.277 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-modules-5.4.0-167-generic. 2023-12-01T15:23:37.314 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167-generic amd64 5.4.0-167.184 [1,367 kB] 2023-12-01T15:23:37.353 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.167.164 [2,428 B] 2023-12-01T15:23:37.710 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.167.164 [1,900 B] 2023-12-01T15:23:37.711 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.167.164 [2,564 B] 2023-12-01T15:23:37.711 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167 all 5.4.0-167.184 [11.0 MB] 2023-12-01T15:23:38.080 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 77.0 MB in 2s (40.0 MB/s) 2023-12-01T15:23:38.284 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-modules-5.4.0-167-generic. 2023-12-01T15:23:38.313 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167-generic amd64 5.4.0-167.184 [1,367 kB] 2023-12-01T15:23:38.385 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.167.164 [2,428 B] 2023-12-01T15:23:38.998 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-12-01T15:23:39.003 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../0-linux-modules-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:39.109 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 77.0 MB in 4s (21.8 MB/s) 2023-12-01T15:23:39.183 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:39.280 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-modules-5.4.0-167-generic. 2023-12-01T15:23:39.996 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-12-01T15:23:40.001 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../0-linux-modules-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:40.140 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:41.067 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-image-5.4.0-167-generic. 2023-12-01T15:23:41.080 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../1-linux-image-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:41.093 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-12-01T15:23:41.098 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../0-linux-modules-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:41.185 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:41.194 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:42.090 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-image-5.4.0-167-generic. 2023-12-01T15:23:42.107 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../1-linux-image-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:42.198 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-167-generic. 2023-12-01T15:23:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:42.268 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:43.194 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-image-5.4.0-167-generic. 2023-12-01T15:23:43.209 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../1-linux-image-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:43.301 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:43.369 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-167-generic. 2023-12-01T15:23:43.385 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:43.427 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:44.498 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-167-generic. 2023-12-01T15:23:44.511 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:44.556 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:46.978 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../3-linux-generic_5.4.0.167.164_amd64.deb ... 2023-12-01T15:23:47.104 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-12-01T15:23:47.439 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.167.164_amd64.deb ... 2023-12-01T15:23:47.566 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-image-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-12-01T15:23:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-headers-5.4.0-167. 2023-12-01T15:23:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../5-linux-headers-5.4.0-167_5.4.0-167.184_all.deb ... 2023-12-01T15:23:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-12-01T15:23:48.415 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../3-linux-generic_5.4.0.167.164_amd64.deb ... 2023-12-01T15:23:48.542 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-12-01T15:23:48.921 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.167.164_amd64.deb ... 2023-12-01T15:23:49.062 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-image-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-12-01T15:23:49.220 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../3-linux-generic_5.4.0.167.164_amd64.deb ... 2023-12-01T15:23:49.369 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-12-01T15:23:49.407 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-headers-5.4.0-167. 2023-12-01T15:23:49.423 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../5-linux-headers-5.4.0-167_5.4.0-167.184_all.deb ... 2023-12-01T15:23:49.465 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-12-01T15:23:49.704 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.167.164_amd64.deb ... 2023-12-01T15:23:49.848 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-image-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-12-01T15:23:50.176 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-headers-5.4.0-167. 2023-12-01T15:23:50.192 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../5-linux-headers-5.4.0-167_5.4.0-167.184_all.deb ... 2023-12-01T15:23:50.226 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-12-01T15:23:53.136 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-headers-5.4.0-167-generic. 2023-12-01T15:23:53.157 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../6-linux-headers-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:53.203 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:55.143 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-headers-5.4.0-167-generic. 2023-12-01T15:23:55.165 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../6-linux-headers-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:55.226 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:55.759 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-headers-5.4.0-167-generic. 2023-12-01T15:23:55.777 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.167.164_amd64.deb ... 2023-12-01T15:23:55.781 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../6-linux-headers-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-12-01T15:23:55.826 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:55.898 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-12-01T15:23:56.230 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:57.445 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-12-01T15:23:57.571 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:57.706 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.167.164_amd64.deb ... 2023-12-01T15:23:58.470 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-12-01T15:23:58.661 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.167.164_amd64.deb ... 2023-12-01T15:23:58.791 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-12-01T15:23:58.839 INFO:teuthology.orchestra.run.smithi146.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-167-generic 2023-12-01T15:23:58.839 INFO:teuthology.orchestra.run.smithi146.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-167-generic 2023-12-01T15:23:58.850 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:58.957 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:23:59.140 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:24:00.200 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-12-01T15:24:00.326 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:24:00.351 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-image-generic (5.4.0.167.164) ... 2023-12-01T15:24:00.413 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-12-01T15:24:00.454 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:24:00.478 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-generic (5.4.0.167.164) ... 2023-12-01T15:24:00.546 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:24:00.603 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-generic (5.4.0.167.164) ... 2023-12-01T15:24:00.729 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:24:00.800 INFO:teuthology.orchestra.run.smithi146.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-12-01T15:24:00.800 INFO:teuthology.orchestra.run.smithi146.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-167-generic 2023-12-01T15:24:01.615 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:24:01.681 INFO:teuthology.orchestra.run.smithi063.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-167-generic 2023-12-01T15:24:01.682 INFO:teuthology.orchestra.run.smithi063.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-167-generic 2023-12-01T15:24:02.801 INFO:teuthology.orchestra.run.smithi066.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-167-generic 2023-12-01T15:24:02.801 INFO:teuthology.orchestra.run.smithi066.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-167-generic 2023-12-01T15:24:02.922 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:24:02.958 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:24:04.185 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-image-generic (5.4.0.167.164) ... 2023-12-01T15:24:04.311 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-generic (5.4.0.167.164) ... 2023-12-01T15:24:04.462 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-generic (5.4.0.167.164) ... 2023-12-01T15:24:04.599 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:24:04.662 INFO:teuthology.orchestra.run.smithi066.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-12-01T15:24:04.662 INFO:teuthology.orchestra.run.smithi066.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-167-generic 2023-12-01T15:24:04.847 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-image-generic (5.4.0.167.164) ... 2023-12-01T15:24:04.998 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-generic (5.4.0.167.164) ... 2023-12-01T15:24:05.124 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-generic (5.4.0.167.164) ... 2023-12-01T15:24:05.273 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-12-01T15:24:05.352 INFO:teuthology.orchestra.run.smithi063.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-12-01T15:24:05.353 INFO:teuthology.orchestra.run.smithi063.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-167-generic 2023-12-01T15:24:22.602 INFO:teuthology.orchestra.run.smithi146.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-12-01T15:24:22.603 INFO:teuthology.orchestra.run.smithi146.stdout:Sourcing file `/etc/default/grub' 2023-12-01T15:24:22.610 INFO:teuthology.orchestra.run.smithi146.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-01T15:24:22.631 INFO:teuthology.orchestra.run.smithi146.stdout:Generating grub configuration file ... 2023-12-01T15:24:22.951 INFO:teuthology.orchestra.run.smithi146.stdout:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-12-01T15:24:22.970 INFO:teuthology.orchestra.run.smithi146.stdout:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-12-01T15:24:23.336 INFO:teuthology.orchestra.run.smithi146.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-01T15:24:23.347 INFO:teuthology.orchestra.run.smithi146.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-01T15:24:25.994 INFO:teuthology.orchestra.run.smithi146.stdout:done 2023-12-01T15:24:26.424 DEBUG:teuthology.orchestra.run.smithi146:> dpkg -s linux-image-generic 2023-12-01T15:24:26.472 INFO:teuthology.orchestra.run.smithi146.stdout:Package: linux-image-generic 2023-12-01T15:24:26.473 INFO:teuthology.orchestra.run.smithi146.stdout:Status: install ok installed 2023-12-01T15:24:26.473 INFO:teuthology.orchestra.run.smithi146.stdout:Priority: optional 2023-12-01T15:24:26.473 INFO:teuthology.orchestra.run.smithi146.stdout:Section: kernel 2023-12-01T15:24:26.474 INFO:teuthology.orchestra.run.smithi146.stdout:Installed-Size: 20 2023-12-01T15:24:26.474 INFO:teuthology.orchestra.run.smithi146.stdout:Maintainer: Ubuntu Kernel Team 2023-12-01T15:24:26.474 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: amd64 2023-12-01T15:24:26.475 INFO:teuthology.orchestra.run.smithi146.stdout:Source: linux-meta 2023-12-01T15:24:26.475 INFO:teuthology.orchestra.run.smithi146.stdout:Version: 5.4.0.167.164 2023-12-01T15:24:26.475 INFO:teuthology.orchestra.run.smithi146.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-12-01T15:24:26.475 INFO:teuthology.orchestra.run.smithi146.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-01T15:24:26.476 INFO:teuthology.orchestra.run.smithi146.stdout:Recommends: thermald 2023-12-01T15:24:26.476 INFO:teuthology.orchestra.run.smithi146.stdout:Description: Generic Linux kernel image 2023-12-01T15:24:26.476 INFO:teuthology.orchestra.run.smithi146.stdout: This package will always depend on the latest generic kernel image 2023-12-01T15:24:26.476 INFO:teuthology.orchestra.run.smithi146.stdout: available. 2023-12-01T15:24:26.478 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-167-generic 2023-12-01T15:24:26.478 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-01T15:24:26.479 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-01T15:24:26.480 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-12-01T15:24:26.480 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=None, version=distro) 2023-12-01T15:24:26.480 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get clean 2023-12-01T15:24:26.565 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2023-12-01T15:24:26.704 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T15:24:26.706 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-01T15:24:26.714 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-01T15:24:26.737 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-01T15:24:26.876 INFO:teuthology.orchestra.run.smithi066.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-12-01T15:24:26.876 INFO:teuthology.orchestra.run.smithi066.stdout:Sourcing file `/etc/default/grub' 2023-12-01T15:24:26.878 INFO:teuthology.orchestra.run.smithi066.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-01T15:24:26.889 INFO:teuthology.orchestra.run.smithi066.stdout:Generating grub configuration file ... 2023-12-01T15:24:27.223 INFO:teuthology.orchestra.run.smithi066.stdout:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-12-01T15:24:27.244 INFO:teuthology.orchestra.run.smithi066.stdout:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-12-01T15:24:27.626 INFO:teuthology.orchestra.run.smithi066.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-01T15:24:27.636 INFO:teuthology.orchestra.run.smithi066.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-01T15:24:28.013 INFO:teuthology.orchestra.run.smithi063.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-12-01T15:24:28.014 INFO:teuthology.orchestra.run.smithi063.stdout:Sourcing file `/etc/default/grub' 2023-12-01T15:24:28.036 INFO:teuthology.orchestra.run.smithi063.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-01T15:24:28.052 INFO:teuthology.orchestra.run.smithi063.stdout:Generating grub configuration file ... 2023-12-01T15:24:28.467 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T15:24:28.479 INFO:teuthology.orchestra.run.smithi063.stdout:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-12-01T15:24:28.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-01T15:24:28.494 INFO:teuthology.orchestra.run.smithi063.stdout:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-12-01T15:24:28.558 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T15:24:28.741 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T15:24:28.741 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T15:24:28.949 INFO:teuthology.orchestra.run.smithi146.stdout:linux-image-generic is already the newest version (5.4.0.167.164). 2023-12-01T15:24:28.949 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 280 not upgraded. 2023-12-01T15:24:28.951 DEBUG:teuthology.orchestra.run.smithi146:> dpkg -s linux-image-generic 2023-12-01T15:24:28.975 INFO:teuthology.orchestra.run.smithi146.stdout:Package: linux-image-generic 2023-12-01T15:24:28.975 INFO:teuthology.orchestra.run.smithi146.stdout:Status: install ok installed 2023-12-01T15:24:28.975 INFO:teuthology.orchestra.run.smithi146.stdout:Priority: optional 2023-12-01T15:24:28.975 INFO:teuthology.orchestra.run.smithi146.stdout:Section: kernel 2023-12-01T15:24:28.975 INFO:teuthology.orchestra.run.smithi146.stdout:Installed-Size: 20 2023-12-01T15:24:28.975 INFO:teuthology.orchestra.run.smithi146.stdout:Maintainer: Ubuntu Kernel Team 2023-12-01T15:24:28.975 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: amd64 2023-12-01T15:24:28.975 INFO:teuthology.orchestra.run.smithi146.stdout:Source: linux-meta 2023-12-01T15:24:28.975 INFO:teuthology.orchestra.run.smithi146.stdout:Version: 5.4.0.167.164 2023-12-01T15:24:28.975 INFO:teuthology.orchestra.run.smithi146.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-12-01T15:24:28.976 INFO:teuthology.orchestra.run.smithi146.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-01T15:24:28.976 INFO:teuthology.orchestra.run.smithi146.stdout:Recommends: thermald 2023-12-01T15:24:28.976 INFO:teuthology.orchestra.run.smithi146.stdout:Description: Generic Linux kernel image 2023-12-01T15:24:28.976 INFO:teuthology.orchestra.run.smithi146.stdout: This package will always depend on the latest generic kernel image 2023-12-01T15:24:28.976 INFO:teuthology.orchestra.run.smithi146.stdout: available. 2023-12-01T15:24:28.976 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-12-01T15:24:29.020 INFO:teuthology.orchestra.run.smithi063.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-01T15:24:29.021 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.3FAaqPzDyb 2023-12-01T15:24:29.022 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub/grub.cfg /tmp/tmp.3FAaqPzDyb 2023-12-01T15:24:29.037 INFO:teuthology.orchestra.run.smithi063.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-01T15:24:29.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.3FAaqPzDyb 2023-12-01T15:24:29.078 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.3FAaqPzDyb is 9KB 2023-12-01T15:24:29.100 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.3FAaqPzDyb 2023-12-01T15:24:29.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-12-01T15:24:29.163 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:24:29.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-12-01T15:24:29.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-12-01T15:24:29.194 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-167-generic 2023-12-01T15:24:29.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo update-grub 2023-12-01T15:24:29.622 INFO:teuthology.orchestra.run.smithi066.stdout:done 2023-12-01T15:24:30.033 DEBUG:teuthology.orchestra.run.smithi066:> dpkg -s linux-image-generic 2023-12-01T15:24:30.082 INFO:teuthology.orchestra.run.smithi066.stdout:Package: linux-image-generic 2023-12-01T15:24:30.083 INFO:teuthology.orchestra.run.smithi066.stdout:Status: install ok installed 2023-12-01T15:24:30.083 INFO:teuthology.orchestra.run.smithi066.stdout:Priority: optional 2023-12-01T15:24:30.084 INFO:teuthology.orchestra.run.smithi066.stdout:Section: kernel 2023-12-01T15:24:30.084 INFO:teuthology.orchestra.run.smithi066.stdout:Installed-Size: 20 2023-12-01T15:24:30.084 INFO:teuthology.orchestra.run.smithi066.stdout:Maintainer: Ubuntu Kernel Team 2023-12-01T15:24:30.085 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: amd64 2023-12-01T15:24:30.085 INFO:teuthology.orchestra.run.smithi066.stdout:Source: linux-meta 2023-12-01T15:24:30.085 INFO:teuthology.orchestra.run.smithi066.stdout:Version: 5.4.0.167.164 2023-12-01T15:24:30.085 INFO:teuthology.orchestra.run.smithi066.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-12-01T15:24:30.086 INFO:teuthology.orchestra.run.smithi066.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-01T15:24:30.086 INFO:teuthology.orchestra.run.smithi066.stdout:Recommends: thermald 2023-12-01T15:24:30.086 INFO:teuthology.orchestra.run.smithi066.stdout:Description: Generic Linux kernel image 2023-12-01T15:24:30.086 INFO:teuthology.orchestra.run.smithi066.stdout: This package will always depend on the latest generic kernel image 2023-12-01T15:24:30.088 INFO:teuthology.orchestra.run.smithi066.stdout: available. 2023-12-01T15:24:30.088 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-167-generic 2023-12-01T15:24:30.088 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-01T15:24:30.089 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-01T15:24:30.089 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-01T15:24:30.089 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi066.front.sepia.ceph.com, path=None, version=distro) 2023-12-01T15:24:30.090 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get clean 2023-12-01T15:24:30.177 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2023-12-01T15:24:30.311 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-01T15:24:30.426 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T15:24:30.485 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub' 2023-12-01T15:24:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-01T15:24:30.510 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-01T15:24:30.511 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2023-12-01T15:24:30.590 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-01T15:24:30.747 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-12-01T15:24:30.759 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-12-01T15:24:31.116 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-01T15:24:31.127 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-01T15:24:31.255 INFO:teuthology.orchestra.run.smithi063.stdout:done 2023-12-01T15:24:31.732 DEBUG:teuthology.orchestra.run.smithi063:> dpkg -s linux-image-generic 2023-12-01T15:24:31.784 INFO:teuthology.orchestra.run.smithi063.stdout:Package: linux-image-generic 2023-12-01T15:24:31.784 INFO:teuthology.orchestra.run.smithi063.stdout:Status: install ok installed 2023-12-01T15:24:31.784 INFO:teuthology.orchestra.run.smithi063.stdout:Priority: optional 2023-12-01T15:24:31.784 INFO:teuthology.orchestra.run.smithi063.stdout:Section: kernel 2023-12-01T15:24:31.784 INFO:teuthology.orchestra.run.smithi063.stdout:Installed-Size: 20 2023-12-01T15:24:31.784 INFO:teuthology.orchestra.run.smithi063.stdout:Maintainer: Ubuntu Kernel Team 2023-12-01T15:24:31.784 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: amd64 2023-12-01T15:24:31.784 INFO:teuthology.orchestra.run.smithi063.stdout:Source: linux-meta 2023-12-01T15:24:31.784 INFO:teuthology.orchestra.run.smithi063.stdout:Version: 5.4.0.167.164 2023-12-01T15:24:31.785 INFO:teuthology.orchestra.run.smithi063.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-12-01T15:24:31.785 INFO:teuthology.orchestra.run.smithi063.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-01T15:24:31.785 INFO:teuthology.orchestra.run.smithi063.stdout:Recommends: thermald 2023-12-01T15:24:31.785 INFO:teuthology.orchestra.run.smithi063.stdout:Description: Generic Linux kernel image 2023-12-01T15:24:31.785 INFO:teuthology.orchestra.run.smithi063.stdout: This package will always depend on the latest generic kernel image 2023-12-01T15:24:31.785 INFO:teuthology.orchestra.run.smithi063.stdout: available. 2023-12-01T15:24:31.785 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-167-generic 2023-12-01T15:24:31.785 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-01T15:24:31.785 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-01T15:24:31.785 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-01T15:24:31.786 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2023-12-01T15:24:31.786 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get clean 2023-12-01T15:24:31.858 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2023-12-01T15:24:32.010 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-01T15:24:32.010 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T15:24:32.036 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-01T15:24:32.082 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-01T15:24:32.111 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T15:24:32.137 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-01T15:24:32.209 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T15:24:32.416 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T15:24:32.416 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T15:24:32.641 INFO:teuthology.orchestra.run.smithi066.stdout:linux-image-generic is already the newest version (5.4.0.167.164). 2023-12-01T15:24:32.641 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 280 not upgraded. 2023-12-01T15:24:32.643 DEBUG:teuthology.orchestra.run.smithi066:> dpkg -s linux-image-generic 2023-12-01T15:24:32.663 INFO:teuthology.orchestra.run.smithi066.stdout:Package: linux-image-generic 2023-12-01T15:24:32.663 INFO:teuthology.orchestra.run.smithi066.stdout:Status: install ok installed 2023-12-01T15:24:32.663 INFO:teuthology.orchestra.run.smithi066.stdout:Priority: optional 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout:Section: kernel 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout:Installed-Size: 20 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout:Maintainer: Ubuntu Kernel Team 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: amd64 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout:Source: linux-meta 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout:Version: 5.4.0.167.164 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout:Recommends: thermald 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout:Description: Generic Linux kernel image 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout: This package will always depend on the latest generic kernel image 2023-12-01T15:24:32.664 INFO:teuthology.orchestra.run.smithi066.stdout: available. 2023-12-01T15:24:32.665 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2023-12-01T15:24:32.671 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.Gevm9Zpb7J 2023-12-01T15:24:32.671 DEBUG:teuthology.orchestra.run.smithi066:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Gevm9Zpb7J 2023-12-01T15:24:32.740 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.Gevm9Zpb7J 2023-12-01T15:24:32.755 INFO:teuthology.orchestra.run.smithi146.stderr:done 2023-12-01T15:24:32.757 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2023-12-01T15:24:32.796 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.Gevm9Zpb7J is 9KB 2023-12-01T15:24:32.815 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.Gevm9Zpb7J 2023-12-01T15:24:32.822 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-12-01T15:24:32.878 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:24:32.879 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-12-01T15:24:32.879 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-12-01T15:24:32.928 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-167-generic 2023-12-01T15:24:32.928 DEBUG:teuthology.orchestra.run.smithi066:> sudo update-grub 2023-12-01T15:24:33.829 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T15:24:33.855 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-01T15:24:33.923 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T15:24:34.132 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T15:24:34.133 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T15:24:34.189 INFO:teuthology.orchestra.run.smithi066.stderr:Sourcing file `/etc/default/grub' 2023-12-01T15:24:34.198 INFO:teuthology.orchestra.run.smithi066.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-01T15:24:34.207 INFO:teuthology.orchestra.run.smithi066.stderr:Generating grub configuration file ... 2023-12-01T15:24:34.367 INFO:teuthology.orchestra.run.smithi063.stdout:linux-image-generic is already the newest version (5.4.0.167.164). 2023-12-01T15:24:34.368 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 280 not upgraded. 2023-12-01T15:24:34.369 DEBUG:teuthology.orchestra.run.smithi063:> dpkg -s linux-image-generic 2023-12-01T15:24:34.392 INFO:teuthology.orchestra.run.smithi063.stdout:Package: linux-image-generic 2023-12-01T15:24:34.393 INFO:teuthology.orchestra.run.smithi063.stdout:Status: install ok installed 2023-12-01T15:24:34.393 INFO:teuthology.orchestra.run.smithi063.stdout:Priority: optional 2023-12-01T15:24:34.393 INFO:teuthology.orchestra.run.smithi063.stdout:Section: kernel 2023-12-01T15:24:34.394 INFO:teuthology.orchestra.run.smithi063.stdout:Installed-Size: 20 2023-12-01T15:24:34.394 INFO:teuthology.orchestra.run.smithi063.stdout:Maintainer: Ubuntu Kernel Team 2023-12-01T15:24:34.394 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: amd64 2023-12-01T15:24:34.395 INFO:teuthology.orchestra.run.smithi063.stdout:Source: linux-meta 2023-12-01T15:24:34.395 INFO:teuthology.orchestra.run.smithi063.stdout:Version: 5.4.0.167.164 2023-12-01T15:24:34.395 INFO:teuthology.orchestra.run.smithi063.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-12-01T15:24:34.395 INFO:teuthology.orchestra.run.smithi063.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-01T15:24:34.396 INFO:teuthology.orchestra.run.smithi063.stdout:Recommends: thermald 2023-12-01T15:24:34.396 INFO:teuthology.orchestra.run.smithi063.stdout:Description: Generic Linux kernel image 2023-12-01T15:24:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: This package will always depend on the latest generic kernel image 2023-12-01T15:24:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: available. 2023-12-01T15:24:34.397 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2023-12-01T15:24:34.416 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.WJvlItpRUV 2023-12-01T15:24:34.416 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub/grub.cfg /tmp/tmp.WJvlItpRUV 2023-12-01T15:24:34.436 INFO:teuthology.orchestra.run.smithi066.stderr:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-12-01T15:24:34.448 INFO:teuthology.orchestra.run.smithi066.stderr:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-12-01T15:24:34.473 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.WJvlItpRUV 2023-12-01T15:24:34.510 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.WJvlItpRUV is 9KB 2023-12-01T15:24:34.528 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.WJvlItpRUV 2023-12-01T15:24:34.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-12-01T15:24:34.595 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:24:34.595 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-12-01T15:24:34.595 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-12-01T15:24:34.625 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-167-generic 2023-12-01T15:24:34.625 DEBUG:teuthology.orchestra.run.smithi063:> sudo update-grub 2023-12-01T15:24:34.797 INFO:teuthology.orchestra.run.smithi066.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-01T15:24:34.810 INFO:teuthology.orchestra.run.smithi066.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-01T15:24:35.677 INFO:teuthology.orchestra.run.smithi066.stderr:done 2023-12-01T15:24:35.679 DEBUG:teuthology.orchestra.run.smithi066:> sudo shutdown -r now 2023-12-01T15:24:35.994 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub' 2023-12-01T15:24:36.005 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-01T15:24:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2023-12-01T15:24:36.347 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-12-01T15:24:36.359 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-12-01T15:24:36.819 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-01T15:24:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-01T15:24:37.879 INFO:teuthology.orchestra.run.smithi063.stderr:done 2023-12-01T15:24:37.879 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2023-12-01T15:25:02.787 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-01T15:25:02.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-01T15:25:02.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:25:05.688 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-01T15:25:05.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-01T15:25:05.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:25:07.885 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-01T15:25:07.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-01T15:25:07.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:26:02.847 DEBUG:teuthology.orchestra.remote:timed out 2023-12-01T15:26:05.693 DEBUG:teuthology.orchestra.remote:timed out 2023-12-01T15:26:07.890 DEBUG:teuthology.orchestra.remote:timed out 2023-12-01T15:26:11.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-01T15:26:11.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:26:14.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-01T15:26:14.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:26:16.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-01T15:26:16.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:26:17.766 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-12-01T15:26:18.983 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-12-01T15:26:24.493 DEBUG:teuthology.orchestra.run.smithi063:> true 2023-12-01T15:26:25.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-01T15:26:25.493 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-167-generic"... 2023-12-01T15:26:25.494 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2023-12-01T15:26:25.501 INFO:teuthology.orchestra.run.smithi063.stdout:5.4.0-167-generic 2023-12-01T15:26:25.502 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-167-generic vs 5.4.0-167-generic 2023-12-01T15:26:25.502 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-01T15:26:25.502 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-01T15:26:26.503 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-01T15:26:26.503 DEBUG:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-01T15:26:27.003 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2023-12-01T15:26:27.049 DEBUG:teuthology.parallel:result is None 2023-12-01T15:26:29.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-01T15:26:29.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:26:30.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-01T15:26:30.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:26:31.193 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-12-01T15:26:31.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-01T15:26:31.803 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.4.0-167-generic"... 2023-12-01T15:26:31.803 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-12-01T15:26:31.854 INFO:teuthology.orchestra.run.smithi146.stdout:5.4.0-167-generic 2023-12-01T15:26:31.854 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-167-generic vs 5.4.0-167-generic 2023-12-01T15:26:31.854 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-01T15:26:31.855 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-01T15:26:32.834 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-12-01T15:26:32.855 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-12-01T15:26:32.855 DEBUG:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-01T15:26:32.941 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2023-12-01T15:26:32.971 DEBUG:teuthology.parallel:result is None 2023-12-01T15:26:47.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-01T15:26:47.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:26:50.914 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-12-01T15:27:08.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-01T15:27:08.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:27:09.136 DEBUG:teuthology.orchestra.run.smithi066:> true 2023-12-01T15:27:09.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-01T15:27:09.846 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-167-generic"... 2023-12-01T15:27:09.847 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2023-12-01T15:27:09.859 INFO:teuthology.orchestra.run.smithi066.stdout:5.4.0-167-generic 2023-12-01T15:27:09.860 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-167-generic vs 5.4.0-167-generic 2023-12-01T15:27:09.860 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-01T15:27:09.860 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-01T15:27:10.861 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-01T15:27:10.861 DEBUG:teuthology.orchestra.run.smithi066:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-01T15:27:10.955 INFO:teuthology.orchestra.run.smithi066.stdout:ttyS1 2023-12-01T15:27:10.984 DEBUG:teuthology.parallel:result is None 2023-12-01T15:27:10.985 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-01T15:27:10.993 INFO:teuthology.task.internal:Creating test directory... 2023-12-01T15:27:10.994 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-01T15:27:10.997 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-01T15:27:11.000 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-01T15:27:11.008 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-01T15:27:11.025 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-01T15:27:11.045 INFO:teuthology.task.internal:Creating archive directory... 2023-12-01T15:27:11.045 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-01T15:27:11.051 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-01T15:27:11.058 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-01T15:27:11.086 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-01T15:27:11.098 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-01T15:27:11.098 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-01T15:27:11.110 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-01T15:27:11.114 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-01T15:27:11.135 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T15:27:11.162 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T15:27:11.165 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T15:27:11.166 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T15:27:11.166 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T15:27:11.168 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T15:27:11.168 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-01T15:27:11.202 INFO:teuthology.task.internal:Configuring sudo... 2023-12-01T15:27:11.203 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-01T15:27:11.206 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-01T15:27:11.215 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-01T15:27:11.232 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-01T15:27:11.243 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-01T15:27:11.244 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-01T15:27:11.268 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-01T15:27:11.270 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-01T15:27:11.284 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T15:27:11.302 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T15:27:11.314 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:27:11.315 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-01T15:27:11.379 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T15:27:11.387 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T15:27:11.397 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:27:11.398 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-01T15:27:11.473 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T15:27:11.481 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T15:27:11.533 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:27:11.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-01T15:27:11.568 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2023-12-01T15:27:11.572 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2023-12-01T15:27:11.576 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2023-12-01T15:27:11.635 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-01T15:27:11.645 INFO:teuthology.task.internal:Starting timer... 2023-12-01T15:27:11.646 INFO:teuthology.run_tasks:Running task pcp... 2023-12-01T15:27:11.727 INFO:teuthology.run_tasks:Running task selinux... 2023-12-01T15:27:11.751 DEBUG:teuthology.task.selinux:Excluding smithi063: OS 'ubuntu' does not support SELinux 2023-12-01T15:27:11.751 DEBUG:teuthology.task.selinux:Excluding smithi066: OS 'ubuntu' does not support SELinux 2023-12-01T15:27:11.751 DEBUG:teuthology.task.selinux:Excluding smithi146: OS 'ubuntu' does not support SELinux 2023-12-01T15:27:11.751 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-01T15:27:11.751 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-01T15:27:11.751 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-01T15:27:11.752 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-01T15:27:11.779 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-01T15:27:11.835 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-01T15:27:12.048 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi066.front.sepia.ceph.com,smithi146.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-01T15:37:52.697 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com')] 2023-12-01T15:37:52.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-01T15:37:52.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:37:52.749 DEBUG:teuthology.orchestra.run.smithi063:> true 2023-12-01T15:37:52.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-01T15:37:52.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-01T15:37:52.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:37:52.923 DEBUG:teuthology.orchestra.run.smithi066:> true 2023-12-01T15:37:53.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-01T15:37:53.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-01T15:37:53.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:37:53.092 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-12-01T15:37:53.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-01T15:37:53.221 INFO:teuthology.run_tasks:Running task clock... 2023-12-01T15:37:53.233 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-01T15:37:53.234 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-01T15:37:53.234 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T15:37:53.236 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-01T15:37:53.236 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T15:37:53.239 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-01T15:37:53.239 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T15:37:53.267 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-12-01T15:37:53.267 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: Command line: ntpd -gq 2023-12-01T15:37:53.268 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: proto: precision = 0.067 usec (-24) 2023-12-01T15:37:53.269 INFO:teuthology.orchestra.run.smithi063.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-01T15:37:53.269 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-01T15:37:53.269 INFO:teuthology.orchestra.run.smithi063.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-01T15:37:53.270 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: restrict ::: KOD does nothing without LIMITED. 2023-12-01T15:37:53.270 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: Listen and drop on 0 v6wildcard [::]:123 2023-12-01T15:37:53.270 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-01T15:37:53.270 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: Listen normally on 2 lo 127.0.0.1:123 2023-12-01T15:37:53.271 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: Listen normally on 3 enp3s0f1 172.21.15.63:123 2023-12-01T15:37:53.271 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: Listen normally on 4 lo [::1]:123 2023-12-01T15:37:53.271 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8d7%5]:123 2023-12-01T15:37:53.271 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:37:53 ntpd[23593]: Listening on routing socket on fd #22 for interface updates 2023-12-01T15:37:53.273 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-12-01T15:37:53.274 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: Command line: ntpd -gq 2023-12-01T15:37:53.275 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-12-01T15:37:53.275 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: Command line: ntpd -gq 2023-12-01T15:37:53.275 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: proto: precision = 0.098 usec (-23) 2023-12-01T15:37:53.275 INFO:teuthology.orchestra.run.smithi066.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-01T15:37:53.276 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-01T15:37:53.276 INFO:teuthology.orchestra.run.smithi066.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-01T15:37:53.277 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: restrict ::: KOD does nothing without LIMITED. 2023-12-01T15:37:53.277 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: Listen and drop on 0 v6wildcard [::]:123 2023-12-01T15:37:53.277 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-01T15:37:53.277 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: Listen normally on 2 lo 127.0.0.1:123 2023-12-01T15:37:53.277 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: Listen normally on 3 enp3s0f1 172.21.15.66:123 2023-12-01T15:37:53.278 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: Listen normally on 4 lo [::1]:123 2023-12-01T15:37:53.278 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8bd%5]:123 2023-12-01T15:37:53.278 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:37:53 ntpd[23653]: Listening on routing socket on fd #22 for interface updates 2023-12-01T15:37:53.278 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: proto: precision = 0.083 usec (-23) 2023-12-01T15:37:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-01T15:37:53.279 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-01T15:37:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-01T15:37:53.280 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: restrict ::: KOD does nothing without LIMITED. 2023-12-01T15:37:53.280 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: Listen and drop on 0 v6wildcard [::]:123 2023-12-01T15:37:53.280 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-01T15:37:53.280 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: Listen normally on 2 lo 127.0.0.1:123 2023-12-01T15:37:53.280 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: Listen normally on 3 enp3s0f1 172.21.15.146:123 2023-12-01T15:37:53.280 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: Listen normally on 4 lo [::1]:123 2023-12-01T15:37:53.281 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:76fd%5]:123 2023-12-01T15:37:53.281 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:37:53 ntpd[23675]: Listening on routing socket on fd #22 for interface updates 2023-12-01T15:37:54.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:54.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:54.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:54.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:54 ntpd[23593]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:54.275 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:54.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:54.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:54.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:54.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:54.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:54 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:54.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:54.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:54.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:54.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:54.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:54.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:54 ntpd[23675]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:55.274 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:55 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:55.274 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:55 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:56.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:56.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:56.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:56 ntpd[23593]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:56.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:56.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:56.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:56.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:56.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:56.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:56 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:56.280 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:56.280 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:56.280 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:56 ntpd[23675]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:57.268 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:57 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:57.268 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:57 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:57.275 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:57 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:57.276 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:57 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:57.276 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:57 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:57.276 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:57 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:57.276 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:57 ntpd[23675]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:57.276 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:57 ntpd[23675]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:58.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:58.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:58.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.271 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:58.271 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:58.271 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.271 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.271 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:58.271 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:37:58 ntpd[23593]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:58.275 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:58.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:58.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:58.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:37:58 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:58.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:58.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:58.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:58.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:58.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:58.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:58 ntpd[23675]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:37:59.276 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:59 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:59.276 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:59 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:59.276 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:59 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:37:59.276 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:59 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:37:59.276 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:59 ntpd[23675]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:37:59.276 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:37:59 ntpd[23675]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:38:00.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:38:00.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:38:00.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:38:00.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:38:00.269 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:38:00.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:38:00.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:38:00.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:38:00.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:38:00.270 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:38:00.270 INFO:teuthology.orchestra.run.smithi063.stdout: 1 Dec 15:38:00 ntpd[23593]: ntpd: time slew +0.004926 s 2023-12-01T15:38:00.270 INFO:teuthology.orchestra.run.smithi063.stdout:ntpd: time slew +0.004926s 2023-12-01T15:38:00.271 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-01T15:38:00.271 INFO:teuthology.orchestra.run.smithi063.stderr: 1 Dec 15:38:00 ntpd[23593]: can't open /var/log/ntpstats/loopstats.20231201: Permission denied 2023-12-01T15:38:00.275 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:38:00.275 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:38:00.275 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:38:00.275 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:38:00.275 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:38:00.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:38:00.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:38:00.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:38:00.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:38:00.276 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:38:00.276 INFO:teuthology.orchestra.run.smithi066.stdout: 1 Dec 15:38:00 ntpd[23653]: ntpd: time slew +0.005124 s 2023-12-01T15:38:00.276 INFO:teuthology.orchestra.run.smithi066.stdout:ntpd: time slew +0.005124s 2023-12-01T15:38:00.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-01T15:38:00.277 INFO:teuthology.orchestra.run.smithi066.stderr: 1 Dec 15:38:00 ntpd[23653]: can't open /var/log/ntpstats/loopstats.20231201: Permission denied 2023-12-01T15:38:00.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:38:00 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:38:00.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:38:00 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:38:00.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:38:00 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:38:00.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:38:00 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:38:00.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:38:00 ntpd[23675]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-01T15:38:00.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:38:00 ntpd[23675]: can't open /var/log/ntpstats/rawstats.20231201: Permission denied 2023-12-01T15:38:00.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:38:00 ntpd[23675]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-01T15:38:00.278 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:38:00 ntpd[23675]: can't open /var/log/ntpstats/peerstats.20231201: Permission denied 2023-12-01T15:38:00.278 INFO:teuthology.orchestra.run.smithi146.stdout: 1 Dec 15:38:00 ntpd[23675]: ntpd: time slew +0.003595 s 2023-12-01T15:38:00.279 INFO:teuthology.orchestra.run.smithi146.stdout:ntpd: time slew +0.003595s 2023-12-01T15:38:00.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:38:00 ntpd[23675]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-01T15:38:00.279 INFO:teuthology.orchestra.run.smithi146.stderr: 1 Dec 15:38:00 ntpd[23675]: can't open /var/log/ntpstats/loopstats.20231201: Permission denied 2023-12-01T15:38:00.341 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2023-12-01T15:38:00.341 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2023-12-01T15:38:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: remote refid st t when poll reach delay offset jitter 2023-12-01T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================== 2023-12-01T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.350 INFO:teuthology.orchestra.run.smithi066.stdout: remote refid st t when poll reach delay offset jitter 2023-12-01T15:38:00.350 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================== 2023-12-01T15:38:00.351 INFO:teuthology.orchestra.run.smithi066.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.351 INFO:teuthology.orchestra.run.smithi066.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.351 INFO:teuthology.orchestra.run.smithi066.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.351 INFO:teuthology.orchestra.run.smithi066.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-01T15:38:00.352 INFO:teuthology.run_tasks:Running task install... 2023-12-01T15:38:00.361 DEBUG:teuthology.task.install:project ceph 2023-12-01T15:38:00.361 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'}} 2023-12-01T15:38:00.361 DEBUG:teuthology.task.install:config {'cleanup': True, 'flavor': 'default', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'} 2023-12-01T15:38:00.361 INFO:teuthology.task.install:Using flavor: default 2023-12-01T15:38:00.367 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-01T15:38:00.367 INFO:teuthology.task.install:extra packages: [] 2023-12-01T15:38:00.367 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-key list | grep Ceph 2023-12-01T15:38:00.368 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-key list | grep Ceph 2023-12-01T15:38:00.368 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-key list | grep Ceph 2023-12-01T15:38:00.467 INFO:teuthology.orchestra.run.smithi066.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-12-01T15:38:00.474 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-12-01T15:38:00.479 INFO:teuthology.orchestra.run.smithi146.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-12-01T15:38:00.528 INFO:teuthology.orchestra.run.smithi066.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-01T15:38:00.528 INFO:teuthology.orchestra.run.smithi066.stdout:uid [ unknown] Ceph.com (release key) 2023-12-01T15:38:00.529 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-12-01T15:38:00.530 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T15:38:00.534 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-01T15:38:00.534 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph.com (release key) 2023-12-01T15:38:00.535 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-12-01T15:38:00.535 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T15:38:00.539 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-01T15:38:00.539 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph.com (release key) 2023-12-01T15:38:00.540 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-12-01T15:38:00.540 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T15:38:00.749 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default/ 2023-12-01T15:38:00.750 INFO:teuthology.task.install.deb:Package version is 18.2.0-1249-ga6f82997-1focal 2023-12-01T15:38:00.757 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default/ 2023-12-01T15:38:00.757 INFO:teuthology.task.install.deb:Package version is 18.2.0-1249-ga6f82997-1focal 2023-12-01T15:38:00.761 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default/ 2023-12-01T15:38:00.761 INFO:teuthology.task.install.deb:Package version is 18.2.0-1249-ga6f82997-1focal 2023-12-01T15:38:01.057 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:38:01.058 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-01T15:38:01.075 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2023-12-01T15:38:01.114 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:38:01.114 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-01T15:38:01.120 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:38:01.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-01T15:38:01.131 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2023-12-01T15:38:01.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2023-12-01T15:38:01.259 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-01T15:38:01.259 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T15:38:01.271 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-01T15:38:01.276 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T15:38:01.276 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-01T15:38:01.281 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-01T15:38:01.291 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-01T15:38:01.298 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-01T15:38:01.331 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-01T15:38:01.445 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T15:38:01.526 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-01T15:38:01.549 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal InRelease 2023-12-01T15:38:01.591 INFO:teuthology.orchestra.run.smithi066.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal InRelease 2023-12-01T15:38:01.608 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-01T15:38:01.616 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal InRelease 2023-12-01T15:38:01.631 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-12-01T15:38:01.673 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-12-01T15:38:01.696 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-12-01T15:38:01.714 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal Release.gpg 2023-12-01T15:38:01.755 INFO:teuthology.orchestra.run.smithi066.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal Release.gpg 2023-12-01T15:38:01.780 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal Release.gpg 2023-12-01T15:38:01.797 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main i386 Packages [3,428 B] 2023-12-01T15:38:01.838 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main i386 Packages [3,428 B] 2023-12-01T15:38:01.864 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main i386 Packages [3,428 B] 2023-12-01T15:38:01.901 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-12-01T15:38:01.945 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-12-01T15:38:01.973 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-12-01T15:38:02.044 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 28.4 kB in 1s (37.9 kB/s) 2023-12-01T15:38:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 28.4 kB in 1s (39.2 kB/s) 2023-12-01T15:38:02.088 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 28.4 kB in 1s (35.4 kB/s) 2023-12-01T15:38:03.148 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T15:38:03.154 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T15:38:03.175 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-1249-ga6f82997-1focal cephadm=18.2.0-1249-ga6f82997-1focal ceph-mds=18.2.0-1249-ga6f82997-1focal ceph-mgr=18.2.0-1249-ga6f82997-1focal ceph-common=18.2.0-1249-ga6f82997-1focal ceph-fuse=18.2.0-1249-ga6f82997-1focal ceph-test=18.2.0-1249-ga6f82997-1focal ceph-volume=18.2.0-1249-ga6f82997-1focal radosgw=18.2.0-1249-ga6f82997-1focal python3-rados=18.2.0-1249-ga6f82997-1focal python3-rgw=18.2.0-1249-ga6f82997-1focal python3-cephfs=18.2.0-1249-ga6f82997-1focal python3-rbd=18.2.0-1249-ga6f82997-1focal libcephfs2=18.2.0-1249-ga6f82997-1focal libcephfs-dev=18.2.0-1249-ga6f82997-1focal librados2=18.2.0-1249-ga6f82997-1focal librbd1=18.2.0-1249-ga6f82997-1focal rbd-fuse=18.2.0-1249-ga6f82997-1focal 2023-12-01T15:38:03.180 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-1249-ga6f82997-1focal cephadm=18.2.0-1249-ga6f82997-1focal ceph-mds=18.2.0-1249-ga6f82997-1focal ceph-mgr=18.2.0-1249-ga6f82997-1focal ceph-common=18.2.0-1249-ga6f82997-1focal ceph-fuse=18.2.0-1249-ga6f82997-1focal ceph-test=18.2.0-1249-ga6f82997-1focal ceph-volume=18.2.0-1249-ga6f82997-1focal radosgw=18.2.0-1249-ga6f82997-1focal python3-rados=18.2.0-1249-ga6f82997-1focal python3-rgw=18.2.0-1249-ga6f82997-1focal python3-cephfs=18.2.0-1249-ga6f82997-1focal python3-rbd=18.2.0-1249-ga6f82997-1focal libcephfs2=18.2.0-1249-ga6f82997-1focal libcephfs-dev=18.2.0-1249-ga6f82997-1focal librados2=18.2.0-1249-ga6f82997-1focal librbd1=18.2.0-1249-ga6f82997-1focal rbd-fuse=18.2.0-1249-ga6f82997-1focal 2023-12-01T15:38:03.249 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T15:38:03.252 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T15:38:03.276 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T15:38:03.302 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-1249-ga6f82997-1focal cephadm=18.2.0-1249-ga6f82997-1focal ceph-mds=18.2.0-1249-ga6f82997-1focal ceph-mgr=18.2.0-1249-ga6f82997-1focal ceph-common=18.2.0-1249-ga6f82997-1focal ceph-fuse=18.2.0-1249-ga6f82997-1focal ceph-test=18.2.0-1249-ga6f82997-1focal ceph-volume=18.2.0-1249-ga6f82997-1focal radosgw=18.2.0-1249-ga6f82997-1focal python3-rados=18.2.0-1249-ga6f82997-1focal python3-rgw=18.2.0-1249-ga6f82997-1focal python3-cephfs=18.2.0-1249-ga6f82997-1focal python3-rbd=18.2.0-1249-ga6f82997-1focal libcephfs2=18.2.0-1249-ga6f82997-1focal libcephfs-dev=18.2.0-1249-ga6f82997-1focal librados2=18.2.0-1249-ga6f82997-1focal librbd1=18.2.0-1249-ga6f82997-1focal rbd-fuse=18.2.0-1249-ga6f82997-1focal 2023-12-01T15:38:03.376 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T15:38:03.453 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T15:38:03.454 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T15:38:03.457 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T15:38:03.458 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T15:38:03.590 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T15:38:03.591 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T15:38:03.627 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T15:38:03.628 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-01T15:38:03.628 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T15:38:03.628 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2023-12-01T15:38:03.628 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-01T15:38:03.628 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-12-01T15:38:03.629 INFO:teuthology.orchestra.run.smithi146.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T15:38:03.629 INFO:teuthology.orchestra.run.smithi146.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-12-01T15:38:03.629 INFO:teuthology.orchestra.run.smithi146.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-12-01T15:38:03.629 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-12-01T15:38:03.630 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T15:38:03.630 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-12-01T15:38:03.630 INFO:teuthology.orchestra.run.smithi146.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-12-01T15:38:03.630 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-12-01T15:38:03.630 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-12-01T15:38:03.630 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T15:38:03.630 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-01T15:38:03.630 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-01T15:38:03.630 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-01T15:38:03.630 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-12-01T15:38:03.630 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T15:38:03.631 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-12-01T15:38:03.631 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T15:38:03.631 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-01T15:38:03.631 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-12-01T15:38:03.631 INFO:teuthology.orchestra.run.smithi146.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-01T15:38:03.631 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2023-12-01T15:38:03.631 INFO:teuthology.orchestra.run.smithi146.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-12-01T15:38:03.631 INFO:teuthology.orchestra.run.smithi146.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-12-01T15:38:03.631 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-12-01T15:38:03.632 INFO:teuthology.orchestra.run.smithi146.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-12-01T15:38:03.632 INFO:teuthology.orchestra.run.smithi146.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-12-01T15:38:03.632 INFO:teuthology.orchestra.run.smithi146.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-12-01T15:38:03.632 INFO:teuthology.orchestra.run.smithi146.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-12-01T15:38:03.632 INFO:teuthology.orchestra.run.smithi146.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-01T15:38:03.632 INFO:teuthology.orchestra.run.smithi146.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-12-01T15:38:03.632 INFO:teuthology.orchestra.run.smithi146.stdout:Recommended packages: 2023-12-01T15:38:03.632 INFO:teuthology.orchestra.run.smithi146.stdout: btrfs-tools 2023-12-01T15:38:03.650 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T15:38:03.651 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-01T15:38:03.652 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T15:38:03.652 INFO:teuthology.orchestra.run.smithi066.stdout:The following additional packages will be installed: 2023-12-01T15:38:03.652 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-01T15:38:03.652 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-12-01T15:38:03.652 INFO:teuthology.orchestra.run.smithi066.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T15:38:03.652 INFO:teuthology.orchestra.run.smithi066.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-12-01T15:38:03.653 INFO:teuthology.orchestra.run.smithi066.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-12-01T15:38:03.653 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-12-01T15:38:03.653 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T15:38:03.654 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-12-01T15:38:03.654 INFO:teuthology.orchestra.run.smithi066.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-12-01T15:38:03.654 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-12-01T15:38:03.654 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-12-01T15:38:03.654 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T15:38:03.655 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-01T15:38:03.655 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-01T15:38:03.655 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-01T15:38:03.655 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-12-01T15:38:03.655 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T15:38:03.656 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-12-01T15:38:03.656 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T15:38:03.656 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-01T15:38:03.656 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-12-01T15:38:03.656 INFO:teuthology.orchestra.run.smithi066.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-01T15:38:03.656 INFO:teuthology.orchestra.run.smithi066.stdout:Suggested packages: 2023-12-01T15:38:03.657 INFO:teuthology.orchestra.run.smithi066.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-12-01T15:38:03.657 INFO:teuthology.orchestra.run.smithi066.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-12-01T15:38:03.657 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-12-01T15:38:03.657 INFO:teuthology.orchestra.run.smithi066.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-12-01T15:38:03.657 INFO:teuthology.orchestra.run.smithi066.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-12-01T15:38:03.657 INFO:teuthology.orchestra.run.smithi066.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-12-01T15:38:03.657 INFO:teuthology.orchestra.run.smithi066.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-12-01T15:38:03.657 INFO:teuthology.orchestra.run.smithi066.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-01T15:38:03.657 INFO:teuthology.orchestra.run.smithi066.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-12-01T15:38:03.657 INFO:teuthology.orchestra.run.smithi066.stdout:Recommended packages: 2023-12-01T15:38:03.657 INFO:teuthology.orchestra.run.smithi066.stdout: btrfs-tools 2023-12-01T15:38:03.741 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2023-12-01T15:38:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-01T15:38:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-01T15:38:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-01T15:38:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-12-01T15:38:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-12-01T15:38:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-12-01T15:38:03.742 INFO:teuthology.orchestra.run.smithi146.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-12-01T15:38:03.742 INFO:teuthology.orchestra.run.smithi146.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-12-01T15:38:03.743 INFO:teuthology.orchestra.run.smithi146.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-12-01T15:38:03.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-12-01T15:38:03.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-01T15:38:03.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-12-01T15:38:03.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T15:38:03.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T15:38:03.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-01T15:38:03.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-01T15:38:03.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-01T15:38:03.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-12-01T15:38:03.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-12-01T15:38:03.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-12-01T15:38:03.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-01T15:38:03.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-12-01T15:38:03.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-12-01T15:38:03.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-12-01T15:38:03.744 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet 2023-12-01T15:38:03.744 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be upgraded: 2023-12-01T15:38:03.744 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 librbd1 2023-12-01T15:38:03.769 INFO:teuthology.orchestra.run.smithi066.stdout:The following NEW packages will be installed: 2023-12-01T15:38:03.769 INFO:teuthology.orchestra.run.smithi066.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-01T15:38:03.769 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-01T15:38:03.769 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-01T15:38:03.770 INFO:teuthology.orchestra.run.smithi066.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-12-01T15:38:03.771 INFO:teuthology.orchestra.run.smithi066.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-12-01T15:38:03.771 INFO:teuthology.orchestra.run.smithi066.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-12-01T15:38:03.771 INFO:teuthology.orchestra.run.smithi066.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-12-01T15:38:03.771 INFO:teuthology.orchestra.run.smithi066.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-12-01T15:38:03.771 INFO:teuthology.orchestra.run.smithi066.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-12-01T15:38:03.771 INFO:teuthology.orchestra.run.smithi066.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-12-01T15:38:03.771 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-01T15:38:03.771 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-12-01T15:38:03.771 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T15:38:03.771 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T15:38:03.771 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-01T15:38:03.772 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-01T15:38:03.772 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-01T15:38:03.772 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-12-01T15:38:03.772 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-12-01T15:38:03.772 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-12-01T15:38:03.772 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-01T15:38:03.772 INFO:teuthology.orchestra.run.smithi066.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-12-01T15:38:03.772 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-12-01T15:38:03.772 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-12-01T15:38:03.772 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet 2023-12-01T15:38:03.773 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be upgraded: 2023-12-01T15:38:03.773 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 librbd1 2023-12-01T15:38:03.781 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T15:38:03.782 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-01T15:38:03.782 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T15:38:03.782 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2023-12-01T15:38:03.783 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-01T15:38:03.783 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-12-01T15:38:03.783 INFO:teuthology.orchestra.run.smithi063.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T15:38:03.783 INFO:teuthology.orchestra.run.smithi063.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-12-01T15:38:03.783 INFO:teuthology.orchestra.run.smithi063.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-12-01T15:38:03.784 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-12-01T15:38:03.784 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T15:38:03.784 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-12-01T15:38:03.784 INFO:teuthology.orchestra.run.smithi063.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-12-01T15:38:03.784 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-12-01T15:38:03.784 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-12-01T15:38:03.784 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T15:38:03.784 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-01T15:38:03.784 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-01T15:38:03.785 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-01T15:38:03.785 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-12-01T15:38:03.785 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T15:38:03.785 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-12-01T15:38:03.785 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T15:38:03.785 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-01T15:38:03.785 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-12-01T15:38:03.785 INFO:teuthology.orchestra.run.smithi063.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout:Recommended packages: 2023-12-01T15:38:03.786 INFO:teuthology.orchestra.run.smithi063.stdout: btrfs-tools 2023-12-01T15:38:03.808 INFO:teuthology.orchestra.run.smithi146.stdout:2 upgraded, 110 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T15:38:03.808 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 208 MB of archives. 2023-12-01T15:38:03.808 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 1,029 MB of additional disk space will be used. 2023-12-01T15:38:03.808 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-12-01T15:38:03.837 INFO:teuthology.orchestra.run.smithi066.stdout:2 upgraded, 110 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T15:38:03.837 INFO:teuthology.orchestra.run.smithi066.stdout:Need to get 208 MB of archives. 2023-12-01T15:38:03.837 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 1,029 MB of additional disk space will be used. 2023-12-01T15:38:03.837 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-12-01T15:38:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-12-01T15:38:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-12-01T15:38:03.904 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2023-12-01T15:38:03.904 INFO:teuthology.orchestra.run.smithi063.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-01T15:38:03.904 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-01T15:38:03.904 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-01T15:38:03.904 INFO:teuthology.orchestra.run.smithi063.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-12-01T15:38:03.904 INFO:teuthology.orchestra.run.smithi063.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-12-01T15:38:03.904 INFO:teuthology.orchestra.run.smithi063.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-12-01T15:38:03.905 INFO:teuthology.orchestra.run.smithi063.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-12-01T15:38:03.905 INFO:teuthology.orchestra.run.smithi063.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-12-01T15:38:03.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-12-01T15:38:03.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-01T15:38:03.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-12-01T15:38:03.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-12-01T15:38:03.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-12-01T15:38:03.907 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet 2023-12-01T15:38:03.907 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be upgraded: 2023-12-01T15:38:03.907 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 librbd1 2023-12-01T15:38:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-12-01T15:38:03.920 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-12-01T15:38:03.923 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-12-01T15:38:03.940 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-12-01T15:38:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-12-01T15:38:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-12-01T15:38:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-12-01T15:38:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-12-01T15:38:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-12-01T15:38:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-12-01T15:38:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-12-01T15:38:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-12-01T15:38:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-12-01T15:38:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-12-01T15:38:03.992 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-12-01T15:38:03.994 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-12-01T15:38:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-12-01T15:38:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-12-01T15:38:03.999 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-12-01T15:38:04.000 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-12-01T15:38:04.000 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-01T15:38:04.001 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-12-01T15:38:04.001 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-12-01T15:38:04.002 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-12-01T15:38:04.002 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-12-01T15:38:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-12-01T15:38:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-12-01T15:38:04.004 INFO:teuthology.orchestra.run.smithi066.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-12-01T15:38:04.004 INFO:teuthology.orchestra.run.smithi066.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-12-01T15:38:04.007 INFO:teuthology.orchestra.run.smithi066.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-12-01T15:38:04.007 INFO:teuthology.orchestra.run.smithi066.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-12-01T15:38:04.010 INFO:teuthology.orchestra.run.smithi066.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-12-01T15:38:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-12-01T15:38:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-12-01T15:38:04.025 INFO:teuthology.orchestra.run.smithi066.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-12-01T15:38:04.026 INFO:teuthology.orchestra.run.smithi066.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-12-01T15:38:04.026 INFO:teuthology.orchestra.run.smithi066.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-12-01T15:38:04.027 INFO:teuthology.orchestra.run.smithi066.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-01T15:38:04.028 INFO:teuthology.orchestra.run.smithi066.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-12-01T15:38:04.028 INFO:teuthology.orchestra.run.smithi066.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-12-01T15:38:04.029 INFO:teuthology.orchestra.run.smithi066.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-12-01T15:38:04.030 INFO:teuthology.orchestra.run.smithi066.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-12-01T15:38:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-12-01T15:38:04.032 INFO:teuthology.orchestra.run.smithi066.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-12-01T15:38:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-12-01T15:38:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-12-01T15:38:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-12-01T15:38:04.040 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-12-01T15:38:04.041 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-12-01T15:38:04.043 INFO:teuthology.orchestra.run.smithi066.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-12-01T15:38:04.044 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-12-01T15:38:04.047 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-12-01T15:38:04.048 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-12-01T15:38:04.049 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-12-01T15:38:04.051 INFO:teuthology.orchestra.run.smithi066.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-12-01T15:38:04.058 INFO:teuthology.orchestra.run.smithi066.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-12-01T15:38:04.058 INFO:teuthology.orchestra.run.smithi066.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-12-01T15:38:04.059 INFO:teuthology.orchestra.run.smithi066.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-12-01T15:38:04.060 INFO:teuthology.orchestra.run.smithi066.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-12-01T15:38:04.062 INFO:teuthology.orchestra.run.smithi066.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-12-01T15:38:04.065 INFO:teuthology.orchestra.run.smithi066.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-12-01T15:38:04.065 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-12-01T15:38:04.065 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-12-01T15:38:04.066 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-12-01T15:38:04.067 INFO:teuthology.orchestra.run.smithi066.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-12-01T15:38:04.067 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-12-01T15:38:04.067 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-12-01T15:38:04.068 INFO:teuthology.orchestra.run.smithi066.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-12-01T15:38:04.068 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-12-01T15:38:04.069 INFO:teuthology.orchestra.run.smithi146.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-12-01T15:38:04.069 INFO:teuthology.orchestra.run.smithi146.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-12-01T15:38:04.077 INFO:teuthology.orchestra.run.smithi066.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-12-01T15:38:04.078 INFO:teuthology.orchestra.run.smithi066.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-12-01T15:38:04.078 INFO:teuthology.orchestra.run.smithi066.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-12-01T15:38:04.082 INFO:teuthology.orchestra.run.smithi146.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-12-01T15:38:04.085 INFO:teuthology.orchestra.run.smithi146.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-01T15:38:04.094 INFO:teuthology.orchestra.run.smithi066.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-12-01T15:38:04.094 INFO:teuthology.orchestra.run.smithi066.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-12-01T15:38:04.095 INFO:teuthology.orchestra.run.smithi066.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-12-01T15:38:04.097 INFO:teuthology.orchestra.run.smithi066.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-12-01T15:38:04.097 INFO:teuthology.orchestra.run.smithi066.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-12-01T15:38:04.098 INFO:teuthology.orchestra.run.smithi066.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-12-01T15:38:04.098 INFO:teuthology.orchestra.run.smithi063.stdout:2 upgraded, 110 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T15:38:04.099 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 208 MB of archives. 2023-12-01T15:38:04.099 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 1,029 MB of additional disk space will be used. 2023-12-01T15:38:04.099 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-12-01T15:38:04.099 INFO:teuthology.orchestra.run.smithi066.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-12-01T15:38:04.099 INFO:teuthology.orchestra.run.smithi146.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-12-01T15:38:04.102 INFO:teuthology.orchestra.run.smithi146.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-12-01T15:38:04.104 INFO:teuthology.orchestra.run.smithi146.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-12-01T15:38:04.107 INFO:teuthology.orchestra.run.smithi146.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-12-01T15:38:04.107 INFO:teuthology.orchestra.run.smithi146.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-12-01T15:38:04.108 INFO:teuthology.orchestra.run.smithi146.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-12-01T15:38:04.111 INFO:teuthology.orchestra.run.smithi066.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-01T15:38:04.111 INFO:teuthology.orchestra.run.smithi066.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-12-01T15:38:04.113 INFO:teuthology.orchestra.run.smithi066.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-12-01T15:38:04.127 INFO:teuthology.orchestra.run.smithi066.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-12-01T15:38:04.129 INFO:teuthology.orchestra.run.smithi066.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-12-01T15:38:04.130 INFO:teuthology.orchestra.run.smithi066.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-12-01T15:38:04.131 INFO:teuthology.orchestra.run.smithi066.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-12-01T15:38:04.188 INFO:teuthology.orchestra.run.smithi146.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-12-01T15:38:04.199 INFO:teuthology.orchestra.run.smithi066.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.0-1249-ga6f82997-1focal [3,439 kB] 2023-12-01T15:38:04.203 INFO:teuthology.orchestra.run.smithi146.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-12-01T15:38:04.205 INFO:teuthology.orchestra.run.smithi146.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-12-01T15:38:04.209 INFO:teuthology.orchestra.run.smithi066.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-12-01T15:38:04.217 INFO:teuthology.orchestra.run.smithi146.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-12-01T15:38:04.217 INFO:teuthology.orchestra.run.smithi146.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-12-01T15:38:04.227 INFO:teuthology.orchestra.run.smithi066.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-12-01T15:38:04.229 INFO:teuthology.orchestra.run.smithi066.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-12-01T15:38:04.240 INFO:teuthology.orchestra.run.smithi146.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.0-1249-ga6f82997-1focal [3,439 kB] 2023-12-01T15:38:04.240 INFO:teuthology.orchestra.run.smithi066.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-12-01T15:38:04.240 INFO:teuthology.orchestra.run.smithi066.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-12-01T15:38:04.279 INFO:teuthology.orchestra.run.smithi146.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-12-01T15:38:04.280 INFO:teuthology.orchestra.run.smithi146.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-12-01T15:38:04.281 INFO:teuthology.orchestra.run.smithi146.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-12-01T15:38:04.282 INFO:teuthology.orchestra.run.smithi146.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-12-01T15:38:04.282 INFO:teuthology.orchestra.run.smithi146.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-12-01T15:38:04.284 INFO:teuthology.orchestra.run.smithi146.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-12-01T15:38:04.285 INFO:teuthology.orchestra.run.smithi146.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-12-01T15:38:04.296 INFO:teuthology.orchestra.run.smithi066.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-12-01T15:38:04.296 INFO:teuthology.orchestra.run.smithi146.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-12-01T15:38:04.297 INFO:teuthology.orchestra.run.smithi066.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-12-01T15:38:04.298 INFO:teuthology.orchestra.run.smithi066.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-12-01T15:38:04.299 INFO:teuthology.orchestra.run.smithi066.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-12-01T15:38:04.299 INFO:teuthology.orchestra.run.smithi066.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-12-01T15:38:04.301 INFO:teuthology.orchestra.run.smithi146.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-12-01T15:38:04.301 INFO:teuthology.orchestra.run.smithi066.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-12-01T15:38:04.301 INFO:teuthology.orchestra.run.smithi066.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-12-01T15:38:04.313 INFO:teuthology.orchestra.run.smithi146.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-12-01T15:38:04.313 INFO:teuthology.orchestra.run.smithi066.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-12-01T15:38:04.314 INFO:teuthology.orchestra.run.smithi146.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-12-01T15:38:04.315 INFO:teuthology.orchestra.run.smithi146.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-12-01T15:38:04.318 INFO:teuthology.orchestra.run.smithi146.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-12-01T15:38:04.318 INFO:teuthology.orchestra.run.smithi066.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-12-01T15:38:04.321 INFO:teuthology.orchestra.run.smithi146.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-12-01T15:38:04.322 INFO:teuthology.orchestra.run.smithi066.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-12-01T15:38:04.330 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.0-1249-ga6f82997-1focal [3,439 kB] 2023-12-01T15:38:04.331 INFO:teuthology.orchestra.run.smithi066.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-12-01T15:38:04.331 INFO:teuthology.orchestra.run.smithi066.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-12-01T15:38:04.333 INFO:teuthology.orchestra.run.smithi066.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-12-01T15:38:04.336 INFO:teuthology.orchestra.run.smithi066.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-12-01T15:38:04.339 INFO:teuthology.orchestra.run.smithi146.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-12-01T15:38:04.342 INFO:teuthology.orchestra.run.smithi146.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-12-01T15:38:04.344 INFO:teuthology.orchestra.run.smithi146.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-12-01T15:38:04.353 INFO:teuthology.orchestra.run.smithi066.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-12-01T15:38:04.356 INFO:teuthology.orchestra.run.smithi066.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-12-01T15:38:04.357 INFO:teuthology.orchestra.run.smithi066.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-12-01T15:38:04.382 INFO:teuthology.orchestra.run.smithi146.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-12-01T15:38:04.383 INFO:teuthology.orchestra.run.smithi146.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-12-01T15:38:04.383 INFO:teuthology.orchestra.run.smithi146.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-12-01T15:38:04.383 INFO:teuthology.orchestra.run.smithi146.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-12-01T15:38:04.393 INFO:teuthology.orchestra.run.smithi066.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-12-01T15:38:04.394 INFO:teuthology.orchestra.run.smithi066.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-12-01T15:38:04.394 INFO:teuthology.orchestra.run.smithi066.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-12-01T15:38:04.394 INFO:teuthology.orchestra.run.smithi066.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-12-01T15:38:04.396 INFO:teuthology.orchestra.run.smithi146.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-01T15:38:04.396 INFO:teuthology.orchestra.run.smithi146.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-12-01T15:38:04.397 INFO:teuthology.orchestra.run.smithi146.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-12-01T15:38:04.397 INFO:teuthology.orchestra.run.smithi146.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-12-01T15:38:04.406 INFO:teuthology.orchestra.run.smithi066.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-01T15:38:04.406 INFO:teuthology.orchestra.run.smithi066.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-12-01T15:38:04.407 INFO:teuthology.orchestra.run.smithi066.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-12-01T15:38:04.407 INFO:teuthology.orchestra.run.smithi066.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-12-01T15:38:04.408 INFO:teuthology.orchestra.run.smithi066.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-12-01T15:38:04.440 INFO:teuthology.orchestra.run.smithi146.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-12-01T15:38:04.503 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-12-01T15:38:04.517 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-12-01T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-12-01T15:38:04.846 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-12-01T15:38:04.855 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-12-01T15:38:04.884 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-12-01T15:38:04.892 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-12-01T15:38:04.893 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-12-01T15:38:04.896 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-12-01T15:38:04.898 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-12-01T15:38:05.074 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-12-01T15:38:05.328 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-12-01T15:38:05.501 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-12-01T15:38:05.515 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-12-01T15:38:05.524 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-12-01T15:38:05.530 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-12-01T15:38:05.541 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.0-1249-ga6f82997-1focal [4,000 kB] 2023-12-01T15:38:05.558 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-01T15:38:05.564 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-12-01T15:38:05.567 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-12-01T15:38:05.596 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-12-01T15:38:05.604 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-12-01T15:38:05.787 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-12-01T15:38:05.911 INFO:teuthology.orchestra.run.smithi146.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.0-1249-ga6f82997-1focal [4,000 kB] 2023-12-01T15:38:05.984 INFO:teuthology.orchestra.run.smithi066.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.0-1249-ga6f82997-1focal [4,000 kB] 2023-12-01T15:38:06.109 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-12-01T15:38:06.120 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-12-01T15:38:06.357 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-12-01T15:38:06.358 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-12-01T15:38:06.365 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-12-01T15:38:06.371 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-12-01T15:38:06.387 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-12-01T15:38:06.414 INFO:teuthology.orchestra.run.smithi063.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-12-01T15:38:06.440 INFO:teuthology.orchestra.run.smithi063.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-12-01T15:38:06.446 INFO:teuthology.orchestra.run.smithi063.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-12-01T15:38:06.626 INFO:teuthology.orchestra.run.smithi063.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-12-01T15:38:06.792 INFO:teuthology.orchestra.run.smithi063.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.0-1249-ga6f82997-1focal [738 kB] 2023-12-01T15:38:06.971 INFO:teuthology.orchestra.run.smithi063.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-12-01T15:38:06.990 INFO:teuthology.orchestra.run.smithi063.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.0-1249-ga6f82997-1focal [387 kB] 2023-12-01T15:38:06.990 INFO:teuthology.orchestra.run.smithi063.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-12-01T15:38:07.002 INFO:teuthology.orchestra.run.smithi063.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-12-01T15:38:07.022 INFO:teuthology.orchestra.run.smithi063.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-12-01T15:38:07.035 INFO:teuthology.orchestra.run.smithi063.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-12-01T15:38:07.088 INFO:teuthology.orchestra.run.smithi063.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-12-01T15:38:07.114 INFO:teuthology.orchestra.run.smithi063.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-12-01T15:38:07.114 INFO:teuthology.orchestra.run.smithi063.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-12-01T15:38:07.117 INFO:teuthology.orchestra.run.smithi063.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-12-01T15:38:07.125 INFO:teuthology.orchestra.run.smithi063.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.0-1249-ga6f82997-1focal [31.9 kB] 2023-12-01T15:38:07.130 INFO:teuthology.orchestra.run.smithi063.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.0-1249-ga6f82997-1focal [201 kB] 2023-12-01T15:38:07.171 INFO:teuthology.orchestra.run.smithi063.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-01T15:38:07.209 INFO:teuthology.orchestra.run.smithi063.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.0-1249-ga6f82997-1focal [60.2 kB] 2023-12-01T15:38:07.221 INFO:teuthology.orchestra.run.smithi063.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.0-1249-ga6f82997-1focal [365 kB] 2023-12-01T15:38:07.338 INFO:teuthology.orchestra.run.smithi063.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-12-01T15:38:07.358 INFO:teuthology.orchestra.run.smithi063.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.0-1249-ga6f82997-1focal [6,587 kB] 2023-12-01T15:38:07.686 INFO:teuthology.orchestra.run.smithi063.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-12-01T15:38:07.725 INFO:teuthology.orchestra.run.smithi146.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.0-1249-ga6f82997-1focal [738 kB] 2023-12-01T15:38:07.744 INFO:teuthology.orchestra.run.smithi063.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-12-01T15:38:07.810 INFO:teuthology.orchestra.run.smithi063.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-12-01T15:38:07.816 INFO:teuthology.orchestra.run.smithi063.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-12-01T15:38:07.832 INFO:teuthology.orchestra.run.smithi063.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-12-01T15:38:07.843 INFO:teuthology.orchestra.run.smithi066.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.0-1249-ga6f82997-1focal [738 kB] 2023-12-01T15:38:08.094 INFO:teuthology.orchestra.run.smithi146.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.0-1249-ga6f82997-1focal [387 kB] 2023-12-01T15:38:08.221 INFO:teuthology.orchestra.run.smithi066.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.0-1249-ga6f82997-1focal [387 kB] 2023-12-01T15:38:08.270 INFO:teuthology.orchestra.run.smithi146.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.0-1249-ga6f82997-1focal [31.9 kB] 2023-12-01T15:38:08.273 INFO:teuthology.orchestra.run.smithi146.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.0-1249-ga6f82997-1focal [201 kB] 2023-12-01T15:38:08.355 INFO:teuthology.orchestra.run.smithi063.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-12-01T15:38:08.365 INFO:teuthology.orchestra.run.smithi146.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.0-1249-ga6f82997-1focal [60.2 kB] 2023-12-01T15:38:08.372 INFO:teuthology.orchestra.run.smithi146.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.0-1249-ga6f82997-1focal [365 kB] 2023-12-01T15:38:08.392 INFO:teuthology.orchestra.run.smithi066.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.0-1249-ga6f82997-1focal [31.9 kB] 2023-12-01T15:38:08.409 INFO:teuthology.orchestra.run.smithi063.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-12-01T15:38:08.412 INFO:teuthology.orchestra.run.smithi063.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-12-01T15:38:08.429 INFO:teuthology.orchestra.run.smithi066.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.0-1249-ga6f82997-1focal [201 kB] 2023-12-01T15:38:08.453 INFO:teuthology.orchestra.run.smithi063.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-12-01T15:38:08.453 INFO:teuthology.orchestra.run.smithi063.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-12-01T15:38:08.586 INFO:teuthology.orchestra.run.smithi066.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.0-1249-ga6f82997-1focal [60.2 kB] 2023-12-01T15:38:08.599 INFO:teuthology.orchestra.run.smithi066.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.0-1249-ga6f82997-1focal [365 kB] 2023-12-01T15:38:08.618 INFO:teuthology.orchestra.run.smithi063.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-12-01T15:38:08.649 INFO:teuthology.orchestra.run.smithi146.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.0-1249-ga6f82997-1focal [6,587 kB] 2023-12-01T15:38:08.801 INFO:teuthology.orchestra.run.smithi066.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.0-1249-ga6f82997-1focal [6,587 kB] 2023-12-01T15:38:08.826 INFO:teuthology.orchestra.run.smithi063.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-12-01T15:38:08.871 INFO:teuthology.orchestra.run.smithi063.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-12-01T15:38:08.941 INFO:teuthology.orchestra.run.smithi063.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-12-01T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-12-01T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-12-01T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-12-01T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-12-01T15:38:09.173 INFO:teuthology.orchestra.run.smithi063.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-12-01T15:38:09.204 INFO:teuthology.orchestra.run.smithi063.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-12-01T15:38:09.225 INFO:teuthology.orchestra.run.smithi063.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-12-01T15:38:09.397 INFO:teuthology.orchestra.run.smithi063.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-12-01T15:38:09.889 INFO:teuthology.orchestra.run.smithi063.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-12-01T15:38:09.939 INFO:teuthology.orchestra.run.smithi063.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-12-01T15:38:10.169 INFO:teuthology.orchestra.run.smithi063.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-12-01T15:38:10.180 INFO:teuthology.orchestra.run.smithi063.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-12-01T15:38:10.189 INFO:teuthology.orchestra.run.smithi063.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-12-01T15:38:10.236 INFO:teuthology.orchestra.run.smithi063.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.0-1249-ga6f82997-1focal [113 kB] 2023-12-01T15:38:10.303 INFO:teuthology.orchestra.run.smithi063.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.0-1249-ga6f82997-1focal [478 kB] 2023-12-01T15:38:10.345 INFO:teuthology.orchestra.run.smithi063.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-12-01T15:38:10.347 INFO:teuthology.orchestra.run.smithi063.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-12-01T15:38:10.347 INFO:teuthology.orchestra.run.smithi063.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-12-01T15:38:10.349 INFO:teuthology.orchestra.run.smithi063.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-12-01T15:38:10.401 INFO:teuthology.orchestra.run.smithi063.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-01T15:38:10.566 INFO:teuthology.orchestra.run.smithi063.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-12-01T15:38:10.590 INFO:teuthology.orchestra.run.smithi063.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.0-1249-ga6f82997-1focal [25.2 MB] 2023-12-01T15:38:10.952 INFO:teuthology.orchestra.run.smithi063.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-12-01T15:38:10.962 INFO:teuthology.orchestra.run.smithi063.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-12-01T15:38:10.984 INFO:teuthology.orchestra.run.smithi063.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-12-01T15:38:12.638 INFO:teuthology.orchestra.run.smithi146.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.0-1249-ga6f82997-1focal [113 kB] 2023-12-01T15:38:12.718 INFO:teuthology.orchestra.run.smithi146.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.0-1249-ga6f82997-1focal [478 kB] 2023-12-01T15:38:12.993 INFO:teuthology.orchestra.run.smithi146.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.0-1249-ga6f82997-1focal [25.2 MB] 2023-12-01T15:38:15.634 INFO:teuthology.orchestra.run.smithi066.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.0-1249-ga6f82997-1focal [113 kB] 2023-12-01T15:38:15.730 INFO:teuthology.orchestra.run.smithi066.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.0-1249-ga6f82997-1focal [478 kB] 2023-12-01T15:38:16.104 INFO:teuthology.orchestra.run.smithi066.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.0-1249-ga6f82997-1focal [25.2 MB] 2023-12-01T15:38:34.453 INFO:teuthology.orchestra.run.smithi063.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.0-1249-ga6f82997-1focal [11.0 MB] 2023-12-01T15:38:41.390 INFO:teuthology.orchestra.run.smithi066.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.0-1249-ga6f82997-1focal [11.0 MB] 2023-12-01T15:38:43.580 INFO:teuthology.orchestra.run.smithi146.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.0-1249-ga6f82997-1focal [11.0 MB] 2023-12-01T15:38:47.533 INFO:teuthology.orchestra.run.smithi063.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.0-1249-ga6f82997-1focal [234 kB] 2023-12-01T15:38:47.749 INFO:teuthology.orchestra.run.smithi063.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.0-1249-ga6f82997-1focal [147 kB] 2023-12-01T15:38:47.925 INFO:teuthology.orchestra.run.smithi063.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.0-1249-ga6f82997-1focal [1,565 kB] 2023-12-01T15:38:49.624 INFO:teuthology.orchestra.run.smithi063.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.0-1249-ga6f82997-1focal [9,404 kB] 2023-12-01T15:38:50.535 INFO:teuthology.orchestra.run.smithi066.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.0-1249-ga6f82997-1focal [234 kB] 2023-12-01T15:38:50.699 INFO:teuthology.orchestra.run.smithi066.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.0-1249-ga6f82997-1focal [147 kB] 2023-12-01T15:38:50.790 INFO:teuthology.orchestra.run.smithi066.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.0-1249-ga6f82997-1focal [1,565 kB] 2023-12-01T15:38:51.812 INFO:teuthology.orchestra.run.smithi066.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.0-1249-ga6f82997-1focal [9,404 kB] 2023-12-01T15:38:55.989 INFO:teuthology.orchestra.run.smithi146.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.0-1249-ga6f82997-1focal [234 kB] 2023-12-01T15:38:56.209 INFO:teuthology.orchestra.run.smithi063.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.0-1249-ga6f82997-1focal [31.3 MB] 2023-12-01T15:38:56.425 INFO:teuthology.orchestra.run.smithi146.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.0-1249-ga6f82997-1focal [147 kB] 2023-12-01T15:38:56.628 INFO:teuthology.orchestra.run.smithi146.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.0-1249-ga6f82997-1focal [1,565 kB] 2023-12-01T15:38:58.726 INFO:teuthology.orchestra.run.smithi146.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.0-1249-ga6f82997-1focal [9,404 kB] 2023-12-01T15:38:58.754 INFO:teuthology.orchestra.run.smithi066.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.0-1249-ga6f82997-1focal [31.3 MB] 2023-12-01T15:39:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.0-1249-ga6f82997-1focal [31.3 MB] 2023-12-01T15:39:15.189 INFO:teuthology.orchestra.run.smithi063.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.0-1249-ga6f82997-1focal [13.7 kB] 2023-12-01T15:39:15.190 INFO:teuthology.orchestra.run.smithi063.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.0-1249-ga6f82997-1focal [846 kB] 2023-12-01T15:39:15.456 INFO:teuthology.orchestra.run.smithi063.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.0-1249-ga6f82997-1focal [2,309 kB] 2023-12-01T15:39:15.757 INFO:teuthology.orchestra.run.smithi066.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.0-1249-ga6f82997-1focal [13.7 kB] 2023-12-01T15:39:15.758 INFO:teuthology.orchestra.run.smithi066.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.0-1249-ga6f82997-1focal [846 kB] 2023-12-01T15:39:16.029 INFO:teuthology.orchestra.run.smithi066.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.0-1249-ga6f82997-1focal [2,309 kB] 2023-12-01T15:39:16.371 INFO:teuthology.orchestra.run.smithi063.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.0-1249-ga6f82997-1focal [234 kB] 2023-12-01T15:39:16.436 INFO:teuthology.orchestra.run.smithi063.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.0-1249-ga6f82997-1focal [136 kB] 2023-12-01T15:39:16.494 INFO:teuthology.orchestra.run.smithi063.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.0-1249-ga6f82997-1focal [1,831 kB] 2023-12-01T15:39:17.017 INFO:teuthology.orchestra.run.smithi066.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.0-1249-ga6f82997-1focal [234 kB] 2023-12-01T15:39:17.107 INFO:teuthology.orchestra.run.smithi066.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.0-1249-ga6f82997-1focal [136 kB] 2023-12-01T15:39:17.163 INFO:teuthology.orchestra.run.smithi066.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.0-1249-ga6f82997-1focal [1,831 kB] 2023-12-01T15:39:17.202 INFO:teuthology.orchestra.run.smithi063.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.0-1249-ga6f82997-1focal [7,892 kB] 2023-12-01T15:39:17.874 INFO:teuthology.orchestra.run.smithi066.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.0-1249-ga6f82997-1focal [7,892 kB] 2023-12-01T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.0-1249-ga6f82997-1focal [13.8 kB] 2023-12-01T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.0-1249-ga6f82997-1focal [50.1 MB] 2023-12-01T15:39:21.166 INFO:teuthology.orchestra.run.smithi066.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.0-1249-ga6f82997-1focal [13.8 kB] 2023-12-01T15:39:21.166 INFO:teuthology.orchestra.run.smithi066.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.0-1249-ga6f82997-1focal [50.1 MB] 2023-12-01T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.0-1249-ga6f82997-1focal [119 kB] 2023-12-01T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.0-1249-ga6f82997-1focal [37.3 kB] 2023-12-01T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.0-1249-ga6f82997-1focal [13.4 MB] 2023-12-01T15:39:32.160 INFO:teuthology.orchestra.run.smithi063.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.0-1249-ga6f82997-1focal [107 kB] 2023-12-01T15:39:32.828 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 208 MB in 1min 28s (2,352 kB/s) 2023-12-01T15:39:32.978 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-12-01T15:39:33.035 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141728 files and directories currently installed.) 2023-12-01T15:39:33.040 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-12-01T15:39:33.126 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-01T15:39:33.490 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-01T15:39:33.510 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-12-01T15:39:33.548 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-01T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-01T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-12-01T15:39:33.969 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-01T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-01T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-01T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:39:34.967 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-01T15:39:34.986 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-01T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:39:35.428 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-01T15:39:35.444 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-01T15:39:35.486 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:39:35.889 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-12-01T15:39:35.907 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-12-01T15:39:35.947 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-01T15:39:36.325 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../007-librbd1_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:36.434 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librbd1 (18.2.0-1249-ga6f82997-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-12-01T15:39:37.137 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../008-librados2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:37.263 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librados2 (18.2.0-1249-ga6f82997-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-12-01T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs2. 2023-12-01T15:39:38.025 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../009-libcephfs2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:38.067 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:38.420 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rados. 2023-12-01T15:39:38.439 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../010-python3-rados_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:38.478 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:38.772 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-01T15:39:38.789 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:39:38.822 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:39.099 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cephfs. 2023-12-01T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../012-python3-cephfs_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:39.494 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-01T15:39:39.511 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:39:39.552 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:40.030 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-prettytable. 2023-12-01T15:39:40.046 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-12-01T15:39:40.088 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-12-01T15:39:40.357 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rbd. 2023-12-01T15:39:40.375 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../015-python3-rbd_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:40.415 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:40.710 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-12-01T15:39:40.728 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-12-01T15:39:40.768 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-01T15:39:40.845 INFO:teuthology.orchestra.run.smithi146.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.0-1249-ga6f82997-1focal [13.7 kB] 2023-12-01T15:39:40.847 INFO:teuthology.orchestra.run.smithi146.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.0-1249-ga6f82997-1focal [846 kB] 2023-12-01T15:39:41.137 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-12-01T15:39:41.155 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-12-01T15:39:41.195 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-12-01T15:39:41.382 INFO:teuthology.orchestra.run.smithi146.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.0-1249-ga6f82997-1focal [2,309 kB] 2023-12-01T15:39:41.540 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-01T15:39:41.556 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-12-01T15:39:41.599 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-01T15:39:41.934 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librgw2. 2023-12-01T15:39:41.954 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../019-librgw2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:41.984 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:42.675 INFO:teuthology.orchestra.run.smithi066.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.0-1249-ga6f82997-1focal [119 kB] 2023-12-01T15:39:42.678 INFO:teuthology.orchestra.run.smithi066.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.0-1249-ga6f82997-1focal [37.3 kB] 2023-12-01T15:39:42.679 INFO:teuthology.orchestra.run.smithi066.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.0-1249-ga6f82997-1focal [13.4 MB] 2023-12-01T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rgw. 2023-12-01T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../020-python3-rgw_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.0-1249-ga6f82997-1focal [234 kB] 2023-12-01T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:43.056 INFO:teuthology.orchestra.run.smithi146.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.0-1249-ga6f82997-1focal [136 kB] 2023-12-01T15:39:43.150 INFO:teuthology.orchestra.run.smithi146.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.0-1249-ga6f82997-1focal [1,831 kB] 2023-12-01T15:39:43.264 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liboath0. 2023-12-01T15:39:43.281 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-12-01T15:39:43.322 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-12-01T15:39:43.642 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libradosstriper1. 2023-12-01T15:39:43.659 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../022-libradosstriper1_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:43.700 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:44.087 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-common. 2023-12-01T15:39:44.102 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../023-ceph-common_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:44.136 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:44.780 INFO:teuthology.orchestra.run.smithi146.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.0-1249-ga6f82997-1focal [7,892 kB] 2023-12-01T15:39:46.692 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-base. 2023-12-01T15:39:46.708 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../024-ceph-base_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:46.760 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:48.179 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-01T15:39:48.198 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-12-01T15:39:48.345 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-12-01T15:39:48.699 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-natsort. 2023-12-01T15:39:48.716 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-12-01T15:39:48.784 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-12-01T15:39:49.102 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-logutils. 2023-12-01T15:39:49.122 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-12-01T15:39:49.160 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-12-01T15:39:49.480 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-01T15:39:49.533 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-12-01T15:39:49.545 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-12-01T15:39:49.857 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-mako. 2023-12-01T15:39:49.873 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-12-01T15:39:49.915 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-01T15:39:50.277 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-01T15:39:50.295 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-01T15:39:50.335 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-01T15:39:50.637 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-01T15:39:50.655 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-12-01T15:39:50.695 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-12-01T15:39:50.998 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webob. 2023-12-01T15:39:51.014 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-12-01T15:39:51.037 INFO:teuthology.orchestra.run.smithi066.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.0-1249-ga6f82997-1focal [107 kB] 2023-12-01T15:39:51.065 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-12-01T15:39:51.393 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-soupsieve. 2023-12-01T15:39:51.409 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-12-01T15:39:51.476 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-01T15:39:51.732 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 208 MB in 1min 47s (1,935 kB/s) 2023-12-01T15:39:51.787 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-bs4. 2023-12-01T15:39:51.806 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-12-01T15:39:51.845 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-12-01T15:39:51.946 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-12-01T15:39:52.004 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141728 files and directories currently installed.) 2023-12-01T15:39:52.009 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-12-01T15:39:52.095 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-01T15:39:52.206 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-waitress. 2023-12-01T15:39:52.224 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-12-01T15:39:52.268 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-01T15:39:52.465 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-01T15:39:52.484 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-12-01T15:39:52.523 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-01T15:39:52.618 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-tempita. 2023-12-01T15:39:52.634 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-12-01T15:39:52.676 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-12-01T15:39:52.876 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-01T15:39:52.892 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-12-01T15:39:52.969 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-01T15:39:53.001 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-paste. 2023-12-01T15:39:53.019 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-12-01T15:39:53.070 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-12-01T15:39:53.390 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-01T15:39:53.409 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-12-01T15:39:53.422 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-01T15:39:53.438 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-01T15:39:53.448 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-12-01T15:39:53.490 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:39:53.776 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-01T15:39:53.793 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-12-01T15:39:53.834 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-12-01T15:39:54.016 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-01T15:39:54.033 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-01T15:39:54.074 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:39:54.112 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webtest. 2023-12-01T15:39:54.129 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-12-01T15:39:54.162 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-12-01T15:39:54.461 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-01T15:39:54.477 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-01T15:39:54.506 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pecan. 2023-12-01T15:39:54.519 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:39:54.526 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-12-01T15:39:54.565 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-12-01T15:39:54.902 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-01T15:39:54.919 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-12-01T15:39:54.960 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-01T15:39:55.039 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-12-01T15:39:55.055 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-12-01T15:39:55.097 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-01T15:39:55.280 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-01T15:39:55.280 INFO:teuthology.orchestra.run.smithi146.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.0-1249-ga6f82997-1focal [13.8 kB] 2023-12-01T15:39:55.294 INFO:teuthology.orchestra.run.smithi146.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.0-1249-ga6f82997-1focal [50.1 MB] 2023-12-01T15:39:55.296 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:39:55.338 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:55.458 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../007-librbd1_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:55.609 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librbd1 (18.2.0-1249-ga6f82997-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-12-01T15:39:55.726 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-01T15:39:55.742 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:55.784 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:56.129 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cryptography. 2023-12-01T15:39:56.145 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-12-01T15:39:56.187 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-12-01T15:39:56.296 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../008-librados2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:56.397 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librados2 (18.2.0-1249-ga6f82997-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-12-01T15:39:56.582 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-openssl. 2023-12-01T15:39:56.598 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-12-01T15:39:56.649 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-12-01T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr. 2023-12-01T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../047-ceph-mgr_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:57.167 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libcephfs2. 2023-12-01T15:39:57.187 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../009-libcephfs2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:57.259 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:57.546 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mon. 2023-12-01T15:39:57.562 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../048-ceph-mon_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:57.604 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:57.745 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rados. 2023-12-01T15:39:57.764 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../010-python3-rados_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:57.811 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:58.156 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-01T15:39:58.175 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:39:58.206 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:58.450 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cephfs. 2023-12-01T15:39:58.467 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../012-python3-cephfs_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:58.508 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:58.877 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-01T15:39:58.894 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:39:58.935 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-osd. 2023-12-01T15:39:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../049-ceph-osd_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:39:59.297 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-prettytable. 2023-12-01T15:39:59.313 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-12-01T15:39:59.380 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-12-01T15:39:59.633 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rbd. 2023-12-01T15:39:59.652 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../015-python3-rbd_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:39:59.724 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:00.085 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-12-01T15:40:00.099 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-12-01T15:40:00.135 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-01T15:40:00.522 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-12-01T15:40:00.538 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-12-01T15:40:00.580 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-12-01T15:40:00.925 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-01T15:40:00.944 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-12-01T15:40:00.983 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-01T15:40:01.311 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librgw2. 2023-12-01T15:40:01.329 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../019-librgw2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:01.360 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph. 2023-12-01T15:40:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../050-ceph_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:02.177 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:02.238 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rgw. 2023-12-01T15:40:02.256 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../020-python3-rgw_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:02.296 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:02.546 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-fuse. 2023-12-01T15:40:02.566 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../051-ceph-fuse_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:02.604 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:02.666 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liboath0. 2023-12-01T15:40:02.682 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-12-01T15:40:02.724 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-12-01T15:40:03.052 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libradosstriper1. 2023-12-01T15:40:03.057 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mds. 2023-12-01T15:40:03.069 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../022-libradosstriper1_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:03.075 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../052-ceph-mds_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:03.110 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:03.115 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:03.547 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-common. 2023-12-01T15:40:03.563 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../023-ceph-common_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:03.613 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:03.635 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephadm. 2023-12-01T15:40:03.652 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../053-cephadm_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:03.693 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:04.029 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-01T15:40:04.045 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-12-01T15:40:04.087 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-12-01T15:40:04.490 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jinja2. 2023-12-01T15:40:04.510 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-12-01T15:40:04.548 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-12-01T15:40:04.818 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-01T15:40:04.836 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:40:04.875 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:05.237 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-01T15:40:05.253 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-12-01T15:40:05.295 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-01T15:40:05.606 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jwt. 2023-12-01T15:40:05.622 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-12-01T15:40:05.664 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-01T15:40:06.001 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-attr. 2023-12-01T15:40:06.017 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2023-12-01T15:40:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-12-01T15:40:06.169 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-base. 2023-12-01T15:40:06.186 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../024-ceph-base_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:10.511 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-01T15:40:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-12-01T15:40:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-12-01T15:40:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-natsort. 2023-12-01T15:40:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-12-01T15:40:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-12-01T15:40:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-logutils. 2023-12-01T15:40:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-12-01T15:40:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-12-01T15:40:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-01T15:40:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-12-01T15:40:10.512 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-12-01T15:40:10.513 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-mako. 2023-12-01T15:40:10.513 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-12-01T15:40:10.513 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-01T15:40:10.513 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-01T15:40:10.513 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-01T15:40:10.513 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-01T15:40:10.513 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-01T15:40:10.513 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-12-01T15:40:10.513 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-12-01T15:40:10.514 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pluggy. 2023-12-01T15:40:10.514 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-py. 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-atomicwrites. 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-packaging. 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-packaging (20.3-1) ... 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-12-01T15:40:10.515 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-01T15:40:10.516 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pytest. 2023-12-01T15:40:10.516 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2023-12-01T15:40:10.516 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-12-01T15:40:10.516 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-01T15:40:10.516 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2023-12-01T15:40:10.516 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-01T15:40:10.516 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjs-underscore. 2023-12-01T15:40:10.516 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-12-01T15:40:10.516 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-01T15:40:10.516 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-12-01T15:40:10.516 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-12-01T15:40:10.548 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-01T15:40:10.548 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-routes. 2023-12-01T15:40:10.548 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2023-12-01T15:40:10.548 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-12-01T15:40:10.548 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-01T15:40:10.548 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:40:10.548 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:10.618 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-webob. 2023-12-01T15:40:10.634 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-12-01T15:40:10.676 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-12-01T15:40:10.787 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-decorator. 2023-12-01T15:40:10.803 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-12-01T15:40:10.844 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-12-01T15:40:11.031 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-soupsieve. 2023-12-01T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-12-01T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-12-01T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-01T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-scipy. 2023-12-01T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-12-01T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-12-01T15:40:12.555 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-12-01T15:40:12.555 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-01T15:40:12.555 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-bs4. 2023-12-01T15:40:12.555 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-12-01T15:40:12.555 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-12-01T15:40:12.555 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-waitress. 2023-12-01T15:40:12.555 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-12-01T15:40:12.555 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-01T15:40:12.555 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-tempita. 2023-12-01T15:40:12.555 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-12-01T15:40:12.555 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-12-01T15:40:12.692 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-paste. 2023-12-01T15:40:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-12-01T15:40:12.743 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-12-01T15:40:12.900 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-12-01T15:40:12.917 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-12-01T15:40:12.949 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-01T15:40:13.087 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-01T15:40:13.103 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-12-01T15:40:13.145 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-12-01T15:40:13.423 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-01T15:40:13.441 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-12-01T15:40:13.473 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-12-01T15:40:13.503 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-joblib. 2023-12-01T15:40:13.520 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2023-12-01T15:40:13.594 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-12-01T15:40:13.792 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-webtest. 2023-12-01T15:40:13.812 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-12-01T15:40:13.850 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-12-01T15:40:13.953 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn. 2023-12-01T15:40:13.972 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-12-01T15:40:14.011 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-01T15:40:14.203 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pecan. 2023-12-01T15:40:14.223 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-12-01T15:40:14.261 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-12-01T15:40:14.650 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-01T15:40:14.667 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-12-01T15:40:14.724 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-01T15:40:14.726 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-01T15:40:14.747 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:40:14.784 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:15.052 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-01T15:40:15.072 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:40:15.110 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:15.532 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-01T15:40:15.549 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:15.590 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:15.937 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cachetools. 2023-12-01T15:40:15.951 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cryptography. 2023-12-01T15:40:15.954 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2023-12-01T15:40:15.971 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-12-01T15:40:15.995 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-12-01T15:40:16.009 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-12-01T15:40:16.281 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-01T15:40:16.298 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-12-01T15:40:16.339 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-12-01T15:40:16.396 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-openssl. 2023-12-01T15:40:16.412 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-12-01T15:40:16.488 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-12-01T15:40:16.684 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-01T15:40:16.701 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-12-01T15:40:16.742 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-01T15:40:16.849 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr. 2023-12-01T15:40:16.866 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../047-ceph-mgr_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:16.907 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:17.181 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rsa. 2023-12-01T15:40:17.200 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2023-12-01T15:40:17.241 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rsa (4.0-3) ... 2023-12-01T15:40:17.427 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mon. 2023-12-01T15:40:17.443 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../048-ceph-mon_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:17.527 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-google-auth. 2023-12-01T15:40:17.568 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2023-12-01T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-12-01T15:40:17.980 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-blinker. 2023-12-01T15:40:17.997 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-12-01T15:40:18.038 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-01T15:40:18.341 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-oauthlib. 2023-12-01T15:40:18.357 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-12-01T15:40:18.399 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-01T15:40:18.777 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-01T15:40:18.794 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-12-01T15:40:18.835 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-01T15:40:18.997 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-osd. 2023-12-01T15:40:19.014 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../049-ceph-osd_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:19.055 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:19.147 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-websocket. 2023-12-01T15:40:19.164 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-12-01T15:40:19.205 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-12-01T15:40:19.550 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-01T15:40:19.568 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-12-01T15:40:19.599 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-12-01T15:40:20.188 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-01T15:40:20.205 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:40:20.246 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-01T15:40:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2023-12-01T15:40:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-12-01T15:40:21.011 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-01T15:40:21.031 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-01T15:40:21.069 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:40:21.280 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package jq. 2023-12-01T15:40:21.297 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-01T15:40:21.330 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:40:21.607 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package socat. 2023-12-01T15:40:21.625 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2023-12-01T15:40:21.665 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking socat (1.7.3.3-2) ... 2023-12-01T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package xmlstarlet. 2023-12-01T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-12-01T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-12-01T15:40:22.191 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph. 2023-12-01T15:40:22.208 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../050-ceph_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:22.283 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:22.381 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-test. 2023-12-01T15:40:22.400 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../094-ceph-test_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:22.439 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:22.635 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-fuse. 2023-12-01T15:40:22.654 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../051-ceph-fuse_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:22.693 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:23.263 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mds. 2023-12-01T15:40:23.280 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../052-ceph-mds_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:23.363 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:23.916 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package cephadm. 2023-12-01T15:40:23.934 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../053-cephadm_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:23.974 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:24.318 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-01T15:40:24.335 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-12-01T15:40:24.402 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-12-01T15:40:24.821 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jinja2. 2023-12-01T15:40:24.838 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-12-01T15:40:24.879 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-12-01T15:40:25.232 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-01T15:40:25.250 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:40:25.290 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:25.653 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-01T15:40:25.672 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-12-01T15:40:25.710 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-01T15:40:26.046 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jwt. 2023-12-01T15:40:26.063 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-12-01T15:40:26.104 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-01T15:40:26.432 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-attr. 2023-12-01T15:40:26.452 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2023-12-01T15:40:26.490 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-12-01T15:40:26.827 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pluggy. 2023-12-01T15:40:26.843 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2023-12-01T15:40:26.901 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-12-01T15:40:26.918 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-volume. 2023-12-01T15:40:26.936 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../095-ceph-volume_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:40:26.976 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:27.246 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-py. 2023-12-01T15:40:27.265 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-12-01T15:40:27.288 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package fonts-mathjax. 2023-12-01T15:40:27.303 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-12-01T15:40:27.308 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-01T15:40:27.346 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:40:27.665 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-atomicwrites. 2023-12-01T15:40:27.682 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-12-01T15:40:27.723 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-12-01T15:40:27.866 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-01T15:40:27.884 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:27.924 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:28.059 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-packaging. 2023-12-01T15:40:28.076 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2023-12-01T15:40:28.117 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-packaging (20.3-1) ... 2023-12-01T15:40:28.252 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package nvme-cli. 2023-12-01T15:40:28.271 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-12-01T15:40:28.328 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-12-01T15:40:28.403 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-01T15:40:28.423 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-12-01T15:40:28.461 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-01T15:40:28.673 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-01T15:40:28.692 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-12-01T15:40:28.731 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-12-01T15:40:28.781 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pytest. 2023-12-01T15:40:28.798 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2023-12-01T15:40:28.839 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-12-01T15:40:29.076 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjs-mathjax. 2023-12-01T15:40:29.093 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-01T15:40:29.155 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:40:29.184 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-01T15:40:29.202 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2023-12-01T15:40:29.242 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-01T15:40:29.541 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libjs-underscore. 2023-12-01T15:40:29.560 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-12-01T15:40:29.599 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-01T15:40:29.885 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-12-01T15:40:29.902 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-12-01T15:40:29.943 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-01T15:40:30.296 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-routes. 2023-12-01T15:40:30.314 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2023-12-01T15:40:30.354 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-12-01T15:40:30.699 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-01T15:40:30.717 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:40:30.790 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:30.910 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-natsort-doc. 2023-12-01T15:40:30.931 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-12-01T15:40:30.968 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-12-01T15:40:31.294 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-decorator. 2023-12-01T15:40:31.310 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-12-01T15:40:31.346 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webencodings. 2023-12-01T15:40:31.352 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-12-01T15:40:31.366 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-12-01T15:40:31.404 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-01T15:40:31.704 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-12-01T15:40:31.715 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-html5lib. 2023-12-01T15:40:31.724 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-12-01T15:40:31.733 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-12-01T15:40:31.763 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-01T15:40:31.773 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-12-01T15:40:32.090 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-scipy. 2023-12-01T15:40:32.109 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-12-01T15:40:32.143 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-12-01T15:40:32.161 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-12-01T15:40:32.181 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-12-01T15:40:32.201 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-01T15:40:32.655 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastescript. 2023-12-01T15:40:32.672 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2023-12-01T15:40:32.738 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-01T15:40:33.052 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-psutil. 2023-12-01T15:40:33.069 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-12-01T15:40:33.109 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-12-01T15:40:33.488 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-01T15:40:33.506 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-12-01T15:40:33.528 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-12-01T15:40:33.544 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-12-01T15:40:33.545 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-01T15:40:33.594 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-01T15:40:33.865 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-simplejson. 2023-12-01T15:40:33.883 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-12-01T15:40:33.923 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-01T15:40:34.123 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-joblib. 2023-12-01T15:40:34.139 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2023-12-01T15:40:34.181 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-12-01T15:40:34.237 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-01T15:40:34.254 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-12-01T15:40:34.295 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-01T15:40:34.642 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-sklearn. 2023-12-01T15:40:34.661 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-12-01T15:40:34.700 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-01T15:40:34.983 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package radosgw. 2023-12-01T15:40:35.003 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../110-radosgw_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:35.032 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:35.517 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-01T15:40:35.534 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:40:35.575 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:36.435 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package rbd-fuse. 2023-12-01T15:40:36.453 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../111-rbd-fuse_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:36.493 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:36.686 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cachetools. 2023-12-01T15:40:36.703 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2023-12-01T15:40:36.769 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-12-01T15:40:36.800 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-attr (19.3.0-2) ... 2023-12-01T15:40:37.072 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-01T15:40:37.088 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-12-01T15:40:37.108 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-12-01T15:40:37.155 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-12-01T15:40:37.234 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-01T15:40:37.360 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-12-01T15:40:37.517 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-01T15:40:37.534 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-12-01T15:40:37.561 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:37.583 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-01T15:40:37.988 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rsa. 2023-12-01T15:40:38.008 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2023-12-01T15:40:38.046 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rsa (4.0-3) ... 2023-12-01T15:40:38.148 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user cephadm....done 2023-12-01T15:40:38.359 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:40:38.367 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-google-auth. 2023-12-01T15:40:38.383 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2023-12-01T15:40:38.425 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-12-01T15:40:38.485 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-01T15:40:38.787 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-blinker. 2023-12-01T15:40:38.804 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-12-01T15:40:38.853 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-01T15:40:38.867 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-01T15:40:39.156 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-oauthlib. 2023-12-01T15:40:39.162 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:40:39.176 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-12-01T15:40:39.239 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-01T15:40:39.280 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-12-01T15:40:39.414 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-12-01T15:40:39.602 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-01T15:40:39.621 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-12-01T15:40:39.659 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-01T15:40:39.783 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-12-01T15:40:39.996 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-websocket. 2023-12-01T15:40:40.012 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-12-01T15:40:40.178 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-12-01T15:40:40.210 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-01T15:40:40.519 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-12-01T15:40:40.632 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-01T15:40:40.652 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-12-01T15:40:40.724 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-12-01T15:40:40.829 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-01T15:40:41.113 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-01T15:40:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-01T15:40:41.290 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:40:41.329 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:41.447 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:41.682 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-01T15:40:41.702 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2023-12-01T15:40:41.759 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-01T15:40:41.765 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-12-01T15:40:41.918 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-12-01T15:40:42.135 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-01T15:40:42.154 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-01T15:40:42.193 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:40:42.219 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-01T15:40:42.479 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package jq. 2023-12-01T15:40:42.498 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-01T15:40:42.529 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-01T15:40:42.537 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:40:42.688 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-12-01T15:40:42.816 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package socat. 2023-12-01T15:40:42.836 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2023-12-01T15:40:42.881 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking socat (1.7.3.3-2) ... 2023-12-01T15:40:43.064 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-12-01T15:40:43.218 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package xmlstarlet. 2023-12-01T15:40:43.237 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-12-01T15:40:43.276 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-12-01T15:40:43.373 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-12-01T15:40:43.639 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-test. 2023-12-01T15:40:43.657 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../094-ceph-test_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:43.667 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-01T15:40:43.697 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:44.018 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-12-01T15:40:44.302 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-12-01T15:40:44.654 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-12-01T15:40:44.988 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-packaging (20.3-1) ... 2023-12-01T15:40:45.297 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-12-01T15:40:45.448 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-01T15:40:45.574 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-01T15:40:45.876 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-12-01T15:40:46.294 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-01T15:40:46.678 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-12-01T15:40:47.055 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up socat (1.7.3.3-2) ... 2023-12-01T15:40:47.181 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:47.541 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:40:47.676 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-12-01T15:40:48.027 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-01T15:40:48.145 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-12-01T15:40:48.301 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-volume. 2023-12-01T15:40:48.304 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-12-01T15:40:48.318 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../095-ceph-volume_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:40:48.359 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:48.613 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-01T15:40:48.704 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package fonts-mathjax. 2023-12-01T15:40:48.722 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-01T15:40:48.762 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:40:48.948 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:40:49.074 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-01T15:40:49.184 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-12-01T15:40:49.299 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-01T15:40:49.318 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:49.357 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:49.527 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-12-01T15:40:49.785 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package nvme-cli. 2023-12-01T15:40:49.802 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-12-01T15:40:49.861 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-12-01T15:40:49.861 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-12-01T15:40:50.171 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-01T15:40:50.173 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-01T15:40:50.190 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-12-01T15:40:50.256 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-12-01T15:40:50.330 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-01T15:40:50.623 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-12-01T15:40:50.652 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libjs-mathjax. 2023-12-01T15:40:50.671 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-01T15:40:50.710 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:40:50.924 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-01T15:40:51.258 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-12-01T15:40:51.650 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-12-01T15:40:51.894 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-12-01T15:40:52.020 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-01T15:40:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.0-1249-ga6f82997-1focal [119 kB] 2023-12-01T15:40:52.355 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-12-01T15:40:52.363 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-natsort-doc. 2023-12-01T15:40:52.381 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-12-01T15:40:52.421 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-12-01T15:40:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.0-1249-ga6f82997-1focal [37.3 kB] 2023-12-01T15:40:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.0-1249-ga6f82997-1focal [13.4 MB] 2023-12-01T15:40:52.741 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-webencodings. 2023-12-01T15:40:52.751 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-01T15:40:52.761 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-12-01T15:40:52.799 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-01T15:40:52.877 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-01T15:40:53.003 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-12-01T15:40:53.135 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-html5lib. 2023-12-01T15:40:53.155 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-12-01T15:40:53.193 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-12-01T15:40:53.354 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-01T15:40:53.549 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-12-01T15:40:53.570 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-12-01T15:40:53.607 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-01T15:40:53.664 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-12-01T15:40:54.110 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pastescript. 2023-12-01T15:40:54.130 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2023-12-01T15:40:54.168 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-01T15:40:54.505 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-psutil. 2023-12-01T15:40:54.526 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-12-01T15:40:54.563 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-12-01T15:40:54.919 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-01T15:40:54.936 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-12-01T15:40:54.977 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-01T15:40:55.203 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:40:55.304 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-simplejson. 2023-12-01T15:40:55.325 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-12-01T15:40:55.362 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-12-01T15:40:55.363 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-01T15:40:55.700 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-01T15:40:55.718 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-12-01T15:40:55.747 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-12-01T15:40:55.757 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-01T15:40:56.048 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-12-01T15:40:56.360 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:40:56.446 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package radosgw. 2023-12-01T15:40:56.466 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../110-radosgw_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:56.486 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-12-01T15:40:56.504 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:56.837 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-01T15:40:57.181 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-12-01T15:40:57.574 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-01T15:40:57.917 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-01T15:40:57.974 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package rbd-fuse. 2023-12-01T15:40:57.994 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../111-rbd-fuse_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:40:58.048 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:58.349 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-attr (19.3.0-2) ... 2023-12-01T15:40:58.661 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-12-01T15:40:58.821 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-01T15:40:58.972 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-12-01T15:40:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-01T15:40:59.133 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-12-01T15:40:59.207 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:40:59.251 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:40:59.377 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rsa (4.0-3) ... 2023-12-01T15:40:59.686 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-01T15:40:59.812 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-12-01T15:40:59.834 INFO:teuthology.orchestra.run.smithi066.stdout:Adding system user cephadm....done 2023-12-01T15:40:59.996 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:41:00.130 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-01T15:41:00.156 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-01T15:41:00.465 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-01T15:41:00.515 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-01T15:41:00.791 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:41:00.802 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-12-01T15:41:00.942 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-12-01T15:41:01.068 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-12-01T15:41:01.202 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librados2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:01.311 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-12-01T15:41:01.403 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-12-01T15:41:01.428 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:01.554 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:01.789 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-01T15:41:01.799 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:01.934 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-routes (2.4.1-2) ... 2023-12-01T15:41:02.115 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-12-01T15:41:02.252 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:02.386 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-12-01T15:41:02.408 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-01T15:41:02.697 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librbd1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:02.701 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-01T15:41:02.822 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:02.949 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:03.001 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:03.208 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-01T15:41:03.209 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-01T15:41:03.327 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-01T15:41:03.453 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-12-01T15:41:03.684 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:03.721 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-01T15:41:03.818 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:03.927 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-12-01T15:41:04.031 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-01T15:41:04.157 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-12-01T15:41:04.533 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-12-01T15:41:04.826 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-12-01T15:41:04.881 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:05.007 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:05.118 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-01T15:41:05.158 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:05.268 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:05.369 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:05.469 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-12-01T15:41:05.770 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-12-01T15:41:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:Adding group ceph....done 2023-12-01T15:41:06.121 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-12-01T15:41:06.315 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user ceph....done 2023-12-01T15:41:06.423 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-packaging (20.3-1) ... 2023-12-01T15:41:06.483 INFO:teuthology.orchestra.run.smithi063.stdout:Setting system user ceph properties....done 2023-12-01T15:41:06.509 INFO:teuthology.orchestra.run.smithi063.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-01T15:41:06.664 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-01T15:41:06.757 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-12-01T15:41:06.916 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-01T15:41:06.983 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-01T15:41:07.042 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-01T15:41:07.327 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-12-01T15:41:07.455 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:07.581 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:07.728 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-01T15:41:07.892 INFO:teuthology.orchestra.run.smithi146.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.0-1249-ga6f82997-1focal [107 kB] 2023-12-01T15:41:08.066 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-01T15:41:08.066 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-01T15:41:08.104 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-12-01T15:41:08.491 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:08.515 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up socat (1.7.3.3-2) ... 2023-12-01T15:41:08.664 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 208 MB in 3min 4s (1,127 kB/s) 2023-12-01T15:41:08.674 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:08.835 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-12-01T15:41:08.891 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141728 files and directories currently installed.) 2023-12-01T15:41:08.895 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-12-01T15:41:08.915 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-01T15:41:09.009 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:41:09.051 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-01T15:41:09.143 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-12-01T15:41:09.385 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:09.421 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-01T15:41:09.439 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-12-01T15:41:09.479 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-01T15:41:09.486 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-01T15:41:09.607 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-01T15:41:09.607 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-01T15:41:09.626 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-12-01T15:41:09.754 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-12-01T15:41:09.782 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-01T15:41:09.802 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-12-01T15:41:09.873 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-01T15:41:10.064 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-01T15:41:10.103 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:10.336 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-01T15:41:10.336 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-01T15:41:10.352 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-01T15:41:10.371 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-01T15:41:10.382 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:41:10.453 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:41:10.508 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-01T15:41:10.634 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-12-01T15:41:10.829 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:11.002 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-12-01T15:41:11.005 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-01T15:41:11.023 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-01T15:41:11.063 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:41:11.321 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-01T15:41:11.322 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-01T15:41:11.416 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-01T15:41:11.432 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-01T15:41:11.474 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:41:11.661 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-12-01T15:41:11.773 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:11.899 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:11.928 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-12-01T15:41:11.944 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-12-01T15:41:11.986 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-01T15:41:11.995 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-01T15:41:12.041 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:12.155 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-01T15:41:12.269 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-01T15:41:12.269 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-01T15:41:12.388 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../007-librbd1_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:12.481 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-12-01T15:41:12.563 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librbd1 (18.2.0-1249-ga6f82997-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-12-01T15:41:12.726 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:12.827 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-01T15:41:12.861 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:13.012 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:13.103 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-12-01T15:41:13.155 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:13.311 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../008-librados2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:13.419 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librados2 (18.2.0-1249-ga6f82997-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-12-01T15:41:13.524 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T15:41:13.580 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-12-01T15:41:13.718 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-01T15:41:13.880 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-12-01T15:41:14.012 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T15:41:14.023 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-01T15:41:14.231 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs2. 2023-12-01T15:41:14.248 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../009-libcephfs2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:14.289 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:14.349 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-12-01T15:41:14.726 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-01T15:41:14.852 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-01T15:41:14.883 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rados. 2023-12-01T15:41:14.902 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../010-python3-rados_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:14.941 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:14.986 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-12-01T15:41:15.329 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-01T15:41:15.344 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-01T15:41:15.363 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:41:15.402 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:15.638 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-12-01T15:41:15.680 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cephfs. 2023-12-01T15:41:15.696 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../012-python3-cephfs_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:15.729 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:16.041 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-01T15:41:16.059 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:41:16.090 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:16.469 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-prettytable. 2023-12-01T15:41:16.487 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-12-01T15:41:16.527 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-12-01T15:41:16.813 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rbd. 2023-12-01T15:41:16.829 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../015-python3-rbd_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:16.871 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:16.914 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-12-01T15:41:17.163 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:41:17.257 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-12-01T15:41:17.273 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-12-01T15:41:17.297 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-12-01T15:41:17.340 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-01T15:41:17.557 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T15:41:17.560 DEBUG:teuthology.parallel:result is None 2023-12-01T15:41:17.676 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-12-01T15:41:17.690 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-12-01T15:41:17.693 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-12-01T15:41:17.726 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-12-01T15:41:18.016 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-12-01T15:41:18.087 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-01T15:41:18.104 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-12-01T15:41:18.145 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-01T15:41:18.343 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:41:18.502 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-12-01T15:41:18.532 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librgw2. 2023-12-01T15:41:18.548 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../019-librgw2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:18.590 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:18.845 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-01T15:41:19.198 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-12-01T15:41:19.476 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rgw. 2023-12-01T15:41:19.495 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../020-python3-rgw_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:19.542 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:19.591 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-01T15:41:19.870 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liboath0. 2023-12-01T15:41:19.889 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-12-01T15:41:19.925 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-01T15:41:19.953 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-12-01T15:41:20.273 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libradosstriper1. 2023-12-01T15:41:20.291 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../022-libradosstriper1_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:20.330 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:20.851 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-common. 2023-12-01T15:41:20.866 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../023-ceph-common_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:20.909 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:21.014 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-01T15:41:21.140 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-12-01T15:41:21.299 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:41:21.425 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rsa (4.0-3) ... 2023-12-01T15:41:21.735 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-01T15:41:21.844 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-12-01T15:41:22.187 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-01T15:41:22.513 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-01T15:41:22.831 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-12-01T15:41:23.209 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librados2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:23.359 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-12-01T15:41:23.389 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-base. 2023-12-01T15:41:23.406 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../024-ceph-base_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:23.491 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:23.587 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:23.823 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:23.949 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-routes (2.4.1-2) ... 2023-12-01T15:41:24.284 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:24.435 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-12-01T15:41:24.728 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librbd1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:24.887 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:24.968 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-01T15:41:24.987 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-12-01T15:41:25.013 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:25.018 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-12-01T15:41:25.279 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-01T15:41:25.279 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-01T15:41:25.338 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-natsort. 2023-12-01T15:41:25.356 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-12-01T15:41:25.387 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-12-01T15:41:25.707 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-logutils. 2023-12-01T15:41:25.724 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-12-01T15:41:25.742 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:25.765 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-12-01T15:41:25.893 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:26.019 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-12-01T15:41:26.127 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-01T15:41:26.144 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-12-01T15:41:26.185 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-12-01T15:41:26.521 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-mako. 2023-12-01T15:41:26.539 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-12-01T15:41:26.579 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-01T15:41:26.982 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-01T15:41:26.989 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:27.001 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-01T15:41:27.040 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-01T15:41:27.115 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:27.266 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:27.360 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-01T15:41:27.379 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-12-01T15:41:27.392 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:27.418 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-12-01T15:41:27.518 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:27.762 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webob. 2023-12-01T15:41:27.778 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-12-01T15:41:27.854 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-12-01T15:41:28.121 INFO:teuthology.orchestra.run.smithi066.stdout:Adding group ceph....done 2023-12-01T15:41:28.223 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-soupsieve. 2023-12-01T15:41:28.241 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-12-01T15:41:28.281 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-01T15:41:28.514 INFO:teuthology.orchestra.run.smithi066.stdout:Adding system user ceph....done 2023-12-01T15:41:28.587 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-bs4. 2023-12-01T15:41:28.606 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-12-01T15:41:28.636 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-12-01T15:41:28.724 INFO:teuthology.orchestra.run.smithi066.stdout:Setting system user ceph properties....done 2023-12-01T15:41:28.747 INFO:teuthology.orchestra.run.smithi066.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-01T15:41:28.902 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-01T15:41:29.031 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-waitress. 2023-12-01T15:41:29.048 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-12-01T15:41:29.093 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-01T15:41:29.216 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-01T15:41:29.442 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-tempita. 2023-12-01T15:41:29.458 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-12-01T15:41:29.500 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-12-01T15:41:29.703 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:29.829 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:29.887 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-paste. 2023-12-01T15:41:29.902 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-12-01T15:41:29.945 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-12-01T15:41:30.292 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-01T15:41:30.292 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-01T15:41:30.306 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-01T15:41:30.322 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-12-01T15:41:30.365 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-12-01T15:41:30.734 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-01T15:41:30.754 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-12-01T15:41:30.764 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:30.792 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-12-01T15:41:31.137 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webtest. 2023-12-01T15:41:31.140 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-01T15:41:31.153 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-12-01T15:41:31.195 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-12-01T15:41:31.573 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pecan. 2023-12-01T15:41:31.592 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-12-01T15:41:31.599 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:31.631 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-12-01T15:41:31.838 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-01T15:41:31.838 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-01T15:41:32.002 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-01T15:41:32.022 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-12-01T15:41:32.060 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-01T15:41:32.277 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:32.372 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-01T15:41:32.389 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:41:32.463 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:32.499 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-01T15:41:32.499 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-01T15:41:32.876 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-01T15:41:32.893 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:32.934 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:32.961 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:33.313 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cryptography. 2023-12-01T15:41:33.329 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-12-01T15:41:33.371 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-12-01T15:41:33.464 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-01T15:41:33.464 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-01T15:41:33.774 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-openssl. 2023-12-01T15:41:33.794 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-12-01T15:41:33.832 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-12-01T15:41:33.954 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:34.063 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:34.197 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:34.235 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr. 2023-12-01T15:41:34.253 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../047-ceph-mgr_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:34.293 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:34.451 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-01T15:41:34.451 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-01T15:41:34.813 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mon. 2023-12-01T15:41:34.832 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../048-ceph-mon_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:34.871 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:34.890 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:35.067 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:35.192 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:35.352 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:35.713 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T15:41:35.865 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-01T15:41:36.166 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T15:41:36.264 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-osd. 2023-12-01T15:41:36.283 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../049-ceph-osd_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:36.333 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:39.086 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-12-01T15:41:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph. 2023-12-01T15:41:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../050-ceph_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:39.706 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T15:41:39.709 DEBUG:teuthology.parallel:result is None 2023-12-01T15:41:40.039 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-fuse. 2023-12-01T15:41:40.054 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../051-ceph-fuse_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:40.088 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:40.583 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mds. 2023-12-01T15:41:40.603 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../052-ceph-mds_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:40.641 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:41.160 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephadm. 2023-12-01T15:41:41.179 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../053-cephadm_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:41:41.218 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:41.572 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-01T15:41:41.589 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-12-01T15:41:41.655 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-12-01T15:41:42.041 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jinja2. 2023-12-01T15:41:42.057 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-12-01T15:41:42.099 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-12-01T15:41:42.485 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-01T15:41:42.504 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:41:42.543 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:42.930 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-01T15:41:42.946 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-12-01T15:41:42.988 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-01T15:41:43.357 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jwt. 2023-12-01T15:41:43.374 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-12-01T15:41:43.415 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-01T15:41:43.735 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-attr. 2023-12-01T15:41:43.752 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2023-12-01T15:41:43.784 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-12-01T15:41:44.154 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pluggy. 2023-12-01T15:41:44.172 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2023-12-01T15:41:44.246 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-12-01T15:41:44.540 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-py. 2023-12-01T15:41:44.557 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-12-01T15:41:44.590 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-12-01T15:41:44.943 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-atomicwrites. 2023-12-01T15:41:44.963 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-12-01T15:41:45.001 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-12-01T15:41:45.313 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-packaging. 2023-12-01T15:41:45.329 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2023-12-01T15:41:45.429 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-packaging (20.3-1) ... 2023-12-01T15:41:45.948 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-01T15:41:45.965 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-12-01T15:41:46.006 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-01T15:41:46.342 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pytest. 2023-12-01T15:41:46.358 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2023-12-01T15:41:46.400 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-12-01T15:41:46.825 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-01T15:41:46.844 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2023-12-01T15:41:46.884 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-01T15:41:47.153 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjs-underscore. 2023-12-01T15:41:47.170 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-12-01T15:41:47.211 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-01T15:41:47.514 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-12-01T15:41:47.530 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-12-01T15:41:47.572 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-01T15:41:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-routes. 2023-12-01T15:41:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2023-12-01T15:41:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-12-01T15:41:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-01T15:41:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:41:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-decorator. 2023-12-01T15:41:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-12-01T15:41:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-12-01T15:41:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-12-01T15:41:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-12-01T15:41:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-01T15:41:49.786 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-scipy. 2023-12-01T15:41:49.802 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-12-01T15:41:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-12-01T15:41:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-12-01T15:41:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-12-01T15:41:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-01T15:41:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-joblib. 2023-12-01T15:41:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2023-12-01T15:41:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-12-01T15:41:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn. 2023-12-01T15:41:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-12-01T15:41:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-01T15:41:53.245 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-01T15:41:53.264 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:41:53.302 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:54.464 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cachetools. 2023-12-01T15:41:54.481 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2023-12-01T15:41:54.522 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-12-01T15:41:54.858 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-01T15:41:54.874 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-12-01T15:41:54.916 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-12-01T15:41:55.311 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-01T15:41:55.327 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-12-01T15:41:55.369 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-01T15:41:55.799 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rsa. 2023-12-01T15:41:55.817 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2023-12-01T15:41:55.882 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rsa (4.0-3) ... 2023-12-01T15:41:56.219 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-google-auth. 2023-12-01T15:41:56.236 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2023-12-01T15:41:56.277 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-12-01T15:41:56.623 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-blinker. 2023-12-01T15:41:56.639 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-12-01T15:41:56.681 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-01T15:41:57.043 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-oauthlib. 2023-12-01T15:41:57.059 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-12-01T15:41:57.100 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-01T15:41:57.463 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-01T15:41:57.479 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-12-01T15:41:57.529 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-01T15:41:57.882 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-websocket. 2023-12-01T15:41:57.901 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-12-01T15:41:57.940 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-12-01T15:41:58.270 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-01T15:41:58.289 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-12-01T15:41:58.327 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-12-01T15:41:58.949 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-01T15:41:58.968 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:41:59.049 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:41:59.402 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-01T15:41:59.421 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2023-12-01T15:41:59.460 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-12-01T15:41:59.897 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-01T15:41:59.916 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-01T15:41:59.955 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:42:00.249 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package jq. 2023-12-01T15:42:00.266 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-01T15:42:00.307 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:42:00.560 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package socat. 2023-12-01T15:42:00.576 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2023-12-01T15:42:00.618 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking socat (1.7.3.3-2) ... 2023-12-01T15:42:00.955 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package xmlstarlet. 2023-12-01T15:42:00.973 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-12-01T15:42:01.054 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-12-01T15:42:01.417 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-test. 2023-12-01T15:42:01.436 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../094-ceph-test_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:42:01.483 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:06.120 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-volume. 2023-12-01T15:42:06.137 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../095-ceph-volume_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-12-01T15:42:06.178 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:06.516 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package fonts-mathjax. 2023-12-01T15:42:06.532 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-01T15:42:06.573 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:42:07.177 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-01T15:42:07.196 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:42:07.268 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:07.689 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package nvme-cli. 2023-12-01T15:42:07.706 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-12-01T15:42:07.764 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-12-01T15:42:08.144 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-01T15:42:08.164 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-12-01T15:42:08.202 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-12-01T15:42:08.647 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjs-mathjax. 2023-12-01T15:42:08.663 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-01T15:42:08.729 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:42:10.500 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-natsort-doc. 2023-12-01T15:42:10.519 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-12-01T15:42:10.559 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-12-01T15:42:10.912 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webencodings. 2023-12-01T15:42:10.933 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-12-01T15:42:11.030 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-01T15:42:11.367 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-html5lib. 2023-12-01T15:42:11.385 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-12-01T15:42:11.425 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-12-01T15:42:11.795 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-12-01T15:42:11.812 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-12-01T15:42:11.886 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-01T15:42:12.384 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastescript. 2023-12-01T15:42:12.405 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2023-12-01T15:42:12.467 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-01T15:42:12.821 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-psutil. 2023-12-01T15:42:12.837 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-12-01T15:42:12.878 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-12-01T15:42:13.248 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-01T15:42:13.265 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-12-01T15:42:13.331 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-01T15:42:13.695 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-simplejson. 2023-12-01T15:42:13.711 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-12-01T15:42:13.752 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-01T15:42:14.055 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-01T15:42:14.075 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-12-01T15:42:14.113 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-01T15:42:14.901 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package radosgw. 2023-12-01T15:42:14.921 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../110-radosgw_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:42:14.958 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:16.795 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package rbd-fuse. 2023-12-01T15:42:16.813 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../111-rbd-fuse_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-12-01T15:42:16.852 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:17.176 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-attr (19.3.0-2) ... 2023-12-01T15:42:17.524 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-12-01T15:42:17.658 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-01T15:42:17.809 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-12-01T15:42:17.986 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:18.650 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user cephadm....done 2023-12-01T15:42:18.825 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:42:18.959 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-01T15:42:19.286 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-01T15:42:19.562 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-01T15:42:19.688 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-12-01T15:42:19.855 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-12-01T15:42:20.182 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-12-01T15:42:20.584 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-01T15:42:20.937 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-12-01T15:42:21.253 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-01T15:42:21.546 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-01T15:42:21.847 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:22.156 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-01T15:42:22.282 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-12-01T15:42:22.600 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-01T15:42:22.918 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-01T15:42:23.052 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-12-01T15:42:23.420 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-12-01T15:42:23.704 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-12-01T15:42:24.014 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-01T15:42:24.432 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-12-01T15:42:24.724 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-12-01T15:42:25.076 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-12-01T15:42:25.344 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-packaging (20.3-1) ... 2023-12-01T15:42:25.603 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-12-01T15:42:25.712 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-01T15:42:25.888 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-01T15:42:26.164 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-12-01T15:42:26.558 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-01T15:42:26.926 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-12-01T15:42:27.303 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up socat (1.7.3.3-2) ... 2023-12-01T15:42:27.404 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:27.730 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:42:27.889 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-12-01T15:42:28.232 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-01T15:42:28.359 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-12-01T15:42:28.510 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-12-01T15:42:28.777 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-01T15:42:29.070 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:42:29.188 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-01T15:42:29.348 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-12-01T15:42:29.677 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-12-01T15:42:29.928 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-12-01T15:42:30.196 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-01T15:42:30.322 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-01T15:42:30.606 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-12-01T15:42:30.915 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-01T15:42:31.275 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-12-01T15:42:31.685 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-12-01T15:42:31.953 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-12-01T15:42:32.078 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-01T15:42:32.413 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-12-01T15:42:32.823 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-01T15:42:38.267 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-01T15:42:38.267 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-12-01T15:42:38.267 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-01T15:42:38.267 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-12-01T15:42:38.267 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:42:38.267 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-12-01T15:42:38.267 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-12-01T15:42:38.267 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-12-01T15:42:38.267 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T15:42:38.267 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-12-01T15:42:38.268 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-01T15:42:38.268 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-12-01T15:42:38.268 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-01T15:42:38.268 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-01T15:42:38.918 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-01T15:42:39.044 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-12-01T15:42:39.212 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-12-01T15:42:39.338 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rsa (4.0-3) ... 2023-12-01T15:42:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-01T15:42:39.815 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-12-01T15:42:40.116 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-01T15:42:40.451 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-01T15:42:40.835 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-12-01T15:42:41.195 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librados2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:41.330 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-12-01T15:42:41.497 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:41.623 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:41.876 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:42.053 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-routes (2.4.1-2) ... 2023-12-01T15:42:42.345 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:42.455 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-12-01T15:42:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librbd1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:42.941 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:43.075 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:43.333 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-01T15:42:43.333 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-01T15:42:43.785 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:43.911 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:44.062 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-12-01T15:42:44.974 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:45.126 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:45.253 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:45.379 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:46.091 INFO:teuthology.orchestra.run.smithi146.stdout:Adding group ceph....done 2023-12-01T15:42:46.509 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user ceph....done 2023-12-01T15:42:46.718 INFO:teuthology.orchestra.run.smithi146.stdout:Setting system user ceph properties....done 2023-12-01T15:42:46.745 INFO:teuthology.orchestra.run.smithi146.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-01T15:42:46.902 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-01T15:42:47.226 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-01T15:42:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-01T15:42:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-01T15:42:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-01T15:42:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-01T15:42:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-01T15:42:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-01T15:42:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-01T15:42:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-01T15:42:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-01T15:42:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:52.912 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-01T15:42:52.912 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-01T15:42:53.369 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:53.512 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:53.671 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:53.814 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T15:42:54.208 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T15:42:54.351 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-01T15:42:54.653 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T15:42:57.505 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-12-01T15:42:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T15:42:58.363 DEBUG:teuthology.parallel:result is None 2023-12-01T15:42:58.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T15:42:58.509 DEBUG:teuthology.orchestra.run.smithi063:> dpkg-query -W -f '${Version}' ceph 2023-12-01T15:42:58.534 INFO:teuthology.orchestra.run.smithi063.stdout:18.2.0-1249-ga6f82997-1focal 2023-12-01T15:42:58.534 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1249-ga6f82997-1focal 2023-12-01T15:42:58.535 INFO:teuthology.task.install:The correct ceph version 18.2.0-1249-ga6f82997-1focal is installed. 2023-12-01T15:42:58.535 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T15:42:58.670 DEBUG:teuthology.orchestra.run.smithi066:> dpkg-query -W -f '${Version}' ceph 2023-12-01T15:42:58.695 INFO:teuthology.orchestra.run.smithi066.stdout:18.2.0-1249-ga6f82997-1focal 2023-12-01T15:42:58.695 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1249-ga6f82997-1focal 2023-12-01T15:42:58.695 INFO:teuthology.task.install:The correct ceph version 18.2.0-1249-ga6f82997-1focal is installed. 2023-12-01T15:42:58.696 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T15:42:58.907 DEBUG:teuthology.orchestra.run.smithi146:> dpkg-query -W -f '${Version}' ceph 2023-12-01T15:42:58.931 INFO:teuthology.orchestra.run.smithi146.stdout:18.2.0-1249-ga6f82997-1focal 2023-12-01T15:42:58.931 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1249-ga6f82997-1focal 2023-12-01T15:42:58.932 INFO:teuthology.task.install:The correct ceph version 18.2.0-1249-ga6f82997-1focal is installed. 2023-12-01T15:42:58.932 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-01T15:42:58.932 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:42:58.932 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-01T15:42:58.949 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:42:58.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-01T15:42:58.966 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:42:58.966 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-01T15:42:58.990 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-01T15:42:58.990 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:42:58.990 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2023-12-01T15:42:59.006 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-01T15:42:59.064 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:42:59.064 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2023-12-01T15:42:59.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-01T15:42:59.090 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:42:59.090 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2023-12-01T15:42:59.104 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-01T15:42:59.119 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-01T15:42:59.120 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:42:59.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-01T15:42:59.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-01T15:42:59.191 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:42:59.191 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-01T15:42:59.208 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-01T15:42:59.266 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:42:59.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-01T15:42:59.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-01T15:42:59.292 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-01T15:42:59.293 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:42:59.293 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2023-12-01T15:42:59.308 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-01T15:42:59.319 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:42:59.319 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2023-12-01T15:42:59.335 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-01T15:42:59.351 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:42:59.351 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2023-12-01T15:42:59.366 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-01T15:42:59.426 INFO:teuthology.run_tasks:Running task ceph... 2023-12-01T15:42:59.491 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-01T15:42:59.492 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2023-12-01T15:42:59.494 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /var/log/ceph 2023-12-01T15:42:59.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2023-12-01T15:42:59.512 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-01T15:42:59.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-01T15:42:59.514 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-01T15:42:59.556 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-01T15:42:59.572 INFO:tasks.ceph:Creating extra log directories... 2023-12-01T15:42:59.572 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-01T15:42:59.574 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-01T15:42:59.576 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-01T15:42:59.637 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-01T15:42:59.637 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-01T15:42:59.637 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-01T15:42:59.637 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:42:59.637 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-01T15:42:59.644 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-01T15:42:59.724 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:42:59.724 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-01T15:42:59.732 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-01T15:42:59.814 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:42:59.814 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-01T15:42:59.821 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-01T15:42:59.868 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-01T15:42:59.869 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-01T15:42:59.869 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692', 'branch': 'reef-release', 'description': 'smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/ubuntu_20.04 tasks/{0-install test/libcephfs_interface_tests}}', 'email': None, 'first_in_suite': False, 'job_id': '7473692', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 2, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef-release'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'}}, 's3tests': {'force-branch': 'ceph-reef'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef-release', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 55, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mds.a', 'mgr.x', 'osd.0', 'osd.1'], ['mon.b', 'mds.b', 'mon.c', 'mgr.y', 'osd.2', 'osd.3'], ['client.0']], 'seed': 3539, 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32', 'sleep_before_teardown': 0, 'suite': 'smoke', 'suite_branch': 'reef-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32', 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi066.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'cleanup': True, 'flavor': 'default', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'}}, {'ceph': {'log-ignorelist': ['\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'conf': {'client': {'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'client.0': ['libcephfs/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'wip-package-queries', 'teuthology_sha1': '595fad1080bd379e3c0231a8e02595924c59a9da', 'timestamp': '2023-12-01_15:11:02', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-01T15:42:59.870 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-01T15:42:59.873 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-01T15:42:59.876 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-01T15:42:59.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2023-12-01T15:42:59.923 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/run/ceph 2023-12-01T15:42:59.925 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2023-12-01T15:42:59.940 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:42:59.940 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2023-12-01T15:42:59.945 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-01T15:42:59.946 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2023-12-01T15:42:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-01T15:42:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T15:42:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 358 Links: 1 2023-12-01T15:42:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T15:42:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-01 15:36:14.908213095 +0000 2023-12-01T15:42:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-01 15:36:14.576220749 +0000 2023-12-01T15:42:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-01 15:36:14.576220749 +0000 2023-12-01T15:42:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2023-12-01T15:42:59.953 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-01T15:43:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-01T15:43:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-01T15:43:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000398878 s, 1.3 MB/s 2023-12-01T15:43:00.014 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-01T15:43:00.022 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2023-12-01T15:43:00.029 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-01T15:43:00.030 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T15:43:00.030 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-12-01T15:43:00.030 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T15:43:00.030 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-01 15:36:15.452200557 +0000 2023-12-01T15:43:00.030 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-01 15:36:15.132207933 +0000 2023-12-01T15:43:00.030 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-01 15:36:15.132207933 +0000 2023-12-01T15:43:00.030 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2023-12-01T15:43:00.030 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-01T15:43:00.042 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-01T15:43:00.042 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-01T15:43:00.042 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.00033383 s, 1.5 MB/s 2023-12-01T15:43:00.043 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-01T15:43:00.093 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2023-12-01T15:43:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-01T15:43:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T15:43:00.101 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-12-01T15:43:00.101 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T15:43:00.101 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-01 15:36:15.984188294 +0000 2023-12-01T15:43:00.101 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-01 15:36:15.692195025 +0000 2023-12-01T15:43:00.101 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-01 15:36:15.692195025 +0000 2023-12-01T15:43:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2023-12-01T15:43:00.101 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-01T15:43:00.113 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-01T15:43:00.113 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-01T15:43:00.114 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000401372 s, 1.3 MB/s 2023-12-01T15:43:00.114 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-01T15:43:00.165 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2023-12-01T15:43:00.172 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-01T15:43:00.172 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T15:43:00.173 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-12-01T15:43:00.173 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T15:43:00.173 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-01 15:36:16.228182670 +0000 2023-12-01T15:43:00.173 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-01 15:36:16.224182762 +0000 2023-12-01T15:43:00.173 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-01 15:36:16.224182762 +0000 2023-12-01T15:43:00.173 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2023-12-01T15:43:00.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-01T15:43:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-01T15:43:00.190 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-01T15:43:00.190 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000384255 s, 1.3 MB/s 2023-12-01T15:43:00.191 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-01T15:43:00.242 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-12-01T15:43:00.242 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:43:00.242 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2023-12-01T15:43:00.249 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-01T15:43:00.249 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2023-12-01T15:43:00.256 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-01T15:43:00.256 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T15:43:00.256 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 357 Links: 1 2023-12-01T15:43:00.256 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T15:43:00.256 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-12-01 15:36:17.284788927 +0000 2023-12-01T15:43:00.256 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-12-01 15:36:16.932797028 +0000 2023-12-01T15:43:00.256 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-12-01 15:36:16.932797028 +0000 2023-12-01T15:43:00.256 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2023-12-01T15:43:00.257 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-01T15:43:00.272 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-12-01T15:43:00.272 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-12-01T15:43:00.272 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000342258 s, 1.5 MB/s 2023-12-01T15:43:00.273 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-01T15:43:00.327 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2023-12-01T15:43:00.334 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-01T15:43:00.334 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T15:43:00.335 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 362 Links: 1 2023-12-01T15:43:00.335 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T15:43:00.335 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-12-01 15:36:17.824776500 +0000 2023-12-01T15:43:00.335 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-12-01 15:36:17.520783495 +0000 2023-12-01T15:43:00.335 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-12-01 15:36:17.520783495 +0000 2023-12-01T15:43:00.335 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2023-12-01T15:43:00.335 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-01T15:43:00.391 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-12-01T15:43:00.391 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-12-01T15:43:00.391 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000384351 s, 1.3 MB/s 2023-12-01T15:43:00.392 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-01T15:43:00.400 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2023-12-01T15:43:00.406 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-01T15:43:00.407 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T15:43:00.407 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-12-01T15:43:00.407 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T15:43:00.407 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-12-01 15:36:18.332764810 +0000 2023-12-01T15:43:00.407 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-12-01 15:36:18.036771621 +0000 2023-12-01T15:43:00.407 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-12-01 15:36:18.036771621 +0000 2023-12-01T15:43:00.407 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2023-12-01T15:43:00.407 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-01T15:43:00.420 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-12-01T15:43:00.421 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-12-01T15:43:00.421 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000394408 s, 1.3 MB/s 2023-12-01T15:43:00.421 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-01T15:43:00.475 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2023-12-01T15:43:00.482 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-01T15:43:00.482 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T15:43:00.483 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 376 Links: 1 2023-12-01T15:43:00.483 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T15:43:00.483 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-12-01 15:36:18.856752751 +0000 2023-12-01T15:43:00.483 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-12-01 15:36:18.556759655 +0000 2023-12-01T15:43:00.483 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-12-01 15:36:18.556759655 +0000 2023-12-01T15:43:00.483 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2023-12-01T15:43:00.483 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-01T15:43:00.497 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-12-01T15:43:00.497 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-12-01T15:43:00.497 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000417878 s, 1.2 MB/s 2023-12-01T15:43:00.498 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-01T15:43:00.506 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-12-01T15:43:00.506 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-12-01T15:43:00.506 INFO:tasks.ceph:Generating config... 2023-12-01T15:43:00.507 INFO:tasks.ceph:[client] debug client = 20 2023-12-01T15:43:00.507 INFO:tasks.ceph:[client] debug ms = 1 2023-12-01T15:43:00.507 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-01T15:43:00.508 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-01T15:43:00.508 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-01T15:43:00.508 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-01T15:43:00.508 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-01T15:43:00.508 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-01T15:43:00.508 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-01T15:43:00.508 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-01T15:43:00.508 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-01T15:43:00.508 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-01T15:43:00.508 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-01T15:43:00.508 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-01T15:43:00.508 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-01T15:43:00.509 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-01T15:43:00.509 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-01T15:43:00.509 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-01T15:43:00.509 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-01T15:43:00.509 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-01T15:43:00.509 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-01T15:43:00.509 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-01T15:43:00.509 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-01T15:43:00.509 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-01T15:43:00.509 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-12-01T15:43:00.509 INFO:tasks.ceph:Setting up mon.a... 2023-12-01T15:43:00.510 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-01T15:43:00.550 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.keyring 2023-12-01T15:43:00.564 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-01T15:43:00.607 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-01T15:43:00.664 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.63'), ('mon.b', '172.21.15.66'), ('mon.c', '[v2:172.21.15.66:3301,v1:172.21.15.66:6790]')] 2023-12-01T15:43:00.665 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.63,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug ms': 1}} 2023-12-01T15:43:00.666 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:43:00.666 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-01T15:43:00.670 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.63 --add b 172.21.15.66 --addv c '[v2:172.21.15.66:3301,v1:172.21.15.66:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-01T15:43:00.716 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-01T15:43:00.716 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid 0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9 2023-12-01T15:43:00.716 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = pacific 2023-12-01T15:43:00.717 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2023-12-01T15:43:00.717 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9 2023-12-01T15:43:00.717 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2023-12-01T15:43:00.715168+0000 2023-12-01T15:43:00.717 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-01T15:43:00.715168+0000 2023-12-01T15:43:00.717 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 16 (pacific) 2023-12-01T15:43:00.717 INFO:teuthology.orchestra.run.smithi063.stdout:election_strategy: 1 2023-12-01T15:43:00.717 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2023-12-01T15:43:00.717 INFO:teuthology.orchestra.run.smithi063.stdout:1: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2023-12-01T15:43:00.717 INFO:teuthology.orchestra.run.smithi063.stdout:2: [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] mon.c 2023-12-01T15:43:00.717 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-01T15:43:00.718 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-01T15:43:00.725 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9... 2023-12-01T15:43:00.726 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-01T15:43:00.771 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-01T15:43:00.773 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-01T15:43:00.802 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2023-12-01T15:43:00.802 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2023-12-01T15:43:00.802 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-01T15:43:00.803 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2023-12-01T15:43:00.803 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.803 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2023-12-01T15:43:00.803 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.803 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2023-12-01T15:43:00.803 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.803 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2023-12-01T15:43:00.803 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2023-12-01T15:43:00.803 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.803 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2023-12-01T15:43:00.803 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2023-12-01T15:43:00.804 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2023-12-01T15:43:00.805 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.806 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2023-12-01T15:43:00.806 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.806 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2023-12-01T15:43:00.806 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2023-12-01T15:43:00.806 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2023-12-01T15:43:00.806 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2023-12-01T15:43:00.806 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9 2023-12-01T15:43:00.806 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.806 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2023-12-01T15:43:00.806 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2023-12-01T15:43:00.806 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.807 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2023-12-01T15:43:00.809 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout: osd shutdown pgref assert = True 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2023-12-01T15:43:00.810 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2023-12-01T15:43:00.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2023-12-01T15:43:00.812 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.812 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-01T15:43:00.812 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2023-12-01T15:43:00.812 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2023-12-01T15:43:00.812 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.812 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2023-12-01T15:43:00.812 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-01T15:43:00.812 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-01T15:43:00.812 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.812 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2023-12-01T15:43:00.812 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2023-12-01T15:43:00.813 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2023-12-01T15:43:00.814 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2023-12-01T15:43:00.814 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2023-12-01T15:43:00.814 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2023-12-01T15:43:00.814 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2023-12-01T15:43:00.814 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2023-12-01T15:43:00.814 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2023-12-01T15:43:00.815 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2023-12-01T15:43:00.815 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2023-12-01T15:43:00.815 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-01T15:43:00.815 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2023-12-01T15:43:00.815 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.815 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2023-12-01T15:43:00.815 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.815 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-01T15:43:00.816 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-01T15:43:00.817 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2023-12-01T15:43:00.818 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.818 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-01T15:43:00.818 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.818 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2023-12-01T15:43:00.818 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.818 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2023-12-01T15:43:00.818 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.818 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2023-12-01T15:43:00.818 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2023-12-01T15:43:00.818 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2023-12-01T15:43:00.818 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.63,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout: osd mclock profile = high_recovery_ops 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2023-12-01T15:43:00.819 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2023-12-01T15:43:00.820 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: bdev async discard = True 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: bdev enable discard = True 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore allocator = bitmap 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 20 2023-12-01T15:43:00.821 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 20 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 20 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 10 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout: osd shutdown pgref assert = True 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2023-12-01T15:43:00.822 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2023-12-01T15:43:00.823 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2023-12-01T15:43:00.824 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2023-12-01T15:43:00.824 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2023-12-01T15:43:00.824 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2023-12-01T15:43:00.824 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2023-12-01T15:43:00.824 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2023-12-01T15:43:00.824 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2023-12-01T15:43:00.824 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.824 INFO:teuthology.orchestra.run.smithi066.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-01T15:43:00.824 INFO:teuthology.orchestra.run.smithi066.stdout: auth mon ticket ttl = 660 # 11m 2023-12-01T15:43:00.824 INFO:teuthology.orchestra.run.smithi066.stdout: auth service ticket ttl = 240 # 4m 2023-12-01T15:43:00.825 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.825 INFO:teuthology.orchestra.run.smithi066.stdout: # don't complain about insecure global_id in the test suite 2023-12-01T15:43:00.825 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-01T15:43:00.825 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-01T15:43:00.825 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.825 INFO:teuthology.orchestra.run.smithi066.stdout: # 1m isn't quite enough 2023-12-01T15:43:00.825 INFO:teuthology.orchestra.run.smithi066.stdout: mon_down_mkfs_grace = 2m 2023-12-01T15:43:00.825 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.825 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_filestore_osds = false 2023-12-01T15:43:00.825 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-01T15:43:00.825 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2023-12-01T15:43:00.826 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2023-12-01T15:43:00.826 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2023-12-01T15:43:00.826 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2023-12-01T15:43:00.826 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-01T15:43:00.826 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-01T15:43:00.826 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2023-12-01T15:43:00.826 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-12-01T15:43:00.826 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2023-12-01T15:43:00.826 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2023-12-01T15:43:00.826 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2023-12-01T15:43:00.826 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.827 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-12-01T15:43:00.828 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.828 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-12-01T15:43:00.828 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-12-01T15:43:00.828 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.828 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-12-01T15:43:00.828 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-12-01T15:43:00.828 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.828 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-01T15:43:00.828 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-12-01T15:43:00.828 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.828 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-12-01T15:43:00.829 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-12-01T15:43:00.830 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.63,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-12-01T15:43:00.831 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-12-01T15:43:00.832 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.832 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-12-01T15:43:00.832 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-12-01T15:43:00.832 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-12-01T15:43:00.832 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.832 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-12-01T15:43:00.832 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-12-01T15:43:00.832 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.832 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-12-01T15:43:00.832 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.832 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2023-12-01T15:43:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 20 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 20 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 10 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-12-01T15:43:00.834 INFO:teuthology.orchestra.run.smithi146.stdout: osd shutdown pgref assert = True 2023-12-01T15:43:00.835 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.835 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-12-01T15:43:00.835 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-12-01T15:43:00.835 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-12-01T15:43:00.835 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-12-01T15:43:00.835 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-12-01T15:43:00.835 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-12-01T15:43:00.835 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-12-01T15:43:00.835 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-12-01T15:43:00.835 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.835 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-01T15:43:00.836 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-12-01T15:43:00.837 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-12-01T15:43:00.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.837 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-12-01T15:43:00.837 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-01T15:43:00.837 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-01T15:43:00.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.837 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2023-12-01T15:43:00.837 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2023-12-01T15:43:00.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.837 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2023-12-01T15:43:00.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-01T15:43:00.838 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-12-01T15:43:00.838 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-12-01T15:43:00.838 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-12-01T15:43:00.838 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-12-01T15:43:00.838 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-01T15:43:00.838 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-01T15:43:00.838 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-12-01T15:43:00.838 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-12-01T15:43:00.838 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-12-01T15:43:00.838 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-12-01T15:43:00.838 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-12-01T15:43:00.839 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-12-01T15:43:00.839 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-12-01T15:43:00.839 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-12-01T15:43:00.839 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-12-01T15:43:00.839 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-12-01T15:43:00.840 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-01T15:43:00.841 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-01T15:43:00.897 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-01T15:43:00.898 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:43:00.898 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-01T15:43:00.902 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:43:00.902 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-01T15:43:00.909 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2023-12-01T15:43:00.909 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:43:00.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-01T15:43:00.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-01T15:43:00.932 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:43:00.932 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-01T15:43:00.938 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi066.front.sepia.ceph.com 2023-12-01T15:43:00.938 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:43:00.938 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-01T15:43:00.939 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-01T15:43:00.966 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:43:00.966 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-01T15:43:01.013 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2023-12-01T15:43:01.013 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:43:01.013 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-01T15:43:01.013 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-01T15:43:01.040 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:43:01.040 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-01T15:43:01.045 INFO:tasks.ceph:Setting up mon nodes... 2023-12-01T15:43:01.045 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-01T15:43:01.045 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-01T15:43:01.096 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-01T15:43:01.100 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-01T15:43:01.153 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-01T15:43:01.169 INFO:tasks.ceph:Setting up mds nodes... 2023-12-01T15:43:01.169 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-01T15:43:01.220 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-01T15:43:01.224 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-01T15:43:01.239 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-01T15:43:01.293 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-01T15:43:01.296 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-01T15:43:01.312 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-01T15:43:01.312 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-01T15:43:01.354 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-01T15:43:01.383 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-01T15:43:01.383 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-12-01T15:43:01.383 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-01T15:43:01.400 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-12-01T15:43:01.400 INFO:tasks.ceph:role: osd.0 2023-12-01T15:43:01.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2023-12-01T15:43:01.400 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-01T15:43:01.984 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T15:43:01.984 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T15:43:01.984 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T15:43:01.984 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 2023-12-01T15:43:01.984 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T15:43:01.984 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2023-12-01T15:43:01.984 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T15:43:01.984 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-01T15:43:01.985 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T15:43:01.985 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T15:43:01.986 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2023-12-01T15:43:01.986 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-01T15:43:02.095 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-01T15:43:02.107 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2023-12-01T15:43:02.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T15:43:02.108 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-01T15:43:02.118 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-12-01T15:43:02.118 INFO:tasks.ceph:role: osd.1 2023-12-01T15:43:02.119 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2023-12-01T15:43:02.119 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-01T15:43:02.637 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T15:43:02.637 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T15:43:02.638 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T15:43:02.638 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 2023-12-01T15:43:02.638 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T15:43:02.638 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2023-12-01T15:43:02.638 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T15:43:02.638 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-01T15:43:02.638 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T15:43:02.638 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T15:43:02.640 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2023-12-01T15:43:02.640 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-01T15:43:02.675 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-01T15:43:02.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T15:43:02.730 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2023-12-01T15:43:02.730 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T15:43:02.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:02.821+0000 7f71a04fd700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-01T15:43:02.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:02.821+0000 7f71a04fd700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-01T15:43:02.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:02.821+0000 7f71a04fd700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-01T15:43:02.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:02.821+0000 7f71a04fd700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-01T15:43:02.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:02.821+0000 7f71a04fd700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-01T15:43:02.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:02.821+0000 7f71a04fd700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-01T15:43:05.826 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-01T15:43:05.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T15:43:05.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:05.885+0000 7fe0b3011700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-01T15:43:05.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:05.885+0000 7fe0b3011700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-01T15:43:05.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:05.885+0000 7fe0b3011700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-01T15:43:05.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:05.885+0000 7fe0b3011700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-01T15:43:05.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:05.885+0000 7fe0b3011700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-01T15:43:05.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:05.885+0000 7fe0b3011700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-01T15:43:08.898 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-01T15:43:08.914 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-01T15:43:08.931 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-12-01T15:43:08.931 INFO:tasks.ceph:role: osd.2 2023-12-01T15:43:08.931 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com 2023-12-01T15:43:08.932 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-01T15:43:09.464 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T15:43:09.464 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T15:43:09.465 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T15:43:09.465 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 2023-12-01T15:43:09.465 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T15:43:09.465 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2023-12-01T15:43:09.465 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T15:43:09.465 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-01T15:43:09.466 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T15:43:09.466 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T15:43:09.467 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2023-12-01T15:43:09.468 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-12-01T15:43:09.578 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-01T15:43:09.590 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: /sbin/restorecon: command not found 2023-12-01T15:43:09.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T15:43:09.591 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-01T15:43:09.606 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-12-01T15:43:09.606 INFO:tasks.ceph:role: osd.3 2023-12-01T15:43:09.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com 2023-12-01T15:43:09.607 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-01T15:43:10.123 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T15:43:10.123 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T15:43:10.123 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T15:43:10.124 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 2023-12-01T15:43:10.124 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T15:43:10.124 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2023-12-01T15:43:10.124 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T15:43:10.124 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-01T15:43:10.124 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T15:43:10.124 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T15:43:10.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2023-12-01T15:43:10.126 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2023-12-01T15:43:10.163 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-01T15:43:10.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T15:43:10.217 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: /sbin/restorecon: command not found 2023-12-01T15:43:10.218 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T15:43:10.301 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:10.294+0000 7fa3115ff700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-01T15:43:10.302 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:10.294+0000 7fa3115ff700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-01T15:43:10.302 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:10.294+0000 7fa3115ff700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-01T15:43:10.302 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:10.294+0000 7fa3115ff700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-01T15:43:10.302 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:10.294+0000 7fa3115ff700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-01T15:43:10.302 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:10.294+0000 7fa3115ff700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-01T15:43:13.322 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-01T15:43:13.337 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T15:43:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:13.418+0000 7f2b0c564700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-01T15:43:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:13.418+0000 7f2b0c564700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-01T15:43:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:13.418+0000 7f2b0c564700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-01T15:43:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:13.418+0000 7f2b0c564700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-01T15:43:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:13.418+0000 7f2b0c564700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-01T15:43:13.427 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:13.418+0000 7f2b0c564700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-01T15:43:16.656 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-01T15:43:16.670 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-01T15:43:16.670 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:43:16.670 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-01T15:43:16.684 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:43:16.685 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-01T15:43:16.697 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:43:16.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-01T15:43:16.709 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:43:16.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-01T15:43:16.768 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:43:16.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-01T15:43:16.785 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:43:16.785 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-01T15:43:16.842 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:43:16.842 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-01T15:43:16.852 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:43:16.852 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-01T15:43:16.867 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:43:16.867 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-01T15:43:16.874 INFO:tasks.ceph:Adding keys to all mons... 2023-12-01T15:43:16.874 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-01T15:43:16.877 DEBUG:teuthology.orchestra.run.smithi066:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-01T15:43:16.913 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2023-12-01T15:43:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAF/2llG0u2BRAAppzcYC7MwtRXosbs4zgTQg== 2023-12-01T15:43:16.913 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2023-12-01T15:43:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAF/2llK3wdDRAAPc7sl7ikUIYD1X79FYm3Jw== 2023-12-01T15:43:16.914 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2023-12-01T15:43:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAG/2llTTJJMRAAtOaNw/JQP4AhInXAfVQzXQ== 2023-12-01T15:43:16.914 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2023-12-01T15:43:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAJ/2llUsoDNRAAVp7YB8QUauIThojqTwal9g== 2023-12-01T15:43:16.914 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2023-12-01T15:43:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAF/2llNDwVCRAAUEgRxiQSuKQhdr7u5mR4PQ== 2023-12-01T15:43:16.914 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2023-12-01T15:43:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAF/2lllaFuERAAhro06FpjqiFOhTzCzAwrXg== 2023-12-01T15:43:16.914 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2023-12-01T15:43:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAO/2llXAziERAAgK6PGQJdrVOF9rwGbLPyFg== 2023-12-01T15:43:16.915 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2023-12-01T15:43:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAR/2lli/dLGRAAaVuh68cLfuGuENI8jJy/wA== 2023-12-01T15:43:16.915 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2023-12-01T15:43:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAF/2llM/QDFRAAdBfUK7QarM1lu94X82Up6w== 2023-12-01T15:43:16.923 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.x] 2023-12-01T15:43:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAF/2llG0u2BRAAppzcYC7MwtRXosbs4zgTQg== 2023-12-01T15:43:16.924 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2023-12-01T15:43:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAF/2llK3wdDRAAPc7sl7ikUIYD1X79FYm3Jw== 2023-12-01T15:43:16.924 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.0] 2023-12-01T15:43:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAG/2llTTJJMRAAtOaNw/JQP4AhInXAfVQzXQ== 2023-12-01T15:43:16.924 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.1] 2023-12-01T15:43:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAJ/2llUsoDNRAAVp7YB8QUauIThojqTwal9g== 2023-12-01T15:43:16.924 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.y] 2023-12-01T15:43:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAF/2llNDwVCRAAUEgRxiQSuKQhdr7u5mR4PQ== 2023-12-01T15:43:16.924 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2023-12-01T15:43:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAF/2lllaFuERAAhro06FpjqiFOhTzCzAwrXg== 2023-12-01T15:43:16.925 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.2] 2023-12-01T15:43:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAO/2llXAziERAAgK6PGQJdrVOF9rwGbLPyFg== 2023-12-01T15:43:16.925 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.3] 2023-12-01T15:43:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAR/2lli/dLGRAAaVuh68cLfuGuENI8jJy/wA== 2023-12-01T15:43:16.925 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2023-12-01T15:43:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAF/2llM/QDFRAAdBfUK7QarM1lu94X82Up6w== 2023-12-01T15:43:16.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-01T15:43:16.959 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-01T15:43:17.011 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T15:43:17.013 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T15:43:17.067 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T15:43:17.069 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T15:43:17.116 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T15:43:17.118 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T15:43:17.167 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-01T15:43:17.169 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-01T15:43:17.217 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T15:43:17.219 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T15:43:17.310 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T15:43:17.312 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T15:43:17.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T15:43:17.367 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T15:43:17.422 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-01T15:43:17.425 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-01T15:43:17.478 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-01T15:43:17.478 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-01T15:43:17.492 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-01T15:43:17.629 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-01T15:43:17.646 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-01T15:43:17.663 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-01T15:43:17.732 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-01T15:43:17.747 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-01T15:43:17.758 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-01T15:43:17.824 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-01T15:43:17.838 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-01T15:43:17.840 DEBUG:teuthology.orchestra.run.smithi066:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-01T15:43:17.846 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-01T15:43:17.846 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-01T15:43:17.847 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-01T15:43:17.887 INFO:tasks.ceph.mon.a:Started 2023-12-01T15:43:17.887 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-01T15:43:17.887 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-01T15:43:17.889 INFO:tasks.ceph.mon.b:Started 2023-12-01T15:43:17.890 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-01T15:43:17.890 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-01T15:43:17.892 INFO:tasks.ceph.mon.c:Started 2023-12-01T15:43:17.892 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-01T15:43:17.893 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-01T15:43:17.893 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-01T15:43:17.895 INFO:tasks.ceph.mgr.x:Started 2023-12-01T15:43:17.895 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-01T15:43:17.895 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-01T15:43:17.897 INFO:tasks.ceph.mgr.y:Started 2023-12-01T15:43:17.898 INFO:tasks.ceph:Setting crush tunables to default 2023-12-01T15:43:17.898 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd crush tunables default 2023-12-01T15:43:18.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32bdf0e700 1 Processor -- start 2023-12-01T15:43:18.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32bdf0e700 1 -- start start 2023-12-01T15:43:18.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32bdf0e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:18.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32bdf0e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b809f900 con 0x7f32b813fd50 2023-12-01T15:43:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32bdf0e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b80a0410 con 0x7f32b8137510 2023-12-01T15:43:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32bdf0e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b80a48c0 con 0x7f32b80992d0 2023-12-01T15:43:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32bd70d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f32b813fd50 0x7f32b8142140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:50032/0 (socket says 172.21.15.63:50032) 2023-12-01T15:43:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32bd70d700 1 -- 172.21.15.63:0/3700623608 learned_addr learned my addr 172.21.15.63:0/3700623608 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 msgr2=0x7f32b813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T15:43:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 msgr2=0x7f32b813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:18.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.001+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T15:43:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.205+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.205+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 msgr2=0x7f32b813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T15:43:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.205+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 msgr2=0x7f32b813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:18.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.205+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:18.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.205+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T15:43:18.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.609+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:18.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.609+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 msgr2=0x7f32b813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T15:43:18.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.609+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 msgr2=0x7f32b813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:18.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.609+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:18.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:18.609+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T15:43:19.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:19.413+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:19.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:19.413+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 msgr2=0x7f32b813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T15:43:19.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:19.413+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 msgr2=0x7f32b813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:19.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:19.413+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:19.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:19.413+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T15:43:21.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b67fc700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 msgr2=0x7f32b813f810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T15:43:21.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b67fc700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32b80992d0 0x7f32b813f810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:21.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b67fc700 1 -- 172.21.15.63:0/3700623608 >> v1:172.21.15.66:6789/0 conn(0x7f32b8137510 legacy=0x7f32b81378f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:21.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b67fc700 1 -- 172.21.15.63:0/3700623608 >> v1:172.21.15.63:6789/0 conn(0x7f32b813fd50 legacy=0x7f32b8142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:21.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b67fc700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:21.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b67fc700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:21.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b67fc700 1 -- 172.21.15.63:0/3700623608 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b80a48c0 con 0x7f32a40062f0 2023-12-01T15:43:21.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b67fc700 1 -- 172.21.15.63:0/3700623608 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a4008e50 con 0x7f32a4003790 2023-12-01T15:43:21.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:21.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:21.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 msgr2=0x7f32a4008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T15:43:21.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 msgr2=0x7f32a4008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:21.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:21.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32bcf0c700 1 -- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 msgr2=0x7f32a4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T15:43:21.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32bcf0c700 1 -- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 msgr2=0x7f32a4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:21.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:21.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T15:43:21.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.005+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T15:43:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.209+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.209+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 msgr2=0x7f32a4008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T15:43:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.209+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 msgr2=0x7f32a4008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.209+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.209+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.209+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T15:43:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.209+0000 7f32bcf0c700 1 -- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 msgr2=0x7f32a4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T15:43:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.209+0000 7f32bcf0c700 1 -- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 msgr2=0x7f32a4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.209+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:21.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.209+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T15:43:21.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.613+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:21.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.613+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 msgr2=0x7f32a4008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T15:43:21.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.613+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 msgr2=0x7f32a4008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:21.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.613+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:21.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.613+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T15:43:21.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.613+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:21.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.613+0000 7f32bcf0c700 1 -- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 msgr2=0x7f32a4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T15:43:21.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.613+0000 7f32bcf0c700 1 -- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 msgr2=0x7f32a4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:21.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.613+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:21.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:21.613+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T15:43:22.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:22.417+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:22.417+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:22.417+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 msgr2=0x7f32a4008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T15:43:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:22.417+0000 7f32b7fff700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 msgr2=0x7f32a4008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:22.417+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:22.417+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T15:43:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:22.417+0000 7f32bcf0c700 1 -- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 msgr2=0x7f32a4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T15:43:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:22.417+0000 7f32bcf0c700 1 -- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 msgr2=0x7f32a4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T15:43:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:22.417+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T15:43:22.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:22.417+0000 7f32bcf0c700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T15:43:23.329 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:23.322+0000 7f2afb9922c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-01T15:43:23.973 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:23.966+0000 7f2afb9922c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-01T15:43:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b67fc700 1 -- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 msgr2=0x7f32a4005bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T15:43:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b67fc700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4003790 0x7f32a4005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b67fc700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 msgr2=0x7f32a4008790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T15:43:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b67fc700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a40062f0 0x7f32a4008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bd70d700 1 -- 172.21.15.63:0/3700623608 reap_dead start 2023-12-01T15:43:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b67fc700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32a4007df0 0x7f32a40082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b67fc700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a4008870 0x7f32a400d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bd70d700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.63:3300/0 conn(0x7f32a4008870 0x7f32a400d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b67fc700 1 -- 172.21.15.63:0/3700623608 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b8099880 con 0x7f32a4003bb0 2023-12-01T15:43:24.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32a4007df0 0x7f32a40082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b67fc700 1 -- 172.21.15.63:0/3700623608 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b80a48c0 con 0x7f32a4008870 2023-12-01T15:43:24.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b67fc700 1 -- 172.21.15.63:0/3700623608 --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a4008e50 con 0x7f32a4007df0 2023-12-01T15:43:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b77fe700 1 -- 172.21.15.63:0/3700623608 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270645304 0 0) 0x7f32b8099880 con 0x7f32a4003bb0 2023-12-01T15:43:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b77fe700 1 -- 172.21.15.63:0/3700623608 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32a00035d0 con 0x7f32a4003bb0 2023-12-01T15:43:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bd70d700 1 -- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32a4007df0 msgr2=0x7f32a40082a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bd70d700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32a4007df0 0x7f32a40082a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bd70d700 1 -- 172.21.15.63:0/3700623608 >> v1:172.21.15.63:6789/0 conn(0x7f32a4003bb0 legacy=0x7f32a40066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bd70d700 1 -- 172.21.15.63:0/3700623608 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a400ea40 con 0x7f32a4008870 2023-12-01T15:43:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b7fff700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32a4007df0 0x7f32a40082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:24.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bd70d700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32a4008870 0x7f32a400d2d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f32b80a11f0 tx=0x7f32a8001850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa82323a895a4781 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:24.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b77fe700 1 -- 172.21.15.63:0/3700623608 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8005de0 con 0x7f32a4008870 2023-12-01T15:43:24.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b77fe700 1 -- 172.21.15.63:0/3700623608 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a8007110 con 0x7f32a4008870 2023-12-01T15:43:24.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32b77fe700 1 -- 172.21.15.63:0/3700623608 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a80074a0 con 0x7f32a4008870 2023-12-01T15:43:24.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bdf0e700 1 -- 172.21.15.63:0/3700623608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32a4008870 msgr2=0x7f32a400d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bdf0e700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32a4008870 0x7f32a400d2d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f32b80a11f0 tx=0x7f32a8001850 comp rx=0 tx=0).stop 2023-12-01T15:43:24.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bdf0e700 1 -- 172.21.15.63:0/3700623608 shutdown_connections 2023-12-01T15:43:24.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bdf0e700 1 --2- 172.21.15.63:0/3700623608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32a4008870 0x7f32a400d2d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bdf0e700 1 --2- 172.21.15.63:0/3700623608 >> v2:172.21.15.66:3300/0 conn(0x7f32a4007df0 0x7f32a40082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bdf0e700 1 -- 172.21.15.63:0/3700623608 >> 172.21.15.63:0/3700623608 conn(0x7f32b80a8780 msgr2=0x7f32b80a8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bdf0e700 1 -- 172.21.15.63:0/3700623608 shutdown_connections 2023-12-01T15:43:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.005+0000 7f32bdf0e700 1 -- 172.21.15.63:0/3700623608 wait complete. 2023-12-01T15:43:24.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.009+0000 7f32bdf0e700 1 Processor -- start 2023-12-01T15:43:24.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.009+0000 7f32bdf0e700 1 -- start start 2023-12-01T15:43:24.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32bdf0e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32a4003bb0 0x7f32b81cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32bdf0e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4007df0 0x7f32b81cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32bdf0e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32a4008870 0x7f32b81cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32bdf0e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b813e930 con 0x7f32a4003bb0 2023-12-01T15:43:24.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32bdf0e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b813a2a0 con 0x7f32a4008870 2023-12-01T15:43:24.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32bdf0e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8139fc0 con 0x7f32a4007df0 2023-12-01T15:43:24.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32bcf0c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32a4003bb0 0x7f32b81cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b7fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4007df0 0x7f32b81cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32bd70d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32a4008870 0x7f32b81cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b7fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4007df0 0x7f32b81cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:52516/0 (socket says 172.21.15.63:52516) 2023-12-01T15:43:24.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b7fff700 1 -- 172.21.15.63:0/764824339 learned_addr learned my addr 172.21.15.63:0/764824339 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:24.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b7fff700 1 -- 172.21.15.63:0/764824339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32a4008870 msgr2=0x7f32b81cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b7fff700 1 --2- 172.21.15.63:0/764824339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32a4008870 0x7f32b81cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b7fff700 1 -- 172.21.15.63:0/764824339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32a4003bb0 msgr2=0x7f32b81cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b7fff700 1 --2- 172.21.15.63:0/764824339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32a4003bb0 0x7f32b81cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b7fff700 1 -- 172.21.15.63:0/764824339 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac00e040 con 0x7f32a4007df0 2023-12-01T15:43:24.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b7fff700 1 --2- 172.21.15.63:0/764824339 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4007df0 0x7f32b81cf600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0196c0 tx=0x7f32ac0199d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:24.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b57fa700 1 -- 172.21.15.63:0/764824339 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac01e070 con 0x7f32a4007df0 2023-12-01T15:43:24.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b57fa700 1 -- 172.21.15.63:0/764824339 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac01f040 con 0x7f32a4007df0 2023-12-01T15:43:24.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b57fa700 1 -- 172.21.15.63:0/764824339 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac017ad0 con 0x7f32a4007df0 2023-12-01T15:43:24.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32bdf0e700 1 -- 172.21.15.63:0/764824339 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b809f900 con 0x7f32a4007df0 2023-12-01T15:43:24.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32bdf0e700 1 -- 172.21.15.63:0/764824339 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b81384d0 con 0x7f32a4007df0 2023-12-01T15:43:24.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b57fa700 1 -- 172.21.15.63:0/764824339 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f32ac005a40 con 0x7f32a4007df0 2023-12-01T15:43:24.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32b57fa700 1 -- 172.21.15.63:0/764824339 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f32ac006740 con 0x7f32a4007df0 2023-12-01T15:43:24.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.013+0000 7f32bdf0e700 1 -- 172.21.15.63:0/764824339 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b809ac80 con 0x7f32a4007df0 2023-12-01T15:43:24.027 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.021+0000 7f32b57fa700 1 -- 172.21.15.63:0/764824339 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f32b81384d0 con 0x7f32a4007df0 2023-12-01T15:43:24.034 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:24.026+0000 7f2afb9922c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-01T15:43:24.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.097+0000 7f32bdf0e700 1 -- 172.21.15.63:0/764824339 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f32b8065fb0 con 0x7f32a4007df0 2023-12-01T15:43:24.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.109+0000 7f32b57fa700 1 -- 172.21.15.63:0/764824339 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f32ac00f040 con 0x7f32a4007df0 2023-12-01T15:43:24.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.109+0000 7f32bdf0e700 1 -- 172.21.15.63:0/764824339 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4007df0 msgr2=0x7f32b81cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.109+0000 7f32bdf0e700 1 --2- 172.21.15.63:0/764824339 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4007df0 0x7f32b81cf600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0196c0 tx=0x7f32ac0199d0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.109+0000 7f32bdf0e700 1 -- 172.21.15.63:0/764824339 shutdown_connections 2023-12-01T15:43:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.109+0000 7f32bdf0e700 1 --2- 172.21.15.63:0/764824339 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32a4007df0 0x7f32b81cf600 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.109+0000 7f32bdf0e700 1 --2- 172.21.15.63:0/764824339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32a4008870 0x7f32b81cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.109+0000 7f32bdf0e700 1 --2- 172.21.15.63:0/764824339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32a4003bb0 0x7f32b81cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.109+0000 7f32bdf0e700 1 -- 172.21.15.63:0/764824339 >> 172.21.15.63:0/764824339 conn(0x7f32b80a8780 msgr2=0x7f32b8133d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.109+0000 7f32bdf0e700 1 -- 172.21.15.63:0/764824339 shutdown_connections 2023-12-01T15:43:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:24.109+0000 7f32bdf0e700 1 -- 172.21.15.63:0/764824339 wait complete. 2023-12-01T15:43:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2023-12-01T15:43:24.130 INFO:tasks.ceph:check_enable_crimson: False 2023-12-01T15:43:24.131 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-01T15:43:24.131 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:43:24.131 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-01T15:43:24.145 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-01T15:43:24.145 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-01T15:43:24.160 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:43:24.160 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-01T15:43:24.177 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-01T15:43:24.177 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-01T15:43:24.194 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:24.186+0000 7f2afb9922c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-01T15:43:24.207 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 2bc79556-979d-4837-8915-054bbf487d48 0 2023-12-01T15:43:24.227 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:24.221+0000 7f9b8504f2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-01T15:43:24.368 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe84520c700 1 Processor -- start 2023-12-01T15:43:24.369 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe84520c700 1 -- start start 2023-12-01T15:43:24.369 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe84520c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 0x7fe8400a0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.369 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe84520c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe840138010 0x7fe840133e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.369 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe84520c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8400a1fc0 con 0x7fe840134350 2023-12-01T15:43:24.369 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe84520c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe840073240 con 0x7fe840138010 2023-12-01T15:43:24.369 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe84520c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400a0d60 con 0x7fe840137c30 2023-12-01T15:43:24.369 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe83ed9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 0x7fe8400a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.369 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe83e59c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe840138010 0x7fe840133e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.369 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe83f59e700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe840134350 0x7fe84013e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:60236/0 (socket says 172.21.15.66:60236) 2023-12-01T15:43:24.370 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe83f59e700 1 -- 172.21.15.66:0/156490741 learned_addr learned my addr 172.21.15.66:0/156490741 (peer_addr_for_me v1:172.21.15.66:0/0) 2023-12-01T15:43:24.370 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.358+0000 7fe83ed9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 0x7fe8400a0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:44296/0 (socket says 172.21.15.66:44296) 2023-12-01T15:43:24.370 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83ed9d700 1 -- 172.21.15.66:0/156490741 >> v2:172.21.15.66:3300/0 conn(0x7fe840138010 msgr2=0x7fe840133e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:24.370 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83ed9d700 1 --2- 172.21.15.66:0/156490741 >> v2:172.21.15.66:3300/0 conn(0x7fe840138010 0x7fe840133e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.370 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83ed9d700 1 -- 172.21.15.66:0/156490741 >> v1:172.21.15.66:6789/0 conn(0x7fe840134350 legacy=0x7fe84013e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.370 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83ed9d700 1 -- 172.21.15.66:0/156490741 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840137520 con 0x7fe840137c30 2023-12-01T15:43:24.370 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83e59c700 1 --2- 172.21.15.66:0/156490741 >> v2:172.21.15.66:3300/0 conn(0x7fe840138010 0x7fe840133e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:24.370 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83ed9d700 1 --2- 172.21.15.66:0/156490741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 0x7fe8400a0750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe830009850 tx=0x7fe830009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a617c9942f1500e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:24.370 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83dd9b700 1 -- 172.21.15.66:0/156490741 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830011830 con 0x7fe840137c30 2023-12-01T15:43:24.371 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83dd9b700 1 -- 172.21.15.66:0/156490741 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe830011990 con 0x7fe840137c30 2023-12-01T15:43:24.371 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83dd9b700 1 -- 172.21.15.66:0/156490741 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830011d40 con 0x7fe840137c30 2023-12-01T15:43:24.371 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 -- 172.21.15.66:0/156490741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 msgr2=0x7fe8400a0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.371 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 --2- 172.21.15.66:0/156490741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 0x7fe8400a0750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe830009850 tx=0x7fe830009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:24.371 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 -- 172.21.15.66:0/156490741 shutdown_connections 2023-12-01T15:43:24.371 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 --2- 172.21.15.66:0/156490741 >> v2:172.21.15.66:3300/0 conn(0x7fe840138010 0x7fe840133e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.371 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 --2- 172.21.15.66:0/156490741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 0x7fe8400a0750 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.371 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 -- 172.21.15.66:0/156490741 >> 172.21.15.66:0/156490741 conn(0x7fe840069ec0 msgr2=0x7fe84006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:24.371 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 -- 172.21.15.66:0/156490741 shutdown_connections 2023-12-01T15:43:24.371 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 -- 172.21.15.66:0/156490741 wait complete. 2023-12-01T15:43:24.374 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 Processor -- start 2023-12-01T15:43:24.374 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 -- start start 2023-12-01T15:43:24.374 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe840134350 0x7fe8401caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.374 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 0x7fe8401cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.374 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe840138010 0x7fe8401cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.374 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84006e550 con 0x7fe840138010 2023-12-01T15:43:24.374 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84006f460 con 0x7fe840134350 2023-12-01T15:43:24.374 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe84520c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8401315b0 con 0x7fe840137c30 2023-12-01T15:43:24.374 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83ed9d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe840134350 0x7fe8401caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.374 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83e59c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 0x7fe8401cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.375 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83e59c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 0x7fe8401cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:44308/0 (socket says 172.21.15.66:44308) 2023-12-01T15:43:24.375 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83e59c700 1 -- 172.21.15.66:0/3369826737 learned_addr learned my addr 172.21.15.66:0/3369826737 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-01T15:43:24.375 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83ed9d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe840134350 0x7fe8401caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57840/0 (socket says 172.21.15.66:57840) 2023-12-01T15:43:24.375 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83f59e700 1 --2- 172.21.15.66:0/3369826737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe840138010 0x7fe8401cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.375 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83ed9d700 1 -- 172.21.15.66:0/3369826737 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 msgr2=0x7fe8401cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.375 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.362+0000 7fe83ed9d700 1 --2- 172.21.15.66:0/3369826737 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 0x7fe8401cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.375 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe83ed9d700 1 -- 172.21.15.66:0/3369826737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe840138010 msgr2=0x7fe8401cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.375 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe83ed9d700 1 --2- 172.21.15.66:0/3369826737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe840138010 0x7fe8401cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.375 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe83ed9d700 1 -- 172.21.15.66:0/3369826737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8340094b0 con 0x7fe840134350 2023-12-01T15:43:24.375 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe83f59e700 1 --2- 172.21.15.66:0/3369826737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe840138010 0x7fe8401cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T15:43:24.376 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe83ed9d700 1 --2- 172.21.15.66:0/3369826737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe840134350 0x7fe8401caef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe8400a34e0 tx=0x7fe830004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:24.376 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe8277fe700 1 -- 172.21.15.66:0/3369826737 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830004300 con 0x7fe840134350 2023-12-01T15:43:24.376 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe8277fe700 1 -- 172.21.15.66:0/3369826737 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83001f070 con 0x7fe840134350 2023-12-01T15:43:24.376 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe84520c700 1 -- 172.21.15.66:0/3369826737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8300094b0 con 0x7fe840134350 2023-12-01T15:43:24.376 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe8277fe700 1 -- 172.21.15.66:0/3369826737 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8300036c0 con 0x7fe840134350 2023-12-01T15:43:24.376 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe84520c700 1 -- 172.21.15.66:0/3369826737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84006f930 con 0x7fe840134350 2023-12-01T15:43:24.376 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe8277fe700 1 -- 172.21.15.66:0/3369826737 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe830021030 con 0x7fe840134350 2023-12-01T15:43:24.376 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe8277fe700 1 -- 172.21.15.66:0/3369826737 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe83001a8b0 con 0x7fe840134350 2023-12-01T15:43:24.376 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.366+0000 7fe84520c700 1 -- 172.21.15.66:0/3369826737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe840065fb0 con 0x7fe840134350 2023-12-01T15:43:24.377 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.370+0000 7fe8277fe700 1 -- 172.21.15.66:0/3369826737 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fe830015020 con 0x7fe840134350 2023-12-01T15:43:24.416 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:24.410+0000 7f2afb9922c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-01T15:43:24.453 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.446+0000 7fe84520c700 1 -- 172.21.15.66:0/3369826737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2bc79556-979d-4837-8915-054bbf487d48", "id": 0} v 0) v1 -- 0x7fe840061d90 con 0x7fe840134350 2023-12-01T15:43:24.463 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.458+0000 7fe8277fe700 1 -- 172.21.15.66:0/3369826737 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2bc79556-979d-4837-8915-054bbf487d48", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe83001a450 con 0x7fe840134350 2023-12-01T15:43:24.463 INFO:teuthology.orchestra.run.smithi066.stdout:0 2023-12-01T15:43:24.465 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.458+0000 7fe84520c700 1 -- 172.21.15.66:0/3369826737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe840134350 msgr2=0x7fe8401caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.465 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.458+0000 7fe84520c700 1 --2- 172.21.15.66:0/3369826737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe840134350 0x7fe8401caef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe8400a34e0 tx=0x7fe830004770 comp rx=0 tx=0).stop 2023-12-01T15:43:24.465 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.458+0000 7fe84520c700 1 -- 172.21.15.66:0/3369826737 shutdown_connections 2023-12-01T15:43:24.465 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.458+0000 7fe84520c700 1 --2- 172.21.15.66:0/3369826737 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe840137c30 0x7fe8401cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.465 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.458+0000 7fe84520c700 1 --2- 172.21.15.66:0/3369826737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe840138010 0x7fe8401cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.465 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.458+0000 7fe84520c700 1 --2- 172.21.15.66:0/3369826737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe840134350 0x7fe8401caef0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.465 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.458+0000 7fe84520c700 1 -- 172.21.15.66:0/3369826737 >> 172.21.15.66:0/3369826737 conn(0x7fe840069ec0 msgr2=0x7fe8400a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:24.466 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.458+0000 7fe84520c700 1 -- 172.21.15.66:0/3369826737 shutdown_connections 2023-12-01T15:43:24.466 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.458+0000 7fe84520c700 1 -- 172.21.15.66:0/3369826737 wait complete. 2023-12-01T15:43:24.473 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:24.466+0000 7f2afb9922c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-01T15:43:24.478 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new bdbba160-500c-4e5d-9756-01bda550eb25 1 2023-12-01T15:43:24.594 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae8ea2700 1 Processor -- start 2023-12-01T15:43:24.594 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae8ea2700 1 -- start start 2023-12-01T15:43:24.595 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae8ea2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3ae41347d0 0x7f3ae406e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae8ea2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3ae4134bb0 0x7f3ae4137630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae8ea2700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae4134610 con 0x7f3ae4137b70 2023-12-01T15:43:24.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae8ea2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae4070010 con 0x7f3ae41347d0 2023-12-01T15:43:24.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae8ea2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae406f360 con 0x7f3ae4134bb0 2023-12-01T15:43:24.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae2ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3ae4134bb0 0x7f3ae4137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae3fff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3ae4137b70 0x7f3ae413e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:60252/0 (socket says 172.21.15.66:60252) 2023-12-01T15:43:24.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae2ffd700 1 --2- 172.21.15.66:0/4179885155 >> v2:172.21.15.66:3300/0 conn(0x7f3ae4134bb0 0x7f3ae4137630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57852/0 (socket says 172.21.15.66:57852) 2023-12-01T15:43:24.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae3fff700 1 -- 172.21.15.66:0/4179885155 learned_addr learned my addr 172.21.15.66:0/4179885155 (peer_addr_for_me v1:172.21.15.66:0/0) 2023-12-01T15:43:24.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae37fe700 1 --2- 172.21.15.66:0/4179885155 >> v2:172.21.15.63:3300/0 conn(0x7f3ae41347d0 0x7f3ae406e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.586+0000 7f3ae2ffd700 1 -- 172.21.15.66:0/4179885155 >> v2:172.21.15.63:3300/0 conn(0x7f3ae41347d0 msgr2=0x7f3ae406e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:24.597 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae2ffd700 1 --2- 172.21.15.66:0/4179885155 >> v2:172.21.15.63:3300/0 conn(0x7f3ae41347d0 0x7f3ae406e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.597 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae2ffd700 1 -- 172.21.15.66:0/4179885155 >> v1:172.21.15.66:6789/0 conn(0x7f3ae4137b70 legacy=0x7f3ae413e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.597 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae2ffd700 1 -- 172.21.15.66:0/4179885155 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae406db00 con 0x7f3ae4134bb0 2023-12-01T15:43:24.597 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae37fe700 1 --2- 172.21.15.66:0/4179885155 >> v2:172.21.15.63:3300/0 conn(0x7f3ae41347d0 0x7f3ae406e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T15:43:24.597 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae2ffd700 1 --2- 172.21.15.66:0/4179885155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae4134bb0 0x7f3ae4137630 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ae409a200 tx=0x7f3ad8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73028ad58bc9206e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:24.597 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae27fc700 1 -- 172.21.15.66:0/4179885155 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8011830 con 0x7f3ae4134bb0 2023-12-01T15:43:24.597 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae27fc700 1 -- 172.21.15.66:0/4179885155 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad8011990 con 0x7f3ae4134bb0 2023-12-01T15:43:24.597 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae27fc700 1 -- 172.21.15.66:0/4179885155 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8011d40 con 0x7f3ae4134bb0 2023-12-01T15:43:24.598 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/4179885155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae4134bb0 msgr2=0x7f3ae4137630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.598 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae8ea2700 1 --2- 172.21.15.66:0/4179885155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae4134bb0 0x7f3ae4137630 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ae409a200 tx=0x7f3ad8009b30 comp rx=0 tx=0).stop 2023-12-01T15:43:24.598 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/4179885155 shutdown_connections 2023-12-01T15:43:24.598 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae8ea2700 1 --2- 172.21.15.66:0/4179885155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae4134bb0 0x7f3ae4137630 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.598 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae8ea2700 1 --2- 172.21.15.66:0/4179885155 >> v2:172.21.15.63:3300/0 conn(0x7f3ae41347d0 0x7f3ae406e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.599 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/4179885155 >> 172.21.15.66:0/4179885155 conn(0x7f3ae40a96b0 msgr2=0x7f3ae40a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:24.599 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/4179885155 shutdown_connections 2023-12-01T15:43:24.599 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/4179885155 wait complete. 2023-12-01T15:43:24.599 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae8ea2700 1 Processor -- start 2023-12-01T15:43:24.599 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.590+0000 7f3ae8ea2700 1 -- start start 2023-12-01T15:43:24.601 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae8ea2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae41347d0 0x7f3ae4133280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.601 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae8ea2700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ae4134bb0 0x7f3ae41337c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.601 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae8ea2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ae4137b70 0x7f3ae40a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.601 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae8ea2700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae40a2ff0 con 0x7f3ae4134bb0 2023-12-01T15:43:24.601 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae8ea2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae4133d00 con 0x7f3ae41347d0 2023-12-01T15:43:24.601 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae8ea2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae406abb0 con 0x7f3ae4137b70 2023-12-01T15:43:24.602 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae37fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae41347d0 0x7f3ae4133280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.602 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ae4137b70 0x7f3ae40a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.602 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ae4137b70 0x7f3ae40a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:44324/0 (socket says 172.21.15.66:44324) 2023-12-01T15:43:24.602 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae37fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae41347d0 0x7f3ae4133280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57864/0 (socket says 172.21.15.66:57864) 2023-12-01T15:43:24.602 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae3fff700 1 -- 172.21.15.66:0/2704949183 learned_addr learned my addr 172.21.15.66:0/2704949183 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-01T15:43:24.602 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae2ffd700 1 --2- 172.21.15.66:0/2704949183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ae4134bb0 0x7f3ae41337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.602 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae3fff700 1 -- 172.21.15.66:0/2704949183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae41347d0 msgr2=0x7f3ae4133280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.602 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae3fff700 1 --2- 172.21.15.66:0/2704949183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae41347d0 0x7f3ae4133280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.602 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae3fff700 1 -- 172.21.15.66:0/2704949183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ae4134bb0 msgr2=0x7f3ae41337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.602 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae3fff700 1 --2- 172.21.15.66:0/2704949183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ae4134bb0 0x7f3ae41337c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.602 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae3fff700 1 -- 172.21.15.66:0/2704949183 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad80094b0 con 0x7f3ae4137b70 2023-12-01T15:43:24.603 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae37fe700 1 --2- 172.21.15.66:0/2704949183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae41347d0 0x7f3ae4133280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:24.603 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae3fff700 1 --2- 172.21.15.66:0/2704949183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ae4137b70 0x7f3ae40a03f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00cbf0 tx=0x7f3adc00cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:24.603 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3acbfff700 1 -- 172.21.15.66:0/2704949183 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc007480 con 0x7f3ae4137b70 2023-12-01T15:43:24.603 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3acbfff700 1 -- 172.21.15.66:0/2704949183 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc0075e0 con 0x7f3ae4137b70 2023-12-01T15:43:24.603 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/2704949183 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae40a2160 con 0x7f3ae4137b70 2023-12-01T15:43:24.603 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3acbfff700 1 -- 172.21.15.66:0/2704949183 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc007950 con 0x7f3ae4137b70 2023-12-01T15:43:24.603 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/2704949183 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae40a2d30 con 0x7f3ae4137b70 2023-12-01T15:43:24.603 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3acbfff700 1 -- 172.21.15.66:0/2704949183 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3adc01c440 con 0x7f3ae4137b70 2023-12-01T15:43:24.603 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3acbfff700 1 -- 172.21.15.66:0/2704949183 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f3adc0127b0 con 0x7f3ae4137b70 2023-12-01T15:43:24.604 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.594+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/2704949183 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae4065fb0 con 0x7f3ae4137b70 2023-12-01T15:43:24.606 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.598+0000 7f3acbfff700 1 -- 172.21.15.66:0/2704949183 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f3adc021060 con 0x7f3ae4137b70 2023-12-01T15:43:24.672 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:24.666+0000 7f2afb9922c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-01T15:43:24.681 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.674+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/2704949183 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bdbba160-500c-4e5d-9756-01bda550eb25", "id": 1} v 0) v1 -- 0x7f3ae40a1920 con 0x7f3ae4137b70 2023-12-01T15:43:24.691 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.686+0000 7f3acbfff700 1 -- 172.21.15.66:0/2704949183 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bdbba160-500c-4e5d-9756-01bda550eb25", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3adc017070 con 0x7f3ae4137b70 2023-12-01T15:43:24.692 INFO:teuthology.orchestra.run.smithi066.stdout:1 2023-12-01T15:43:24.693 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.686+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/2704949183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ae4137b70 msgr2=0x7f3ae40a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.693 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.686+0000 7f3ae8ea2700 1 --2- 172.21.15.66:0/2704949183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ae4137b70 0x7f3ae40a03f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00cbf0 tx=0x7f3adc00cc20 comp rx=0 tx=0).stop 2023-12-01T15:43:24.693 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.686+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/2704949183 shutdown_connections 2023-12-01T15:43:24.693 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.686+0000 7f3ae8ea2700 1 --2- 172.21.15.66:0/2704949183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ae4137b70 0x7f3ae40a03f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.693 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.686+0000 7f3ae8ea2700 1 --2- 172.21.15.66:0/2704949183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ae4134bb0 0x7f3ae41337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.693 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.686+0000 7f3ae8ea2700 1 --2- 172.21.15.66:0/2704949183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ae41347d0 0x7f3ae4133280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.693 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.686+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/2704949183 >> 172.21.15.66:0/2704949183 conn(0x7f3ae40a96b0 msgr2=0x7f3ae409af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:24.694 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.686+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/2704949183 shutdown_connections 2023-12-01T15:43:24.694 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.686+0000 7f3ae8ea2700 1 -- 172.21.15.66:0/2704949183 wait complete. 2023-12-01T15:43:24.710 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 3165d6ee-48db-4d40-b80d-abc11f61cb96 2 2023-12-01T15:43:24.740 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:24.734+0000 7f2afb9922c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-01T15:43:24.813 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:24.806+0000 7f2afb9922c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-01T15:43:24.825 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca818c4700 1 Processor -- start 2023-12-01T15:43:24.825 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca818c4700 1 -- start start 2023-12-01T15:43:24.826 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca818c4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c13bd50 0x7fca7c13c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.826 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca818c4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fca7c06c960 0x7fca7c098a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.826 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca818c4700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c13c670 con 0x7fca7c098fa0 2023-12-01T15:43:24.826 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca818c4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c0a8680 con 0x7fca7c06c960 2023-12-01T15:43:24.826 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca818c4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c06ba50 con 0x7fca7c13bd50 2023-12-01T15:43:24.826 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca7b7fe700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fca7c098fa0 0x7fca7c145e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:60264/0 (socket says 172.21.15.66:60264) 2023-12-01T15:43:24.826 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca7b7fe700 1 -- 172.21.15.66:0/2476993509 learned_addr learned my addr 172.21.15.66:0/2476993509 (peer_addr_for_me v1:172.21.15.66:0/0) 2023-12-01T15:43:24.826 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca7affd700 1 --2- 172.21.15.66:0/2476993509 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c13bd50 0x7fca7c13c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.826 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca7a7fc700 1 --2- 172.21.15.66:0/2476993509 >> v2:172.21.15.66:3300/0 conn(0x7fca7c06c960 0x7fca7c098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.828 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca79ffb700 1 -- 172.21.15.66:0/2476993509 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945729679 0 0) 0x7fca74001490 con 0x7fca7c098fa0 2023-12-01T15:43:24.828 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca79ffb700 1 -- 172.21.15.66:0/2476993509 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca640035d0 con 0x7fca7c098fa0 2023-12-01T15:43:24.828 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca7affd700 1 -- 172.21.15.66:0/2476993509 >> v2:172.21.15.66:3300/0 conn(0x7fca7c06c960 msgr2=0x7fca7c098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:24.828 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca7affd700 1 --2- 172.21.15.66:0/2476993509 >> v2:172.21.15.66:3300/0 conn(0x7fca7c06c960 0x7fca7c098a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.828 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca7affd700 1 -- 172.21.15.66:0/2476993509 >> v1:172.21.15.66:6789/0 conn(0x7fca7c098fa0 legacy=0x7fca7c145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.828 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca7affd700 1 -- 172.21.15.66:0/2476993509 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0a9be0 con 0x7fca7c13bd50 2023-12-01T15:43:24.828 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca7a7fc700 1 --2- 172.21.15.66:0/2476993509 >> v2:172.21.15.66:3300/0 conn(0x7fca7c06c960 0x7fca7c098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.818+0000 7fca7affd700 1 --2- 172.21.15.66:0/2476993509 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c13bd50 0x7fca7c13c130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009850 tx=0x7fca6c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b35527d06a22978 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca79ffb700 1 -- 172.21.15.66:0/2476993509 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c011830 con 0x7fca7c13bd50 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca79ffb700 1 -- 172.21.15.66:0/2476993509 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c011990 con 0x7fca7c13bd50 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca79ffb700 1 -- 172.21.15.66:0/2476993509 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c011d40 con 0x7fca7c13bd50 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 -- 172.21.15.66:0/2476993509 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c13bd50 msgr2=0x7fca7c13c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 --2- 172.21.15.66:0/2476993509 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c13bd50 0x7fca7c13c130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009850 tx=0x7fca6c009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 -- 172.21.15.66:0/2476993509 shutdown_connections 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 --2- 172.21.15.66:0/2476993509 >> v2:172.21.15.66:3300/0 conn(0x7fca7c06c960 0x7fca7c098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 --2- 172.21.15.66:0/2476993509 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c13bd50 0x7fca7c13c130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 -- 172.21.15.66:0/2476993509 >> 172.21.15.66:0/2476993509 conn(0x7fca7c073580 msgr2=0x7fca7c0aa880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 -- 172.21.15.66:0/2476993509 shutdown_connections 2023-12-01T15:43:24.829 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 -- 172.21.15.66:0/2476993509 wait complete. 2023-12-01T15:43:24.832 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 Processor -- start 2023-12-01T15:43:24.832 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 -- start start 2023-12-01T15:43:24.832 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca7c06c960 0x7fca7c1d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.832 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c098fa0 0x7fca7c1d4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.832 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca7c13bd50 0x7fca7c1d4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:24.832 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c09e7d0 con 0x7fca7c06c960 2023-12-01T15:43:24.832 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c09fcb0 con 0x7fca7c13bd50 2023-12-01T15:43:24.832 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c09f7e0 con 0x7fca7c098fa0 2023-12-01T15:43:24.832 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7b7fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca7c13bd50 0x7fca7c1d4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.832 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7a7fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c098fa0 0x7fca7c1d4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7a7fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c098fa0 0x7fca7c1d4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:44330/0 (socket says 172.21.15.66:44330) 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7a7fc700 1 -- 172.21.15.66:0/318760570 learned_addr learned my addr 172.21.15.66:0/318760570 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7affd700 1 --2- 172.21.15.66:0/318760570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca7c06c960 0x7fca7c1d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7b7fe700 1 -- 172.21.15.66:0/318760570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c098fa0 msgr2=0x7fca7c1d4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7b7fe700 1 --2- 172.21.15.66:0/318760570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c098fa0 0x7fca7c1d4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7b7fe700 1 -- 172.21.15.66:0/318760570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca7c06c960 msgr2=0x7fca7c1d3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7b7fe700 1 --2- 172.21.15.66:0/318760570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca7c06c960 0x7fca7c1d3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7b7fe700 1 -- 172.21.15.66:0/318760570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca700094b0 con 0x7fca7c13bd50 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7affd700 1 --2- 172.21.15.66:0/318760570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca7c06c960 0x7fca7c1d3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca7b7fe700 1 --2- 172.21.15.66:0/318760570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca7c13bd50 0x7fca7c1d4550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca7400c9f0 tx=0x7fca7400ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca63fff700 1 -- 172.21.15.66:0/318760570 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74007480 con 0x7fca7c13bd50 2023-12-01T15:43:24.833 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca63fff700 1 -- 172.21.15.66:0/318760570 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca740075e0 con 0x7fca7c13bd50 2023-12-01T15:43:24.834 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.822+0000 7fca818c4700 1 -- 172.21.15.66:0/318760570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c0094b0 con 0x7fca7c13bd50 2023-12-01T15:43:24.834 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.826+0000 7fca63fff700 1 -- 172.21.15.66:0/318760570 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74007990 con 0x7fca7c13bd50 2023-12-01T15:43:24.834 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.826+0000 7fca818c4700 1 -- 172.21.15.66:0/318760570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c09ebd0 con 0x7fca7c13bd50 2023-12-01T15:43:24.834 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.826+0000 7fca63fff700 1 -- 172.21.15.66:0/318760570 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fca7401c440 con 0x7fca7c13bd50 2023-12-01T15:43:24.834 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.826+0000 7fca63fff700 1 -- 172.21.15.66:0/318760570 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fca74012820 con 0x7fca7c13bd50 2023-12-01T15:43:24.835 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.826+0000 7fca818c4700 1 -- 172.21.15.66:0/318760570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c065fb0 con 0x7fca7c13bd50 2023-12-01T15:43:24.835 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.826+0000 7fca63fff700 1 -- 172.21.15.66:0/318760570 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fca74017070 con 0x7fca7c13bd50 2023-12-01T15:43:24.872 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:24.865+0000 7f9b8504f2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-01T15:43:24.912 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.906+0000 7fca818c4700 1 -- 172.21.15.66:0/318760570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3165d6ee-48db-4d40-b80d-abc11f61cb96", "id": 2} v 0) v1 -- 0x7fca7c0aa4b0 con 0x7fca7c13bd50 2023-12-01T15:43:24.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.914+0000 7fca63fff700 1 -- 172.21.15.66:0/318760570 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3165d6ee-48db-4d40-b80d-abc11f61cb96", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fca7c13c670 con 0x7fca7c13bd50 2023-12-01T15:43:24.921 INFO:teuthology.orchestra.run.smithi066.stdout:2 2023-12-01T15:43:24.923 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.914+0000 7fca818c4700 1 -- 172.21.15.66:0/318760570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca7c13bd50 msgr2=0x7fca7c1d4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:24.923 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.914+0000 7fca818c4700 1 --2- 172.21.15.66:0/318760570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca7c13bd50 0x7fca7c1d4550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca7400c9f0 tx=0x7fca7400ca20 comp rx=0 tx=0).stop 2023-12-01T15:43:24.923 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.914+0000 7fca818c4700 1 -- 172.21.15.66:0/318760570 shutdown_connections 2023-12-01T15:43:24.923 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.914+0000 7fca818c4700 1 --2- 172.21.15.66:0/318760570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fca7c098fa0 0x7fca7c1d4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.923 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.914+0000 7fca818c4700 1 --2- 172.21.15.66:0/318760570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca7c13bd50 0x7fca7c1d4550 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.923 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.914+0000 7fca818c4700 1 --2- 172.21.15.66:0/318760570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca7c06c960 0x7fca7c1d3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:24.923 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.914+0000 7fca818c4700 1 -- 172.21.15.66:0/318760570 >> 172.21.15.66:0/318760570 conn(0x7fca7c073580 msgr2=0x7fca7c13ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:24.923 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.914+0000 7fca818c4700 1 -- 172.21.15.66:0/318760570 shutdown_connections 2023-12-01T15:43:24.923 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:24.914+0000 7fca818c4700 1 -- 172.21.15.66:0/318760570 wait complete. 2023-12-01T15:43:24.933 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:24.925+0000 7f9b8504f2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-01T15:43:24.936 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new aac87cc6-efc2-45b9-a147-f936029dcb2f 3 2023-12-01T15:43:25.088 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:25.081+0000 7f9b8504f2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-01T15:43:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 Processor -- start 2023-12-01T15:43:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 -- start start 2023-12-01T15:43:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 0x7f081813b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0818098a60 0x7f0818098e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081813a710 con 0x7f08180993c0 2023-12-01T15:43:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08180a93c0 con 0x7f0818098a60 2023-12-01T15:43:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08180a6ae0 con 0x7f081813aeb0 2023-12-01T15:43:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081cede700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 0x7f081813b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081cede700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 0x7f081813b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:44344/0 (socket says 172.21.15.66:44344) 2023-12-01T15:43:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f0817fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0818098a60 0x7f0818098e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081cede700 1 -- 172.21.15.66:0/140607976 learned_addr learned my addr 172.21.15.66:0/140607976 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-01T15:43:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081cede700 1 -- 172.21.15.66:0/140607976 >> v2:172.21.15.66:3300/0 conn(0x7f0818098a60 msgr2=0x7f0818098e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081cede700 1 --2- 172.21.15.66:0/140607976 >> v2:172.21.15.66:3300/0 conn(0x7f0818098a60 0x7f0818098e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081cede700 1 -- 172.21.15.66:0/140607976 >> v1:172.21.15.66:6789/0 conn(0x7f08180993c0 legacy=0x7f0818141a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081cede700 1 -- 172.21.15.66:0/140607976 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08180a7d00 con 0x7f081813aeb0 2023-12-01T15:43:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f08177fe700 1 -- 172.21.15.66:0/140607976 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802717799 0 0) 0x7f081813a710 con 0x7f08180993c0 2023-12-01T15:43:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f0817fff700 1 --2- 172.21.15.66:0/140607976 >> v2:172.21.15.66:3300/0 conn(0x7f0818098a60 0x7f0818098e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081cede700 1 --2- 172.21.15.66:0/140607976 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 0x7f081813b290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f080c009910 tx=0x7f080c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65d26f319dbc297f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f08177fe700 1 -- 172.21.15.66:0/140607976 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c011830 con 0x7f081813aeb0 2023-12-01T15:43:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f08177fe700 1 -- 172.21.15.66:0/140607976 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c011990 con 0x7f081813aeb0 2023-12-01T15:43:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f08177fe700 1 -- 172.21.15.66:0/140607976 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c011d40 con 0x7f081813aeb0 2023-12-01T15:43:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 -- 172.21.15.66:0/140607976 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 msgr2=0x7f081813b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 --2- 172.21.15.66:0/140607976 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 0x7f081813b290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f080c009910 tx=0x7f080c009c20 comp rx=0 tx=0).stop 2023-12-01T15:43:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 -- 172.21.15.66:0/140607976 shutdown_connections 2023-12-01T15:43:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 --2- 172.21.15.66:0/140607976 >> v2:172.21.15.66:3300/0 conn(0x7f0818098a60 0x7f0818098e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 --2- 172.21.15.66:0/140607976 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 0x7f081813b290 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.101 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 -- 172.21.15.66:0/140607976 >> 172.21.15.66:0/140607976 conn(0x7f08180738b0 msgr2=0x7f08180acaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:25.101 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 -- 172.21.15.66:0/140607976 shutdown_connections 2023-12-01T15:43:25.101 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.090+0000 7f081f142700 1 -- 172.21.15.66:0/140607976 wait complete. 2023-12-01T15:43:25.101 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081f142700 1 Processor -- start 2023-12-01T15:43:25.101 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081f142700 1 -- start start 2023-12-01T15:43:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081f142700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0818098a60 0x7f08181cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081f142700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08180993c0 0x7f08181cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081f142700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 0x7f08181d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081f142700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08180a0360 con 0x7f0818098a60 2023-12-01T15:43:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081f142700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08180a0e50 con 0x7f08180993c0 2023-12-01T15:43:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081f142700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081809f590 con 0x7f081813aeb0 2023-12-01T15:43:25.104 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f0817fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08180993c0 0x7f08181cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.104 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f0817fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08180993c0 0x7f08181cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57902/0 (socket says 172.21.15.66:57902) 2023-12-01T15:43:25.104 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f0817fff700 1 -- 172.21.15.66:0/2546491077 learned_addr learned my addr 172.21.15.66:0/2546491077 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-01T15:43:25.104 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081d6df700 1 --2- 172.21.15.66:0/2546491077 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 0x7f08181d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.104 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081cede700 1 --2- 172.21.15.66:0/2546491077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0818098a60 0x7f08181cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.104 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f0817fff700 1 -- 172.21.15.66:0/2546491077 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 msgr2=0x7f08181d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.104 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f0817fff700 1 --2- 172.21.15.66:0/2546491077 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 0x7f08181d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.104 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f0817fff700 1 -- 172.21.15.66:0/2546491077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0818098a60 msgr2=0x7f08181cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.104 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f0817fff700 1 --2- 172.21.15.66:0/2546491077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0818098a60 0x7f08181cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.104 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f0817fff700 1 -- 172.21.15.66:0/2546491077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040094b0 con 0x7f08180993c0 2023-12-01T15:43:25.104 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f0817fff700 1 --2- 172.21.15.66:0/2546491077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08180993c0 0x7f08181cfad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f080400ebe0 tx=0x7f080400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:25.105 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f08157fa700 1 -- 172.21.15.66:0/2546491077 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400c850 con 0x7f08180993c0 2023-12-01T15:43:25.105 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f08157fa700 1 -- 172.21.15.66:0/2546491077 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080400c9b0 con 0x7f08180993c0 2023-12-01T15:43:25.105 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081f142700 1 -- 172.21.15.66:0/2546491077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c009570 con 0x7f08180993c0 2023-12-01T15:43:25.105 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f08157fa700 1 -- 172.21.15.66:0/2546491077 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400cd40 con 0x7f08180993c0 2023-12-01T15:43:25.105 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f081f142700 1 -- 172.21.15.66:0/2546491077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08180a18f0 con 0x7f08180993c0 2023-12-01T15:43:25.105 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f08157fa700 1 -- 172.21.15.66:0/2546491077 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0804005d40 con 0x7f08180993c0 2023-12-01T15:43:25.105 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.094+0000 7f08157fa700 1 -- 172.21.15.66:0/2546491077 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f08040068e0 con 0x7f08180993c0 2023-12-01T15:43:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.102+0000 7f081f142700 1 -- 172.21.15.66:0/2546491077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0818065fb0 con 0x7f08180993c0 2023-12-01T15:43:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.102+0000 7f08157fa700 1 -- 172.21.15.66:0/2546491077 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f0804021060 con 0x7f08180993c0 2023-12-01T15:43:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.182+0000 7f081f142700 1 -- 172.21.15.66:0/2546491077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aac87cc6-efc2-45b9-a147-f936029dcb2f", "id": 3} v 0) v1 -- 0x7f0818061d90 con 0x7f08180993c0 2023-12-01T15:43:25.195 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.190+0000 7f08157fa700 1 -- 172.21.15.66:0/2546491077 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aac87cc6-efc2-45b9-a147-f936029dcb2f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0804029020 con 0x7f08180993c0 2023-12-01T15:43:25.195 INFO:teuthology.orchestra.run.smithi066.stdout:3 2023-12-01T15:43:25.197 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.190+0000 7f081f142700 1 -- 172.21.15.66:0/2546491077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08180993c0 msgr2=0x7f08181cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.197 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.190+0000 7f081f142700 1 --2- 172.21.15.66:0/2546491077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08180993c0 0x7f08181cfad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f080400ebe0 tx=0x7f080400eef0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.197 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.190+0000 7f081f142700 1 -- 172.21.15.66:0/2546491077 shutdown_connections 2023-12-01T15:43:25.197 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.190+0000 7f081f142700 1 --2- 172.21.15.66:0/2546491077 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f081813aeb0 0x7f08181d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.197 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.190+0000 7f081f142700 1 --2- 172.21.15.66:0/2546491077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08180993c0 0x7f08181cfad0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.197 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.190+0000 7f081f142700 1 --2- 172.21.15.66:0/2546491077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0818098a60 0x7f08181cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.197 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.190+0000 7f081f142700 1 -- 172.21.15.66:0/2546491077 >> 172.21.15.66:0/2546491077 conn(0x7f08180738b0 msgr2=0x7f08181393a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:25.198 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.190+0000 7f081f142700 1 -- 172.21.15.66:0/2546491077 shutdown_connections 2023-12-01T15:43:25.198 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-01T15:43:25.190+0000 7f081f142700 1 -- 172.21.15.66:0/2546491077 wait complete. 2023-12-01T15:43:25.209 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-01T15:43:25.209 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-01T15:43:25.211 INFO:tasks.ceph.osd.0:Started 2023-12-01T15:43:25.212 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-01T15:43:25.212 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-01T15:43:25.214 INFO:tasks.ceph.osd.1:Started 2023-12-01T15:43:25.214 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-01T15:43:25.214 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-01T15:43:25.216 INFO:tasks.ceph.osd.2:Started 2023-12-01T15:43:25.216 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-01T15:43:25.216 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-01T15:43:25.218 INFO:tasks.ceph.osd.3:Started 2023-12-01T15:43:25.218 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:25.251 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:25.246+0000 7f2afb9922c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-01T15:43:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.313+0000 7fcfe32b6700 1 Processor -- start 2023-12-01T15:43:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.313+0000 7fcfe32b6700 1 -- start start 2023-12-01T15:43:25.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe32b6700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcfdc0a1a50 0x7fcfdc13c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe32b6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfdc0a3cf0 con 0x7fcfdc1379f0 2023-12-01T15:43:25.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe32b6700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfdc0a3f20 con 0x7fcfdc136f00 2023-12-01T15:43:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe32b6700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfdc0a34b0 con 0x7fcfdc0a1a50 2023-12-01T15:43:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe1853700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcfdc1379f0 0x7fcfdc13e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:50074/0 (socket says 172.21.15.63:50074) 2023-12-01T15:43:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe1853700 1 -- 172.21.15.63:0/280242109 learned_addr learned my addr 172.21.15.63:0/280242109 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe0851700 1 --2- 172.21.15.63:0/280242109 >> v2:172.21.15.66:3300/0 conn(0x7fcfdc0a1a50 0x7fcfdc13c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfd3fff700 1 -- 172.21.15.63:0/280242109 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463834317 0 0) 0x7fcfdc0a3cf0 con 0x7fcfdc1379f0 2023-12-01T15:43:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfd3fff700 1 -- 172.21.15.63:0/280242109 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc80034f0 con 0x7fcfdc1379f0 2023-12-01T15:43:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfd3fff700 1 -- 172.21.15.63:0/280242109 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671066146 0 0) 0x7fcfdc0a3f20 con 0x7fcfdc136f00 2023-12-01T15:43:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfd3fff700 1 -- 172.21.15.63:0/280242109 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfdc0a3cf0 con 0x7fcfdc136f00 2023-12-01T15:43:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe0851700 1 -- 172.21.15.63:0/280242109 >> v1:172.21.15.66:6789/0 conn(0x7fcfdc136f00 legacy=0x7fcfdc1372e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe0851700 1 -- 172.21.15.63:0/280242109 >> v1:172.21.15.63:6789/0 conn(0x7fcfdc1379f0 legacy=0x7fcfdc13e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe0851700 1 -- 172.21.15.63:0/280242109 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0a4120 con 0x7fcfdc0a1a50 2023-12-01T15:43:25.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe0851700 1 --2- 172.21.15.63:0/280242109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc0a1a50 0x7fcfdc13c1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009260 tx=0x7fcfd8009570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3ae85f0bf00d6c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:25.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfd3fff700 1 -- 172.21.15.63:0/280242109 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8011830 con 0x7fcfdc0a1a50 2023-12-01T15:43:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfd3fff700 1 -- 172.21.15.63:0/280242109 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd8011990 con 0x7fcfdc0a1a50 2023-12-01T15:43:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfd3fff700 1 -- 172.21.15.63:0/280242109 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8011d00 con 0x7fcfdc0a1a50 2023-12-01T15:43:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe32b6700 1 -- 172.21.15.63:0/280242109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc0a1a50 msgr2=0x7fcfdc13c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe32b6700 1 --2- 172.21.15.63:0/280242109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc0a1a50 0x7fcfdc13c1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009260 tx=0x7fcfd8009570 comp rx=0 tx=0).stop 2023-12-01T15:43:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe32b6700 1 -- 172.21.15.63:0/280242109 shutdown_connections 2023-12-01T15:43:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe32b6700 1 --2- 172.21.15.63:0/280242109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc0a1a50 0x7fcfdc13c1b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe32b6700 1 -- 172.21.15.63:0/280242109 >> 172.21.15.63:0/280242109 conn(0x7fcfdc073490 msgr2=0x7fcfdc0a8660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe32b6700 1 -- 172.21.15.63:0/280242109 shutdown_connections 2023-12-01T15:43:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.317+0000 7fcfe32b6700 1 -- 172.21.15.63:0/280242109 wait complete. 2023-12-01T15:43:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe32b6700 1 Processor -- start 2023-12-01T15:43:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe32b6700 1 -- start start 2023-12-01T15:43:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe32b6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfdc0a1a50 0x7fcfdc06d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe32b6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfdc136f00 0x7fcfdc06de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe32b6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc1379f0 0x7fcfdc06e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe32b6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc070db0 con 0x7fcfdc136f00 2023-12-01T15:43:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe32b6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc070970 con 0x7fcfdc1379f0 2023-12-01T15:43:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe32b6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc071820 con 0x7fcfdc0a1a50 2023-12-01T15:43:25.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe0851700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfdc136f00 0x7fcfdc06de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe0851700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfdc136f00 0x7fcfdc06de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50436/0 (socket says 172.21.15.63:50436) 2023-12-01T15:43:25.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe0851700 1 -- 172.21.15.63:0/1138013201 learned_addr learned my addr 172.21.15.63:0/1138013201 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:25.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe1853700 1 --2- 172.21.15.63:0/1138013201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc1379f0 0x7fcfdc06e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe1052700 1 --2- 172.21.15.63:0/1138013201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfdc0a1a50 0x7fcfdc06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe0851700 1 -- 172.21.15.63:0/1138013201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfdc0a1a50 msgr2=0x7fcfdc06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe0851700 1 --2- 172.21.15.63:0/1138013201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfdc0a1a50 0x7fcfdc06d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe0851700 1 -- 172.21.15.63:0/1138013201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc1379f0 msgr2=0x7fcfdc06e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe0851700 1 --2- 172.21.15.63:0/1138013201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc1379f0 0x7fcfdc06e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe0851700 1 -- 172.21.15.63:0/1138013201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd8009d40 con 0x7fcfdc136f00 2023-12-01T15:43:25.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe1052700 1 --2- 172.21.15.63:0/1138013201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfdc0a1a50 0x7fcfdc06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:25.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe0851700 1 --2- 172.21.15.63:0/1138013201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfdc136f00 0x7fcfdc06de90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80090b0 tx=0x7fcfd8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:25.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfd1ffb700 1 -- 172.21.15.63:0/1138013201 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80042c0 con 0x7fcfdc136f00 2023-12-01T15:43:25.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfd1ffb700 1 -- 172.21.15.63:0/1138013201 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd801f070 con 0x7fcfdc136f00 2023-12-01T15:43:25.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe32b6700 1 -- 172.21.15.63:0/1138013201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc09f7b0 con 0x7fcfdc136f00 2023-12-01T15:43:25.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfd1ffb700 1 -- 172.21.15.63:0/1138013201 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80036c0 con 0x7fcfdc136f00 2023-12-01T15:43:25.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfe32b6700 1 -- 172.21.15.63:0/1138013201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfdc11ed10 con 0x7fcfdc136f00 2023-12-01T15:43:25.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfd1ffb700 1 -- 172.21.15.63:0/1138013201 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcfd8021030 con 0x7fcfdc136f00 2023-12-01T15:43:25.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.321+0000 7fcfd1ffb700 1 -- 172.21.15.63:0/1138013201 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fcfd801a450 con 0x7fcfdc136f00 2023-12-01T15:43:25.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.325+0000 7fcfe32b6700 1 -- 172.21.15.63:0/1138013201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfdc065fb0 con 0x7fcfdc136f00 2023-12-01T15:43:25.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.325+0000 7fcfd1ffb700 1 -- 172.21.15.63:0/1138013201 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fcfd8044b10 con 0x7fcfdc136f00 2023-12-01T15:43:25.334 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:25.329+0000 7f9b8504f2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-01T15:43:25.391 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:25.385+0000 7f9b8504f2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-01T15:43:25.391 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:25.382+0000 7f2afb9922c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-01T15:43:25.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.397+0000 7fcfe32b6700 1 -- 172.21.15.63:0/1138013201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfdc061d90 con 0x7fcfdc136f00 2023-12-01T15:43:25.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.397+0000 7fcfd1ffb700 1 -- 172.21.15.63:0/1138013201 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7fcfd8033070 con 0x7fcfdc136f00 2023-12-01T15:43:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:25.404 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":6,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:25.188448+0000","last_up_change":"0.000000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:25.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.397+0000 7fcfe32b6700 1 -- 172.21.15.63:0/1138013201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfdc136f00 msgr2=0x7fcfdc06de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.397+0000 7fcfe32b6700 1 --2- 172.21.15.63:0/1138013201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfdc136f00 0x7fcfdc06de90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80090b0 tx=0x7fcfd8004770 comp rx=0 tx=0).stop 2023-12-01T15:43:25.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.397+0000 7fcfe32b6700 1 -- 172.21.15.63:0/1138013201 shutdown_connections 2023-12-01T15:43:25.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.397+0000 7fcfe32b6700 1 --2- 172.21.15.63:0/1138013201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc1379f0 0x7fcfdc06e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.397+0000 7fcfe32b6700 1 --2- 172.21.15.63:0/1138013201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfdc136f00 0x7fcfdc06de90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.397+0000 7fcfe32b6700 1 --2- 172.21.15.63:0/1138013201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfdc0a1a50 0x7fcfdc06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.397+0000 7fcfe32b6700 1 -- 172.21.15.63:0/1138013201 >> 172.21.15.63:0/1138013201 conn(0x7fcfdc073490 msgr2=0x7fcfdc1bec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:25.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.397+0000 7fcfe32b6700 1 -- 172.21.15.63:0/1138013201 shutdown_connections 2023-12-01T15:43:25.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:25.397+0000 7fcfe32b6700 1 -- 172.21.15.63:0/1138013201 wait complete. 2023-12-01T15:43:25.417 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-01T15:43:25.417 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-01T15:43:25.585 INFO:tasks.ceph.osd.3.smithi066.stderr:2023-12-01T15:43:25.578+0000 7ffa9da9b700 -1 Falling back to public interface 2023-12-01T15:43:25.591 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:25.585+0000 7f9b8504f2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-01T15:43:25.607 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-01T15:43:25.601+0000 7ff630f1e700 -1 Falling back to public interface 2023-12-01T15:43:25.661 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:25.653+0000 7f9b8504f2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-01T15:43:25.733 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:25.725+0000 7f9b8504f2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-01T15:43:25.757 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:25.750+0000 7f2afb9922c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-01T15:43:25.820 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:25.840 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-01T15:43:25.833+0000 7f1cb6aed700 -1 Falling back to public interface 2023-12-01T15:43:25.840 INFO:tasks.ceph.osd.2.smithi066.stderr:2023-12-01T15:43:25.834+0000 7efd50f18700 -1 Falling back to public interface 2023-12-01T15:43:25.918 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 Processor -- start 2023-12-01T15:43:25.918 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 -- start start 2023-12-01T15:43:25.920 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc544137690 0x7fc544137a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.920 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc54406bac0 0x7fc54406bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.920 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54409be20 con 0x7fc54406c440 2023-12-01T15:43:25.920 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc544137fb0 con 0x7fc544137690 2023-12-01T15:43:25.920 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54409d2b0 con 0x7fc54406bac0 2023-12-01T15:43:25.920 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc542ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc544137690 0x7fc544137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.920 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc5437fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc54406c440 0x7fc544141860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:50076/0 (socket says 172.21.15.63:50076) 2023-12-01T15:43:25.920 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc5427fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc54406bac0 0x7fc54406bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.920 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc542ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc544137690 0x7fc544137a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:54676/0 (socket says 172.21.15.63:54676) 2023-12-01T15:43:25.921 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc5437fe700 1 -- 172.21.15.63:0/1621793141 learned_addr learned my addr 172.21.15.63:0/1621793141 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:25.921 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc542ffd700 1 -- 172.21.15.63:0/1621793141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc54406bac0 msgr2=0x7fc54406bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:25.921 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc542ffd700 1 --2- 172.21.15.63:0/1621793141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc54406bac0 0x7fc54406bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.921 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc541ffb700 1 -- 172.21.15.63:0/1621793141 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645451581 0 0) 0x7fc54409be20 con 0x7fc54406c440 2023-12-01T15:43:25.921 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc542ffd700 1 -- 172.21.15.63:0/1621793141 >> v1:172.21.15.63:6789/0 conn(0x7fc54406c440 legacy=0x7fc544141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.921 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc542ffd700 1 -- 172.21.15.63:0/1621793141 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54409c080 con 0x7fc544137690 2023-12-01T15:43:25.921 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc542ffd700 1 --2- 172.21.15.63:0/1621793141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc544137690 0x7fc544137a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc5441380f0 tx=0x7fc53400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4d6dff61aba5562 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:25.921 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc541ffb700 1 -- 172.21.15.63:0/1621793141 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534016070 con 0x7fc544137690 2023-12-01T15:43:25.921 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc541ffb700 1 -- 172.21.15.63:0/1621793141 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53400bb20 con 0x7fc544137690 2023-12-01T15:43:25.921 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc541ffb700 1 -- 172.21.15.63:0/1621793141 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53400e070 con 0x7fc544137690 2023-12-01T15:43:25.924 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 -- 172.21.15.63:0/1621793141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc544137690 msgr2=0x7fc544137a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.924 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 --2- 172.21.15.63:0/1621793141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc544137690 0x7fc544137a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc5441380f0 tx=0x7fc53400b330 comp rx=0 tx=0).stop 2023-12-01T15:43:25.924 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 -- 172.21.15.63:0/1621793141 shutdown_connections 2023-12-01T15:43:25.924 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 --2- 172.21.15.63:0/1621793141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc54406bac0 0x7fc54406bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.924 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 --2- 172.21.15.63:0/1621793141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc544137690 0x7fc544137a70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 -- 172.21.15.63:0/1621793141 >> 172.21.15.63:0/1621793141 conn(0x7fc5440738e0 msgr2=0x7fc5440ac910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 -- 172.21.15.63:0/1621793141 shutdown_connections 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 -- 172.21.15.63:0/1621793141 wait complete. 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 Processor -- start 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.913+0000 7fc543fff700 1 -- start start 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc543fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc54406bac0 0x7fc5441cef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc543fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc54406c440 0x7fc5441cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc543fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc544137690 0x7fc5441cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc543fff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440a91d0 con 0x7fc544137690 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc543fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440a48d0 con 0x7fc54406c440 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc543fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440a3030 con 0x7fc54406bac0 2023-12-01T15:43:25.925 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc5437fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc544137690 0x7fc5441cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc5427fc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc54406c440 0x7fc5441cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc5427fc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc54406c440 0x7fc5441cf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:54688/0 (socket says 172.21.15.63:54688) 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc5427fc700 1 -- 172.21.15.63:0/655772832 learned_addr learned my addr 172.21.15.63:0/655772832 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc542ffd700 1 --2- 172.21.15.63:0/655772832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc54406bac0 0x7fc5441cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc542ffd700 1 -- 172.21.15.63:0/655772832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc54406c440 msgr2=0x7fc5441cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc542ffd700 1 --2- 172.21.15.63:0/655772832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc54406c440 0x7fc5441cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc542ffd700 1 -- 172.21.15.63:0/655772832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc544137690 msgr2=0x7fc5441cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc542ffd700 1 --2- 172.21.15.63:0/655772832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc544137690 0x7fc5441cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc542ffd700 1 -- 172.21.15.63:0/655772832 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc534009a70 con 0x7fc54406bac0 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc5427fc700 1 --2- 172.21.15.63:0/655772832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc54406c440 0x7fc5441cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc542ffd700 1 --2- 172.21.15.63:0/655772832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc54406bac0 0x7fc5441cef80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc54409b300 tx=0x7fc534004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:25.926 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc53b7fe700 1 -- 172.21.15.63:0/655772832 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534016040 con 0x7fc54406bac0 2023-12-01T15:43:25.927 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc53b7fe700 1 -- 172.21.15.63:0/655772832 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5340070e0 con 0x7fc54406bac0 2023-12-01T15:43:25.927 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc543fff700 1 -- 172.21.15.63:0/655772832 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5440a3f20 con 0x7fc54406bac0 2023-12-01T15:43:25.927 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc53b7fe700 1 -- 172.21.15.63:0/655772832 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53401b440 con 0x7fc54406bac0 2023-12-01T15:43:25.927 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc543fff700 1 -- 172.21.15.63:0/655772832 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5440a31e0 con 0x7fc54406bac0 2023-12-01T15:43:25.927 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc53b7fe700 1 -- 172.21.15.63:0/655772832 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc53401b8a0 con 0x7fc54406bac0 2023-12-01T15:43:25.927 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc53b7fe700 1 -- 172.21.15.63:0/655772832 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc534012430 con 0x7fc54406bac0 2023-12-01T15:43:25.927 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.917+0000 7fc543fff700 1 -- 172.21.15.63:0/655772832 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc544066040 con 0x7fc54406bac0 2023-12-01T15:43:25.930 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.925+0000 7fc53b7fe700 1 -- 172.21.15.63:0/655772832 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fc534044b10 con 0x7fc54406bac0 2023-12-01T15:43:25.932 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:25.926+0000 7f2afb9922c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-01T15:43:25.998 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.993+0000 7fc543fff700 1 -- 172.21.15.63:0/655772832 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc54406cda0 con 0x7fc54406bac0 2023-12-01T15:43:26.000 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.993+0000 7fc53b7fe700 1 -- 172.21.15.63:0/655772832 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7fc534033030 con 0x7fc54406bac0 2023-12-01T15:43:26.000 INFO:teuthology.misc.health.smithi063.stdout: 2023-12-01T15:43:26.000 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":6,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:25.188448+0000","last_up_change":"0.000000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:26.001 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.993+0000 7fc543fff700 1 -- 172.21.15.63:0/655772832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc54406bac0 msgr2=0x7fc5441cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:26.001 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.993+0000 7fc543fff700 1 --2- 172.21.15.63:0/655772832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc54406bac0 0x7fc5441cef80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc54409b300 tx=0x7fc534004af0 comp rx=0 tx=0).stop 2023-12-01T15:43:26.001 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.993+0000 7fc543fff700 1 -- 172.21.15.63:0/655772832 shutdown_connections 2023-12-01T15:43:26.001 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.993+0000 7fc543fff700 1 --2- 172.21.15.63:0/655772832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc544137690 0x7fc5441cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:26.001 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.993+0000 7fc543fff700 1 --2- 172.21.15.63:0/655772832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc54406c440 0x7fc5441cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:26.002 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.993+0000 7fc543fff700 1 --2- 172.21.15.63:0/655772832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc54406bac0 0x7fc5441cef80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:26.002 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.993+0000 7fc543fff700 1 -- 172.21.15.63:0/655772832 >> 172.21.15.63:0/655772832 conn(0x7fc5440738e0 msgr2=0x7fc5440aa880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:26.002 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.993+0000 7fc543fff700 1 -- 172.21.15.63:0/655772832 shutdown_connections 2023-12-01T15:43:26.002 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:25.993+0000 7fc543fff700 1 -- 172.21.15.63:0/655772832 wait complete. 2023-12-01T15:43:26.002 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:25.994+0000 7f2afb9922c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-01T15:43:26.013 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-12-01T15:43:26.059 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:26.050+0000 7f2afb9922c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-01T15:43:26.168 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:26.161+0000 7f9b8504f2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-01T15:43:26.298 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:26.293+0000 7f9b8504f2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-01T15:43:26.668 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:26.661+0000 7f9b8504f2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-01T15:43:26.845 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:26.837+0000 7f9b8504f2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-01T15:43:26.874 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:26.866+0000 7f2afb9922c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-01T15:43:26.914 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:26.909+0000 7f9b8504f2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-01T15:43:26.944 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:26.938+0000 7f2afb9922c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-01T15:43:26.971 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:26.965+0000 7f9b8504f2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-01T15:43:27.094 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:27.086+0000 7f2afb9922c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-01T15:43:27.156 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:27.150+0000 7f2afb9922c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-01T15:43:27.232 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:27.226+0000 7f2afb9922c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-01T15:43:27.412 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:27.406+0000 7f2afb9922c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-01T15:43:27.639 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:27.634+0000 7f2afb9922c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-01T15:43:27.811 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:27.805+0000 7f9b8504f2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-01T15:43:27.882 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:27.877+0000 7f9b8504f2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-01T15:43:28.061 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:28.053+0000 7f9b8504f2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-01T15:43:28.129 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:28.121+0000 7f9b8504f2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-01T15:43:28.205 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:28.197+0000 7f9b8504f2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-01T15:43:28.332 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:28.326+0000 7f2afb9922c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-01T15:43:28.390 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:28.385+0000 7f9b8504f2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-01T15:43:28.627 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:28.621+0000 7f9b8504f2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-01T15:43:29.375 INFO:tasks.ceph.mgr.x.smithi063.stderr:2023-12-01T15:43:29.369+0000 7f9b8504f2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-01T15:43:29.377 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:29.370+0000 7f2ae2a11700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-01T15:43:29.378 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:43:29.370+0000 7f2ae2a11700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-01T15:43:29.411 INFO:tasks.ceph.osd.3.smithi066.stderr:2023-12-01T15:43:29.406+0000 7ffa9da9b700 -1 osd.3 0 log_to_monitors true 2023-12-01T15:43:29.432 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-01T15:43:29.425+0000 7ff630f1e700 -1 osd.1 0 log_to_monitors true 2023-12-01T15:43:29.693 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-01T15:43:29.685+0000 7f1cb6aed700 -1 osd.0 0 log_to_monitors true 2023-12-01T15:43:29.809 INFO:tasks.ceph.osd.2.smithi066.stderr:2023-12-01T15:43:29.802+0000 7efd50f18700 -1 osd.2 0 log_to_monitors true 2023-12-01T15:43:29.871 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:43:29.874 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:43:29.876 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:43:32.417 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:32.540 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.533+0000 7f091352d700 1 Processor -- start 2023-12-01T15:43:32.541 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.533+0000 7f091352d700 1 -- start start 2023-12-01T15:43:32.541 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.533+0000 7f091352d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f090c0a2d50 0x7f090c0a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:32.541 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.533+0000 7f091352d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f090c0a1800 0x7f090c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:32.542 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.533+0000 7f091352d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090c0a3da0 con 0x7f090c136c70 2023-12-01T15:43:32.542 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.533+0000 7f091352d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c0a3bb0 con 0x7f090c0a2d50 2023-12-01T15:43:32.542 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.533+0000 7f091352d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c09f430 con 0x7f090c0a1800 2023-12-01T15:43:32.542 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.533+0000 7f0912d2c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f090c136c70 0x7f090c1370c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:44412/0 (socket says 172.21.15.63:44412) 2023-12-01T15:43:32.542 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.533+0000 7f0912d2c700 1 -- 172.21.15.63:0/2528296112 learned_addr learned my addr 172.21.15.63:0/2528296112 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:32.542 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.533+0000 7f091252b700 1 --2- 172.21.15.63:0/2528296112 >> v2:172.21.15.66:3300/0 conn(0x7f090c0a2d50 0x7f090c0a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:32.543 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.533+0000 7f091252b700 1 -- 172.21.15.63:0/2528296112 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f090c0a1800 msgr2=0x7f090c0a3670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-01T15:43:32.543 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091252b700 1 --2- 172.21.15.63:0/2528296112 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f090c0a1800 0x7f090c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:32.543 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091252b700 1 -- 172.21.15.63:0/2528296112 >> v1:172.21.15.63:6789/0 conn(0x7f090c136c70 legacy=0x7f090c1370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:32.543 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091252b700 1 -- 172.21.15.63:0/2528296112 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c0a0680 con 0x7f090c0a2d50 2023-12-01T15:43:32.543 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091252b700 1 --2- 172.21.15.63:0/2528296112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f090c0a2d50 0x7f090c0a3130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009850 tx=0x7f08fc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c05cab5086770c93 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:32.544 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f0911529700 1 -- 172.21.15.63:0/2528296112 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc004230 con 0x7f090c0a2d50 2023-12-01T15:43:32.544 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f0911529700 1 -- 172.21.15.63:0/2528296112 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc004390 con 0x7f090c0a2d50 2023-12-01T15:43:32.544 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f0911529700 1 -- 172.21.15.63:0/2528296112 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00f740 con 0x7f090c0a2d50 2023-12-01T15:43:32.545 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091352d700 1 -- 172.21.15.63:0/2528296112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f090c0a2d50 msgr2=0x7f090c0a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:32.545 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091352d700 1 --2- 172.21.15.63:0/2528296112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f090c0a2d50 0x7f090c0a3130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009850 tx=0x7f08fc009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:32.545 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091352d700 1 -- 172.21.15.63:0/2528296112 shutdown_connections 2023-12-01T15:43:32.545 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091352d700 1 --2- 172.21.15.63:0/2528296112 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f090c0a1800 0x7f090c0a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:32.545 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091352d700 1 --2- 172.21.15.63:0/2528296112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f090c0a2d50 0x7f090c0a3130 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:32.545 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091352d700 1 -- 172.21.15.63:0/2528296112 >> 172.21.15.63:0/2528296112 conn(0x7f090c0a8bc0 msgr2=0x7f090c0a4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:32.545 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091352d700 1 -- 172.21.15.63:0/2528296112 shutdown_connections 2023-12-01T15:43:32.546 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.537+0000 7f091352d700 1 -- 172.21.15.63:0/2528296112 wait complete. 2023-12-01T15:43:32.546 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f091352d700 1 Processor -- start 2023-12-01T15:43:32.546 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f091352d700 1 -- start start 2023-12-01T15:43:32.548 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f091352d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f090c0a1800 0x7f090c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:32.548 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f091352d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f090c0a2d50 0x7f090c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:32.548 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f091352d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f090c136c70 0x7f090c06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:32.548 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f091352d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c070690 con 0x7f090c0a2d50 2023-12-01T15:43:32.548 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f091352d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c070460 con 0x7f090c136c70 2023-12-01T15:43:32.548 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f091352d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0a20c0 con 0x7f090c0a1800 2023-12-01T15:43:32.548 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0911d2a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f090c0a2d50 0x7f090c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:32.548 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0912d2c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f090c136c70 0x7f090c06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:32.548 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0911d2a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f090c0a2d50 0x7f090c06d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34574/0 (socket says 172.21.15.63:34574) 2023-12-01T15:43:32.549 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0911d2a700 1 -- 172.21.15.63:0/2244966206 learned_addr learned my addr 172.21.15.63:0/2244966206 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:32.549 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f091252b700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f090c0a1800 0x7f090c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:32.549 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0911d2a700 1 -- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f090c0a1800 msgr2=0x7f090c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:32.549 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0911d2a700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f090c0a1800 0x7f090c06d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:32.549 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0911d2a700 1 -- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f090c136c70 msgr2=0x7f090c06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:32.549 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0911d2a700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f090c136c70 0x7f090c06dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:32.549 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0911d2a700 1 -- 172.21.15.63:0/2244966206 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0094b0 con 0x7f090c0a2d50 2023-12-01T15:43:32.549 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0911d2a700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f090c0a2d50 0x7f090c06d7f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f090400ba80 tx=0x7f090400bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:32.550 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0902ffd700 1 -- 172.21.15.63:0/2244966206 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400c930 con 0x7f090c0a2d50 2023-12-01T15:43:32.550 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0902ffd700 1 -- 172.21.15.63:0/2244966206 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090400cab0 con 0x7f090c0a2d50 2023-12-01T15:43:32.550 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f091352d700 1 -- 172.21.15.63:0/2244966206 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c06ef30 con 0x7f090c0a2d50 2023-12-01T15:43:32.550 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f0902ffd700 1 -- 172.21.15.63:0/2244966206 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400ce60 con 0x7f090c0a2d50 2023-12-01T15:43:32.550 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.541+0000 7f091352d700 1 -- 172.21.15.63:0/2244966206 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c06f2f0 con 0x7f090c0a2d50 2023-12-01T15:43:32.552 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.545+0000 7f0902ffd700 1 -- 172.21.15.63:0/2244966206 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 85172+0+0 (secure 0 0 0) 0x7f090401d3b0 con 0x7f090c0a2d50 2023-12-01T15:43:32.552 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.545+0000 7f091352d700 1 -- 172.21.15.63:0/2244966206 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f4005100 con 0x7f090c0a2d50 2023-12-01T15:43:32.552 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.545+0000 7f0902ffd700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065b10 0x7f08f0067fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:32.553 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.545+0000 7f0902ffd700 1 -- 172.21.15.63:0/2244966206 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1623+0+0 (secure 0 0 0) 0x7f0904081ad0 con 0x7f090c0a2d50 2023-12-01T15:43:32.553 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.545+0000 7f091252b700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065b10 0x7f08f0067fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:32.553 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.545+0000 7f091252b700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065b10 0x7f08f0067fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009850 tx=0x7f08fc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:32.559 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.553+0000 7f0902ffd700 1 -- 172.21.15.63:0/2244966206 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0904019080 con 0x7f090c0a2d50 2023-12-01T15:43:32.696 INFO:tasks.ceph.osd.2.smithi066.stderr:2023-12-01T15:43:32.690+0000 7efd4c534700 -1 osd.2 0 waiting for initial osdmap 2023-12-01T15:43:32.700 INFO:tasks.ceph.osd.2.smithi066.stderr:2023-12-01T15:43:32.694+0000 7efd44809700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T15:43:32.701 INFO:tasks.ceph.osd.3.smithi066.stderr:2023-12-01T15:43:32.694+0000 7ffa990b7700 -1 osd.3 0 waiting for initial osdmap 2023-12-01T15:43:32.705 INFO:tasks.ceph.osd.3.smithi066.stderr:2023-12-01T15:43:32.698+0000 7ffa9138c700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T15:43:32.747 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-01T15:43:32.741+0000 7ff62c53a700 -1 osd.1 0 waiting for initial osdmap 2023-12-01T15:43:32.752 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-01T15:43:32.745+0000 7ff62480f700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T15:43:32.793 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-01T15:43:32.785+0000 7f1cb2109700 -1 osd.0 0 waiting for initial osdmap 2023-12-01T15:43:32.793 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.785+0000 7f091352d700 1 -- 172.21.15.63:0/2244966206 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08f40053b0 con 0x7f090c0a2d50 2023-12-01T15:43:32.793 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.789+0000 7f0902ffd700 1 -- 172.21.15.63:0/2244966206 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4152 (secure 0 0 0) 0x7f09040505d0 con 0x7f090c0a2d50 2023-12-01T15:43:32.794 INFO:teuthology.misc.health.smithi063.stdout: 2023-12-01T15:43:32.794 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":8,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:31.382084+0000","last_up_change":"0.000000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:32.797 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-01T15:43:32.789+0000 7f1caa3de700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T15:43:32.799 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 -- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065b10 msgr2=0x7f08f0067fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:32.799 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065b10 0x7f08f0067fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009850 tx=0x7f08fc008030 comp rx=0 tx=0).stop 2023-12-01T15:43:32.799 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 -- 172.21.15.63:0/2244966206 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f090c0a2d50 msgr2=0x7f090c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:32.799 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f090c0a2d50 0x7f090c06d7f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f090400ba80 tx=0x7f090400bd90 comp rx=0 tx=0).stop 2023-12-01T15:43:32.799 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 -- 172.21.15.63:0/2244966206 shutdown_connections 2023-12-01T15:43:32.799 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065b10 0x7f08f0067fd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:32.799 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f090c136c70 0x7f090c06dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:32.799 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f090c0a2d50 0x7f090c06d7f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:32.800 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 --2- 172.21.15.63:0/2244966206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f090c0a1800 0x7f090c06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:32.800 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 -- 172.21.15.63:0/2244966206 >> 172.21.15.63:0/2244966206 conn(0x7f090c0a8bc0 msgr2=0x7f090c134e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:32.800 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 -- 172.21.15.63:0/2244966206 shutdown_connections 2023-12-01T15:43:32.800 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:32.793+0000 7f091352d700 1 -- 172.21.15.63:0/2244966206 wait complete. 2023-12-01T15:43:32.812 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-12-01T15:43:39.217 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:39.324 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61f4fc2700 1 Processor -- start 2023-12-01T15:43:39.324 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61f4fc2700 1 -- start start 2023-12-01T15:43:39.325 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61f4fc2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f61f0141870 0x7f61f0143c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.325 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61f4fc2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f009be20 con 0x7f61f0137690 2023-12-01T15:43:39.325 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61f4fc2700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f006c8e0 con 0x7f61f0137a70 2023-12-01T15:43:39.325 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61f4fc2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f009d2b0 con 0x7f61f0141870 2023-12-01T15:43:39.325 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61ef7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f61f0137690 0x7f61f006bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33614/0 (socket says 172.21.15.63:33614) 2023-12-01T15:43:39.325 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61ef7fe700 1 -- 172.21.15.63:0/3783497807 learned_addr learned my addr 172.21.15.63:0/3783497807 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:39.326 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61effff700 1 --2- 172.21.15.63:0/3783497807 >> v2:172.21.15.66:3300/0 conn(0x7f61f0141870 0x7f61f0143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.326 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61eeffd700 1 -- 172.21.15.63:0/3783497807 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045871186 0 0) 0x7f61f009be20 con 0x7f61f0137690 2023-12-01T15:43:39.326 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61eeffd700 1 -- 172.21.15.63:0/3783497807 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61dc0035d0 con 0x7f61f0137690 2023-12-01T15:43:39.327 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61eeffd700 1 -- 172.21.15.63:0/3783497807 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662791780 0 0) 0x7f61f006c8e0 con 0x7f61f0137a70 2023-12-01T15:43:39.327 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.316+0000 7f61eeffd700 1 -- 172.21.15.63:0/3783497807 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f009be20 con 0x7f61f0137a70 2023-12-01T15:43:39.327 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61eeffd700 1 -- 172.21.15.63:0/3783497807 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3259603913 0 0) 0x7f61dc0035d0 con 0x7f61f0137690 2023-12-01T15:43:39.327 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61effff700 1 -- 172.21.15.63:0/3783497807 >> v1:172.21.15.66:6789/0 conn(0x7f61f0137a70 legacy=0x7f61f006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:39.327 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61effff700 1 -- 172.21.15.63:0/3783497807 >> v1:172.21.15.63:6789/0 conn(0x7f61f0137690 legacy=0x7f61f006bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:39.327 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61effff700 1 -- 172.21.15.63:0/3783497807 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f009c080 con 0x7f61f0141870 2023-12-01T15:43:39.328 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61effff700 1 --2- 172.21.15.63:0/3783497807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61f0141870 0x7f61f0143c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009d90 tx=0x7f61e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90ac4542f93fae4f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:39.328 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61eeffd700 1 -- 172.21.15.63:0/3783497807 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800e070 con 0x7f61f0141870 2023-12-01T15:43:39.328 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61eeffd700 1 -- 172.21.15.63:0/3783497807 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e8003a40 con 0x7f61f0141870 2023-12-01T15:43:39.328 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61eeffd700 1 -- 172.21.15.63:0/3783497807 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0001670 con 0x7f61f0141870 2023-12-01T15:43:39.329 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61f4fc2700 1 -- 172.21.15.63:0/3783497807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61f0141870 msgr2=0x7f61f0143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:39.329 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61f4fc2700 1 --2- 172.21.15.63:0/3783497807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61f0141870 0x7f61f0143c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009d90 tx=0x7f61e800b330 comp rx=0 tx=0).stop 2023-12-01T15:43:39.329 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61f4fc2700 1 -- 172.21.15.63:0/3783497807 shutdown_connections 2023-12-01T15:43:39.329 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61f4fc2700 1 --2- 172.21.15.63:0/3783497807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61f0141870 0x7f61f0143c60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.329 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61f4fc2700 1 -- 172.21.15.63:0/3783497807 >> 172.21.15.63:0/3783497807 conn(0x7f61f00738e0 msgr2=0x7f61f00ac910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:39.329 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61f4fc2700 1 -- 172.21.15.63:0/3783497807 shutdown_connections 2023-12-01T15:43:39.329 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.320+0000 7f61f4fc2700 1 -- 172.21.15.63:0/3783497807 wait complete. 2023-12-01T15:43:39.331 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61f4fc2700 1 Processor -- start 2023-12-01T15:43:39.331 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61f4fc2700 1 -- start start 2023-12-01T15:43:39.332 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61f4fc2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61f0137690 0x7f61f01cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.332 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61f4fc2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61f0137a70 0x7f61f01cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.332 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61f4fc2700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61f0141870 0x7f61f01cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.332 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61f4fc2700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f013f6a0 con 0x7f61f0141870 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61f4fc2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f013e430 con 0x7f61f0137690 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61f4fc2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f013edd0 con 0x7f61f0137a70 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61effff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61f0141870 0x7f61f01cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61effff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61f0141870 0x7f61f01cfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53190/0 (socket says 172.21.15.63:53190) 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61effff700 1 -- 172.21.15.63:0/2514226821 learned_addr learned my addr 172.21.15.63:0/2514226821 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61e6ffd700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61f0137a70 0x7f61f01cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61ef7fe700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61f0137690 0x7f61f01cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61effff700 1 -- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61f0137a70 msgr2=0x7f61f01cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61effff700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61f0137a70 0x7f61f01cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61effff700 1 -- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61f0137690 msgr2=0x7f61f01cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61effff700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61f0137690 0x7f61f01cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61effff700 1 -- 172.21.15.63:0/2514226821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e8009a70 con 0x7f61f0141870 2023-12-01T15:43:39.334 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61effff700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61f0141870 0x7f61f01cfd20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f61e8004000 tx=0x7f61e8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:39.335 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61ecff9700 1 -- 172.21.15.63:0/2514226821 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e80045c0 con 0x7f61f0141870 2023-12-01T15:43:39.335 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61ecff9700 1 -- 172.21.15.63:0/2514226821 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e8004720 con 0x7f61f0141870 2023-12-01T15:43:39.335 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61ecff9700 1 -- 172.21.15.63:0/2514226821 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e801d470 con 0x7f61f0141870 2023-12-01T15:43:39.335 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61f4fc2700 1 -- 172.21.15.63:0/2514226821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f0140420 con 0x7f61f0141870 2023-12-01T15:43:39.335 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.324+0000 7f61f4fc2700 1 -- 172.21.15.63:0/2514226821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f01414e0 con 0x7f61f0141870 2023-12-01T15:43:39.335 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.328+0000 7f61f4fc2700 1 -- 172.21.15.63:0/2514226821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f0140290 con 0x7f61f0141870 2023-12-01T15:43:39.336 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.328+0000 7f61ecff9700 1 -- 172.21.15.63:0/2514226821 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f61e801d5d0 con 0x7f61f0141870 2023-12-01T15:43:39.336 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.328+0000 7f61ecff9700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f61d0065ad0 0x7f61d0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.328+0000 7f61ecff9700 1 -- 172.21.15.63:0/2514226821 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f61e8084340 con 0x7f61f0141870 2023-12-01T15:43:39.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.328+0000 7f61ef7fe700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f61d0065ad0 0x7f61d0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.338 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.332+0000 7f61ef7fe700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f61d0065ad0 0x7f61d0067f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000fd0 tx=0x7f61e0001490 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:39.346 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.340+0000 7f61ecff9700 1 -- 172.21.15.63:0/2514226821 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f61e80562d0 con 0x7f61f0141870 2023-12-01T15:43:39.515 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.508+0000 7f61f4fc2700 1 -- 172.21.15.63:0/2514226821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61f006cdb0 con 0x7f61f0141870 2023-12-01T15:43:39.516 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.508+0000 7f61ecff9700 1 -- 172.21.15.63:0/2514226821 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7677 (secure 0 0 0) 0x7f61f006cdb0 con 0x7f61f0141870 2023-12-01T15:43:39.516 INFO:teuthology.misc.health.smithi063.stdout: 2023-12-01T15:43:39.516 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":12,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:36.707776+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:39.518 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 -- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f61d0065ad0 msgr2=0x7f61d0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:39.519 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f61d0065ad0 0x7f61d0067f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000fd0 tx=0x7f61e0001490 comp rx=0 tx=0).stop 2023-12-01T15:43:39.519 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 -- 172.21.15.63:0/2514226821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61f0141870 msgr2=0x7f61f01cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:39.519 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61f0141870 0x7f61f01cfd20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f61e8004000 tx=0x7f61e8004af0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.519 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 -- 172.21.15.63:0/2514226821 shutdown_connections 2023-12-01T15:43:39.519 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f61d0065ad0 0x7f61d0067f90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.519 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61f0137a70 0x7f61f01cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.520 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61f0141870 0x7f61f01cfd20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.520 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 --2- 172.21.15.63:0/2514226821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61f0137690 0x7f61f01cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.520 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 -- 172.21.15.63:0/2514226821 >> 172.21.15.63:0/2514226821 conn(0x7f61f00738e0 msgr2=0x7f61f01367d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:39.520 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 -- 172.21.15.63:0/2514226821 shutdown_connections 2023-12-01T15:43:39.520 INFO:teuthology.misc.health.smithi063.stderr:2023-12-01T15:43:39.512+0000 7f61f4fc2700 1 -- 172.21.15.63:0/2514226821 wait complete. 2023-12-01T15:43:39.529 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-12-01T15:43:39.529 INFO:tasks.ceph:Creating RBD pool 2023-12-01T15:43:39.530 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd pool create rbd 8 2023-12-01T15:43:39.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8be01d700 1 Processor -- start 2023-12-01T15:43:39.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8be01d700 1 -- start start 2023-12-01T15:43:39.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8be01d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b813abc0 0x7ff8b813afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8be01d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff8b806ba50 0x7ff8b806be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8be01d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff8b806c3d0 0x7ff8b8141890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8be01d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b809b5a0 con 0x7ff8b806c3d0 2023-12-01T15:43:39.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8be01d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b813b4e0 con 0x7ff8b806ba50 2023-12-01T15:43:39.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8be01d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b809c5c0 con 0x7ff8b813abc0 2023-12-01T15:43:39.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8bd81c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff8b806c3d0 0x7ff8b8141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8bd81c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff8b806c3d0 0x7ff8b8141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53204/0 (socket says 172.21.15.63:53204) 2023-12-01T15:43:39.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8bd81c700 1 -- 172.21.15.63:0/3057416356 learned_addr learned my addr 172.21.15.63:0/3057416356 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:39.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8bc81a700 1 --2- 172.21.15.63:0/3057416356 >> v2:172.21.15.66:3300/0 conn(0x7ff8b806ba50 0x7ff8b806be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.636+0000 7ff8bd01b700 1 --2- 172.21.15.63:0/3057416356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b813abc0 0x7ff8b813afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8bd81c700 1 -- 172.21.15.63:0/3057416356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b813abc0 msgr2=0x7ff8b813afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:39.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8bd81c700 1 --2- 172.21.15.63:0/3057416356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b813abc0 0x7ff8b813afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8bd81c700 1 -- 172.21.15.63:0/3057416356 >> v2:172.21.15.66:3300/0 conn(0x7ff8b806ba50 msgr2=0x7ff8b806be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:39.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8bd81c700 1 --2- 172.21.15.63:0/3057416356 >> v2:172.21.15.66:3300/0 conn(0x7ff8b806ba50 0x7ff8b806be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8bd81c700 1 -- 172.21.15.63:0/3057416356 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b813a6e0 con 0x7ff8b806c3d0 2023-12-01T15:43:39.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8bc81a700 1 --2- 172.21.15.63:0/3057416356 >> v2:172.21.15.66:3300/0 conn(0x7ff8b806ba50 0x7ff8b806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:39.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8bd81c700 1 --2- 172.21.15.63:0/3057416356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b806c3d0 0x7ff8b8141890 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80ab570 tx=0x7ff8a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d589782b124e928 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:39.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8affff700 1 -- 172.21.15.63:0/3057416356 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800b8a0 con 0x7ff8b806c3d0 2023-12-01T15:43:39.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8affff700 1 -- 172.21.15.63:0/3057416356 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a800ba00 con 0x7ff8b806c3d0 2023-12-01T15:43:39.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8affff700 1 -- 172.21.15.63:0/3057416356 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800bd90 con 0x7ff8b806c3d0 2023-12-01T15:43:39.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8be01d700 1 -- 172.21.15.63:0/3057416356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b806c3d0 msgr2=0x7ff8b8141890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:39.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8be01d700 1 --2- 172.21.15.63:0/3057416356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b806c3d0 0x7ff8b8141890 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80ab570 tx=0x7ff8a8009bf0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8be01d700 1 -- 172.21.15.63:0/3057416356 shutdown_connections 2023-12-01T15:43:39.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8be01d700 1 --2- 172.21.15.63:0/3057416356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b806c3d0 0x7ff8b8141890 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8be01d700 1 --2- 172.21.15.63:0/3057416356 >> v2:172.21.15.66:3300/0 conn(0x7ff8b806ba50 0x7ff8b806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8be01d700 1 --2- 172.21.15.63:0/3057416356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b813abc0 0x7ff8b813afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8be01d700 1 -- 172.21.15.63:0/3057416356 >> 172.21.15.63:0/3057416356 conn(0x7ff8b80738c0 msgr2=0x7ff8b80aa840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:39.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8be01d700 1 -- 172.21.15.63:0/3057416356 shutdown_connections 2023-12-01T15:43:39.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8be01d700 1 -- 172.21.15.63:0/3057416356 wait complete. 2023-12-01T15:43:39.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.640+0000 7ff8be01d700 1 Processor -- start 2023-12-01T15:43:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8be01d700 1 -- start start 2023-12-01T15:43:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8be01d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b806ba50 0x7ff8b80a2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8be01d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8b806c3d0 0x7ff8b80a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8be01d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b813abc0 0x7ff8b80a3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8be01d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80a63a0 con 0x7ff8b806ba50 2023-12-01T15:43:39.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8be01d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b8072530 con 0x7ff8b806c3d0 2023-12-01T15:43:39.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8be01d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80a5100 con 0x7ff8b813abc0 2023-12-01T15:43:39.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8bd01b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b806ba50 0x7ff8b80a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8bd01b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b806ba50 0x7ff8b80a2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53214/0 (socket says 172.21.15.63:53214) 2023-12-01T15:43:39.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8bd01b700 1 -- 172.21.15.63:0/2161656135 learned_addr learned my addr 172.21.15.63:0/2161656135 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:39.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8bc81a700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8b806c3d0 0x7ff8b80a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8bd81c700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b813abc0 0x7ff8b80a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8bd01b700 1 -- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b813abc0 msgr2=0x7ff8b80a3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8bd01b700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b813abc0 0x7ff8b80a3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8bd01b700 1 -- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8b806c3d0 msgr2=0x7ff8b80a2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8bd01b700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8b806c3d0 0x7ff8b80a2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8bd01b700 1 -- 172.21.15.63:0/2161656135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8009570 con 0x7ff8b806ba50 2023-12-01T15:43:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8bd01b700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b806ba50 0x7ff8b80a2690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000e760 tx=0x7ff8b000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8adffb700 1 -- 172.21.15.63:0/2161656135 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000c070 con 0x7ff8b806ba50 2023-12-01T15:43:39.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8adffb700 1 -- 172.21.15.63:0/2161656135 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b0013610 con 0x7ff8b806ba50 2023-12-01T15:43:39.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8be01d700 1 -- 172.21.15.63:0/2161656135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b80a4570 con 0x7ff8b806ba50 2023-12-01T15:43:39.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8adffb700 1 -- 172.21.15.63:0/2161656135 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0013980 con 0x7ff8b806ba50 2023-12-01T15:43:39.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.644+0000 7ff8be01d700 1 -- 172.21.15.63:0/2161656135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b80a53c0 con 0x7ff8b806ba50 2023-12-01T15:43:39.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.648+0000 7ff8be01d700 1 -- 172.21.15.63:0/2161656135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b8065fb0 con 0x7ff8b806ba50 2023-12-01T15:43:39.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.648+0000 7ff8adffb700 1 -- 172.21.15.63:0/2161656135 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff8b0013ae0 con 0x7ff8b806ba50 2023-12-01T15:43:39.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.648+0000 7ff8adffb700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff8a4065ad0 0x7ff8a4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:39.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.648+0000 7ff8adffb700 1 -- 172.21.15.63:0/2161656135 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3129+0+0 (secure 0 0 0) 0x7ff8b0082160 con 0x7ff8b806ba50 2023-12-01T15:43:39.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.648+0000 7ff8bc81a700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff8a4065ad0 0x7ff8a4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:39.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.652+0000 7ff8bc81a700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff8a4065ad0 0x7ff8a4067f90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80a76b0 tx=0x7ff8b40098c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:39.662 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.656+0000 7ff8adffb700 1 -- 172.21.15.63:0/2161656135 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff8b0050520 con 0x7ff8b806ba50 2023-12-01T15:43:39.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:39.820+0000 7ff8be01d700 1 -- 172.21.15.63:0/2161656135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7ff8b8061d90 con 0x7ff8b806ba50 2023-12-01T15:43:40.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.016+0000 7ff8adffb700 1 -- 172.21.15.63:0/2161656135 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7ff8b0053b40 con 0x7ff8b806ba50 2023-12-01T15:43:40.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 -- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff8a4065ad0 msgr2=0x7ff8a4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:40.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff8a4065ad0 0x7ff8a4067f90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80a76b0 tx=0x7ff8b40098c0 comp rx=0 tx=0).stop 2023-12-01T15:43:40.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 -- 172.21.15.63:0/2161656135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b806ba50 msgr2=0x7ff8b80a2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:40.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b806ba50 0x7ff8b80a2690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000e760 tx=0x7ff8b000ea70 comp rx=0 tx=0).stop 2023-12-01T15:43:40.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 -- 172.21.15.63:0/2161656135 shutdown_connections 2023-12-01T15:43:40.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff8a4065ad0 0x7ff8a4067f90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:40.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b813abc0 0x7ff8b80a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:40.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8b806c3d0 0x7ff8b80a2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:40.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 --2- 172.21.15.63:0/2161656135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b806ba50 0x7ff8b80a2690 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:40.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 -- 172.21.15.63:0/2161656135 >> 172.21.15.63:0/2161656135 conn(0x7ff8b80738c0 msgr2=0x7ff8b81391f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:40.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 -- 172.21.15.63:0/2161656135 shutdown_connections 2023-12-01T15:43:40.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.020+0000 7ff8be01d700 1 -- 172.21.15.63:0/2161656135 wait complete. 2023-12-01T15:43:40.031 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'rbd' created 2023-12-01T15:43:40.045 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-01T15:43:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.156+0000 7fa94b59e700 1 Processor -- start 2023-12-01T15:43:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.156+0000 7fa94b59e700 1 -- start start 2023-12-01T15:43:40.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c137680 0x7fa94c137a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:40.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa94c13ac60 0x7fa94c142890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:40.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c0ab180 con 0x7fa94c0aa7a0 2023-12-01T15:43:40.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94c137fa0 con 0x7fa94c13ac60 2023-12-01T15:43:40.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c06c840 con 0x7fa94c137680 2023-12-01T15:43:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94ad9d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa94c13ac60 0x7fa94c142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94a59c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c137680 0x7fa94c137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:40.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa949d9b700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa94c0aa7a0 0x7fa94c13a550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:52976/0 (socket says 172.21.15.63:52976) 2023-12-01T15:43:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa949d9b700 1 -- 172.21.15.63:0/3616753905 learned_addr learned my addr 172.21.15.63:0/3616753905 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94ad9d700 1 -- 172.21.15.63:0/3616753905 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c137680 msgr2=0x7fa94c137a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94ad9d700 1 --2- 172.21.15.63:0/3616753905 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c137680 0x7fa94c137a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94ad9d700 1 -- 172.21.15.63:0/3616753905 >> v1:172.21.15.66:6789/0 conn(0x7fa94c0aa7a0 legacy=0x7fa94c13a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94959a700 1 -- 172.21.15.63:0/3616753905 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681144484 0 0) 0x7fa94c0ab180 con 0x7fa94c0aa7a0 2023-12-01T15:43:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94ad9d700 1 -- 172.21.15.63:0/3616753905 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c0ab950 con 0x7fa94c13ac60 2023-12-01T15:43:40.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94ad9d700 1 --2- 172.21.15.63:0/3616753905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c13ac60 0x7fa94c142890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009850 tx=0x7fa93c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53f946afd53bdb9c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:40.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94959a700 1 -- 172.21.15.63:0/3616753905 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c011830 con 0x7fa94c13ac60 2023-12-01T15:43:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94959a700 1 -- 172.21.15.63:0/3616753905 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c011990 con 0x7fa94c13ac60 2023-12-01T15:43:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94959a700 1 -- 172.21.15.63:0/3616753905 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c011d40 con 0x7fa94c13ac60 2023-12-01T15:43:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 -- 172.21.15.63:0/3616753905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c13ac60 msgr2=0x7fa94c142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 --2- 172.21.15.63:0/3616753905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c13ac60 0x7fa94c142890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009850 tx=0x7fa93c009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 -- 172.21.15.63:0/3616753905 shutdown_connections 2023-12-01T15:43:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 --2- 172.21.15.63:0/3616753905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c13ac60 0x7fa94c142890 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 --2- 172.21.15.63:0/3616753905 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c137680 0x7fa94c137a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 -- 172.21.15.63:0/3616753905 >> 172.21.15.63:0/3616753905 conn(0x7fa94c073770 msgr2=0x7fa94c0ac9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.160+0000 7fa94b59e700 1 -- 172.21.15.63:0/3616753905 shutdown_connections 2023-12-01T15:43:40.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94b59e700 1 -- 172.21.15.63:0/3616753905 wait complete. 2023-12-01T15:43:40.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94b59e700 1 Processor -- start 2023-12-01T15:43:40.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94b59e700 1 -- start start 2023-12-01T15:43:40.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c137680 0x7fa94c135460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:40.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94b59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c13ac60 0x7fa94c1359a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:40.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94b59e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c0a5300 0x7fa94c1cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:40.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94b59e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c0a3200 con 0x7fa94c0a5300 2023-12-01T15:43:40.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94b59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c0a23c0 con 0x7fa94c13ac60 2023-12-01T15:43:40.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c0a5df0 con 0x7fa94c137680 2023-12-01T15:43:40.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94ad9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c0a5300 0x7fa94c1cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:40.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94ad9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c0a5300 0x7fa94c1cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53226/0 (socket says 172.21.15.63:53226) 2023-12-01T15:43:40.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94ad9d700 1 -- 172.21.15.63:0/903776302 learned_addr learned my addr 172.21.15.63:0/903776302 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:40.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa949d9b700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c13ac60 0x7fa94c1359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:40.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94a59c700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c137680 0x7fa94c135460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:40.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94ad9d700 1 -- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c137680 msgr2=0x7fa94c135460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94ad9d700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c137680 0x7fa94c135460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94ad9d700 1 -- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c13ac60 msgr2=0x7fa94c1359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94ad9d700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c13ac60 0x7fa94c1359a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.164+0000 7fa94ad9d700 1 -- 172.21.15.63:0/903776302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c0094b0 con 0x7fa94c0a5300 2023-12-01T15:43:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.168+0000 7fa94ad9d700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c0a5300 0x7fa94c1cf2d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa93c014040 tx=0x7fa93c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.168+0000 7fa942ffd700 1 -- 172.21.15.63:0/903776302 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0198c0 con 0x7fa94c0a5300 2023-12-01T15:43:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.168+0000 7fa942ffd700 1 -- 172.21.15.63:0/903776302 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c01e070 con 0x7fa94c0a5300 2023-12-01T15:43:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.168+0000 7fa94b59e700 1 -- 172.21.15.63:0/903776302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c0a2000 con 0x7fa94c0a5300 2023-12-01T15:43:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.168+0000 7fa942ffd700 1 -- 172.21.15.63:0/903776302 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c019c60 con 0x7fa94c0a5300 2023-12-01T15:43:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.168+0000 7fa94b59e700 1 -- 172.21.15.63:0/903776302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c135ee0 con 0x7fa94c0a5300 2023-12-01T15:43:40.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.168+0000 7fa942ffd700 1 -- 172.21.15.63:0/903776302 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa93c01a420 con 0x7fa94c0a5300 2023-12-01T15:43:40.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.172+0000 7fa94b59e700 1 -- 172.21.15.63:0/903776302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c065fb0 con 0x7fa94c0a5300 2023-12-01T15:43:40.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.172+0000 7fa942ffd700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa92c065b00 0x7fa92c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:40.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.172+0000 7fa942ffd700 1 -- 172.21.15.63:0/903776302 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3471+0+0 (secure 0 0 0) 0x7fa93c083890 con 0x7fa94c0a5300 2023-12-01T15:43:40.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.172+0000 7fa94a59c700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa92c065b00 0x7fa92c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:40.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.172+0000 7fa94a59c700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa92c065b00 0x7fa92c067fc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa9440113e0 tx=0x7fa94400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:40.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.176+0000 7fa942ffd700 1 -- 172.21.15.63:0/903776302 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa93c051ba0 con 0x7fa94c0a5300 2023-12-01T15:43:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:40.344+0000 7fa94b59e700 1 -- 172.21.15.63:0/903776302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa94c0aaee0 con 0x7fa94c0a5300 2023-12-01T15:43:41.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.028+0000 7fa942ffd700 1 -- 172.21.15.63:0/903776302 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa93c0150c0 con 0x7fa94c0a5300 2023-12-01T15:43:41.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 -- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa92c065b00 msgr2=0x7fa92c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa92c065b00 0x7fa92c067fc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa9440113e0 tx=0x7fa94400b040 comp rx=0 tx=0).stop 2023-12-01T15:43:41.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 -- 172.21.15.63:0/903776302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c0a5300 msgr2=0x7fa94c1cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c0a5300 0x7fa94c1cf2d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa93c014040 tx=0x7fa93c004770 comp rx=0 tx=0).stop 2023-12-01T15:43:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 -- 172.21.15.63:0/903776302 shutdown_connections 2023-12-01T15:43:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa92c065b00 0x7fa92c067fc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c0a5300 0x7fa94c1cf2d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c13ac60 0x7fa94c1359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 --2- 172.21.15.63:0/903776302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c137680 0x7fa94c135460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 -- 172.21.15.63:0/903776302 >> 172.21.15.63:0/903776302 conn(0x7fa94c073770 msgr2=0x7fa94c0a70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 -- 172.21.15.63:0/903776302 shutdown_connections 2023-12-01T15:43:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.036+0000 7fa94b59e700 1 -- 172.21.15.63:0/903776302 wait complete. 2023-12-01T15:43:41.046 INFO:teuthology.orchestra.run.smithi063.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-01T15:43:41.061 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-01T15:43:41.061 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-01T15:43:41.061 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-01T15:43:41.063 INFO:tasks.ceph.mds.a:Started 2023-12-01T15:43:41.063 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-01T15:43:41.064 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-01T15:43:41.066 INFO:tasks.ceph.mds.b:Started 2023-12-01T15:43:41.066 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-01T15:43:41.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:41.141 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2023-12-01T15:43:41.150 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2023-12-01T15:43:41.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 Processor -- start 2023-12-01T15:43:41.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 -- start start 2023-12-01T15:43:41.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6808137ac0 0x7f680806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680809c240 con 0x7f68081376e0 2023-12-01T15:43:41.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680809bc90 con 0x7f68081408b0 2023-12-01T15:43:41.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680809bf80 con 0x7f6808137ac0 2023-12-01T15:43:41.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680659c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f68081376e0 0x7f680806ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33622/0 (socket says 172.21.15.63:33622) 2023-12-01T15:43:41.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680659c700 1 -- 172.21.15.63:0/1634843736 learned_addr learned my addr 172.21.15.63:0/1634843736 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:41.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f6805d9b700 1 --2- 172.21.15.63:0/1634843736 >> v2:172.21.15.66:3300/0 conn(0x7f6808137ac0 0x7f680806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680559a700 1 -- 172.21.15.63:0/1634843736 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154812396 0 0) 0x7f680809c240 con 0x7f68081376e0 2023-12-01T15:43:41.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680559a700 1 -- 172.21.15.63:0/1634843736 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f40035d0 con 0x7f68081376e0 2023-12-01T15:43:41.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f6805d9b700 1 -- 172.21.15.63:0/1634843736 >> v1:172.21.15.66:6789/0 conn(0x7f68081408b0 legacy=0x7f6808142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f6805d9b700 1 -- 172.21.15.63:0/1634843736 >> v1:172.21.15.63:6789/0 conn(0x7f68081376e0 legacy=0x7f680806ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680559a700 1 -- 172.21.15.63:0/1634843736 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394618016 0 0) 0x7f680809bc90 con 0x7f68081408b0 2023-12-01T15:43:41.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f6805d9b700 1 -- 172.21.15.63:0/1634843736 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680809ebd0 con 0x7f6808137ac0 2023-12-01T15:43:41.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f6805d9b700 1 --2- 172.21.15.63:0/1634843736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6808137ac0 0x7f680806c160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009850 tx=0x7f67f0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=534e7472ba45de4b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:41.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680559a700 1 -- 172.21.15.63:0/1634843736 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0011830 con 0x7f6808137ac0 2023-12-01T15:43:41.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680559a700 1 -- 172.21.15.63:0/1634843736 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f0011990 con 0x7f6808137ac0 2023-12-01T15:43:41.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680559a700 1 -- 172.21.15.63:0/1634843736 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0011d40 con 0x7f6808137ac0 2023-12-01T15:43:41.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 -- 172.21.15.63:0/1634843736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6808137ac0 msgr2=0x7f680806c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 --2- 172.21.15.63:0/1634843736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6808137ac0 0x7f680806c160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009850 tx=0x7f67f0009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:41.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 -- 172.21.15.63:0/1634843736 shutdown_connections 2023-12-01T15:43:41.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 --2- 172.21.15.63:0/1634843736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6808137ac0 0x7f680806c160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 -- 172.21.15.63:0/1634843736 >> 172.21.15.63:0/1634843736 conn(0x7f68080737a0 msgr2=0x7f68080ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:41.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 -- 172.21.15.63:0/1634843736 shutdown_connections 2023-12-01T15:43:41.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.164+0000 7f680759e700 1 -- 172.21.15.63:0/1634843736 wait complete. 2023-12-01T15:43:41.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f680759e700 1 Processor -- start 2023-12-01T15:43:41.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f680759e700 1 -- start start 2023-12-01T15:43:41.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f680759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68081376e0 0x7f68081cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f680759e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6808137ac0 0x7f68081cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f680759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68081408b0 0x7f68081cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f680759e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680813b720 con 0x7f6808137ac0 2023-12-01T15:43:41.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f680759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68081cbf70 con 0x7f68081408b0 2023-12-01T15:43:41.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f680759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68081cc230 con 0x7f68081376e0 2023-12-01T15:43:41.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f6805d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6808137ac0 0x7f68081cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f6805d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6808137ac0 0x7f68081cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53252/0 (socket says 172.21.15.63:53252) 2023-12-01T15:43:41.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f6805d9b700 1 -- 172.21.15.63:0/496085890 learned_addr learned my addr 172.21.15.63:0/496085890 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:41.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f6806d9d700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68081408b0 0x7f68081cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f680659c700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68081376e0 0x7f68081cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f6805d9b700 1 -- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68081376e0 msgr2=0x7f68081cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f6805d9b700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68081376e0 0x7f68081cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f6805d9b700 1 -- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68081408b0 msgr2=0x7f68081cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f6805d9b700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68081408b0 0x7f68081cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f6805d9b700 1 -- 172.21.15.63:0/496085890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f00094b0 con 0x7f6808137ac0 2023-12-01T15:43:41.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f6806d9d700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68081408b0 0x7f68081cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:41.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f6805d9b700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6808137ac0 0x7f68081cf520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68080ad960 tx=0x7f67f0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:41.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.168+0000 7f67feffd700 1 -- 172.21.15.63:0/496085890 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f001a8d0 con 0x7f6808137ac0 2023-12-01T15:43:41.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.172+0000 7f67feffd700 1 -- 172.21.15.63:0/496085890 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f001f070 con 0x7f6808137ac0 2023-12-01T15:43:41.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.172+0000 7f680759e700 1 -- 172.21.15.63:0/496085890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680813bfb0 con 0x7f6808137ac0 2023-12-01T15:43:41.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.172+0000 7f67feffd700 1 -- 172.21.15.63:0/496085890 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f001ac90 con 0x7f6808137ac0 2023-12-01T15:43:41.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.172+0000 7f680759e700 1 -- 172.21.15.63:0/496085890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68081400b0 con 0x7f6808137ac0 2023-12-01T15:43:41.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.172+0000 7f680759e700 1 -- 172.21.15.63:0/496085890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6808065fb0 con 0x7f6808137ac0 2023-12-01T15:43:41.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.172+0000 7f67feffd700 1 -- 172.21.15.63:0/496085890 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f67f001b430 con 0x7f6808137ac0 2023-12-01T15:43:41.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.172+0000 7f67feffd700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f67e8065ad0 0x7f67e8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.172+0000 7f67feffd700 1 -- 172.21.15.63:0/496085890 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f67f0021070 con 0x7f6808137ac0 2023-12-01T15:43:41.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.172+0000 7f680659c700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f67e8065ad0 0x7f67e8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.172+0000 7f680659c700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f67e8065ad0 0x7f67e8067f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005cb0 tx=0x7f67f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:41.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.180+0000 7f67feffd700 1 -- 172.21.15.63:0/496085890 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f67f0052260 con 0x7f6808137ac0 2023-12-01T15:43:41.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.356+0000 7f680759e700 1 -- 172.21.15.63:0/496085890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f680806d940 con 0x7f6808137ac0 2023-12-01T15:43:41.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.356+0000 7f67feffd700 1 -- 172.21.15.63:0/496085890 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9423 (secure 0 0 0) 0x7f67f0015090 con 0x7f6808137ac0 2023-12-01T15:43:41.366 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:41.366 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":14,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:41.019455+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:41.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 -- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f67e8065ad0 msgr2=0x7f67e8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f67e8065ad0 0x7f67e8067f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005cb0 tx=0x7f67f8009040 comp rx=0 tx=0).stop 2023-12-01T15:43:41.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 -- 172.21.15.63:0/496085890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6808137ac0 msgr2=0x7f68081cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6808137ac0 0x7f68081cf520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68080ad960 tx=0x7f67f0004770 comp rx=0 tx=0).stop 2023-12-01T15:43:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 -- 172.21.15.63:0/496085890 shutdown_connections 2023-12-01T15:43:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f67e8065ad0 0x7f67e8067f90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68081408b0 0x7f68081cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6808137ac0 0x7f68081cf520 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 --2- 172.21.15.63:0/496085890 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68081376e0 0x7f68081cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 -- 172.21.15.63:0/496085890 >> 172.21.15.63:0/496085890 conn(0x7f68080737a0 msgr2=0x7f680809d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 -- 172.21.15.63:0/496085890 shutdown_connections 2023-12-01T15:43:41.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.360+0000 7f680759e700 1 -- 172.21.15.63:0/496085890 wait complete. 2023-12-01T15:43:41.379 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T15:43:34.432064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-01T15:43:39.868591+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T15:43:41.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T15:43:41.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 Processor -- start 2023-12-01T15:43:41.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 -- start start 2023-12-01T15:43:41.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f02701377b0 0x7f0270137b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f027013a3e0 0x7f027013a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02700ab9c0 con 0x7f027013ad00 2023-12-01T15:43:41.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02700aafc0 con 0x7f02701377b0 2023-12-01T15:43:41.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02700aab40 con 0x7f027013a3e0 2023-12-01T15:43:41.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f027013ad00 0x7f0270141750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33628/0 (socket says 172.21.15.63:33628) 2023-12-01T15:43:41.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026f7fe700 1 -- 172.21.15.63:0/2331215793 learned_addr learned my addr 172.21.15.63:0/2331215793 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:41.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026effd700 1 --2- 172.21.15.63:0/2331215793 >> v2:172.21.15.63:3300/0 conn(0x7f02701377b0 0x7f0270137b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026e7fc700 1 --2- 172.21.15.63:0/2331215793 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f027013a3e0 0x7f027013a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026dffb700 1 -- 172.21.15.63:0/2331215793 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966078897 0 0) 0x7f02700ab9c0 con 0x7f027013ad00 2023-12-01T15:43:41.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026dffb700 1 -- 172.21.15.63:0/2331215793 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02580035d0 con 0x7f027013ad00 2023-12-01T15:43:41.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026effd700 1 -- 172.21.15.63:0/2331215793 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f027013a3e0 msgr2=0x7f027013a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:41.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026dffb700 1 -- 172.21.15.63:0/2331215793 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2193408928 0 0) 0x7f02580035d0 con 0x7f027013ad00 2023-12-01T15:43:41.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026effd700 1 --2- 172.21.15.63:0/2331215793 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f027013a3e0 0x7f027013a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026effd700 1 -- 172.21.15.63:0/2331215793 >> v1:172.21.15.63:6789/0 conn(0x7f027013ad00 legacy=0x7f0270141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026effd700 1 -- 172.21.15.63:0/2331215793 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02700ab6e0 con 0x7f02701377b0 2023-12-01T15:43:41.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026e7fc700 1 --2- 172.21.15.63:0/2331215793 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f027013a3e0 0x7f027013a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:41.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026effd700 1 --2- 172.21.15.63:0/2331215793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02701377b0 0x7f0270137b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0264009880 tx=0x7f0264009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba39c8f366d6a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:41.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026dffb700 1 -- 172.21.15.63:0/2331215793 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02680019f0 con 0x7f02701377b0 2023-12-01T15:43:41.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026dffb700 1 -- 172.21.15.63:0/2331215793 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0264004030 con 0x7f02701377b0 2023-12-01T15:43:41.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026dffb700 1 -- 172.21.15.63:0/2331215793 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02640043c0 con 0x7f02701377b0 2023-12-01T15:43:41.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 -- 172.21.15.63:0/2331215793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02701377b0 msgr2=0x7f0270137b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 --2- 172.21.15.63:0/2331215793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02701377b0 0x7f0270137b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0264009880 tx=0x7f0264009b90 comp rx=0 tx=0).stop 2023-12-01T15:43:41.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 -- 172.21.15.63:0/2331215793 shutdown_connections 2023-12-01T15:43:41.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 --2- 172.21.15.63:0/2331215793 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f027013a3e0 0x7f027013a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 --2- 172.21.15.63:0/2331215793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02701377b0 0x7f0270137b90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 -- 172.21.15.63:0/2331215793 >> 172.21.15.63:0/2331215793 conn(0x7f0270073710 msgr2=0x7f02700ac9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:41.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.496+0000 7f026ffff700 1 -- 172.21.15.63:0/2331215793 shutdown_connections 2023-12-01T15:43:41.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026ffff700 1 -- 172.21.15.63:0/2331215793 wait complete. 2023-12-01T15:43:41.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026ffff700 1 Processor -- start 2023-12-01T15:43:41.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026ffff700 1 -- start start 2023-12-01T15:43:41.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02701377b0 0x7f02700a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f027013a3e0 0x7f02700a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f027013ad00 0x7f02700a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026ffff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02701381b0 con 0x7f027013a3e0 2023-12-01T15:43:41.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026ffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02700a4d40 con 0x7f027013ad00 2023-12-01T15:43:41.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02700a2ff0 con 0x7f02701377b0 2023-12-01T15:43:41.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026e7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f027013a3e0 0x7f02700a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026e7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f027013a3e0 0x7f02700a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53264/0 (socket says 172.21.15.63:53264) 2023-12-01T15:43:41.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026e7fc700 1 -- 172.21.15.63:0/2381771805 learned_addr learned my addr 172.21.15.63:0/2381771805 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:41.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026effd700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02701377b0 0x7f02700a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026f7fe700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f027013ad00 0x7f02700a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026e7fc700 1 -- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02701377b0 msgr2=0x7f02700a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026e7fc700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02701377b0 0x7f02700a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026e7fc700 1 -- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f027013ad00 msgr2=0x7f02700a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026e7fc700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f027013ad00 0x7f02700a1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026e7fc700 1 -- 172.21.15.63:0/2381771805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02600094b0 con 0x7f027013a3e0 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.500+0000 7f026e7fc700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f027013a3e0 0x7f02700a1530 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f026000ebe0 tx=0x7f026000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.504+0000 7f02577fe700 1 -- 172.21.15.63:0/2381771805 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000c890 con 0x7f027013a3e0 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.504+0000 7f02577fe700 1 -- 172.21.15.63:0/2381771805 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026000c9f0 con 0x7f027013a3e0 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.504+0000 7f026ffff700 1 -- 172.21.15.63:0/2381771805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02640094b0 con 0x7f027013a3e0 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.504+0000 7f02577fe700 1 -- 172.21.15.63:0/2381771805 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000cd80 con 0x7f027013a3e0 2023-12-01T15:43:41.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.504+0000 7f026ffff700 1 -- 172.21.15.63:0/2381771805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02700a4200 con 0x7f027013a3e0 2023-12-01T15:43:41.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.504+0000 7f026ffff700 1 -- 172.21.15.63:0/2381771805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0270065fb0 con 0x7f027013a3e0 2023-12-01T15:43:41.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.504+0000 7f02577fe700 1 -- 172.21.15.63:0/2381771805 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0260013470 con 0x7f027013a3e0 2023-12-01T15:43:41.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.504+0000 7f02577fe700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f025c065ad0 0x7f025c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.504+0000 7f02577fe700 1 -- 172.21.15.63:0/2381771805 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f0260082930 con 0x7f027013a3e0 2023-12-01T15:43:41.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.504+0000 7f026effd700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f025c065ad0 0x7f025c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.508+0000 7f026effd700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f025c065ad0 0x7f025c067f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f02640090b0 tx=0x7f0264010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:41.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.512+0000 7f02577fe700 1 -- 172.21.15.63:0/2381771805 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0260050c30 con 0x7f027013a3e0 2023-12-01T15:43:41.683 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.676+0000 7f026ffff700 1 -- 172.21.15.63:0/2381771805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0270061d90 con 0x7f027013a3e0 2023-12-01T15:43:41.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.676+0000 7f02577fe700 1 -- 172.21.15.63:0/2381771805 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v14) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02600210a0 con 0x7f027013a3e0 2023-12-01T15:43:41.684 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-01T15:43:41.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 -- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f025c065ad0 msgr2=0x7f025c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f025c065ad0 0x7f025c067f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f02640090b0 tx=0x7f0264010000 comp rx=0 tx=0).stop 2023-12-01T15:43:41.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 -- 172.21.15.63:0/2381771805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f027013a3e0 msgr2=0x7f02700a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f027013a3e0 0x7f02700a1530 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f026000ebe0 tx=0x7f026000eef0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 -- 172.21.15.63:0/2381771805 shutdown_connections 2023-12-01T15:43:41.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f025c065ad0 0x7f025c067f90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f027013ad00 0x7f02700a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f027013a3e0 0x7f02700a1530 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 --2- 172.21.15.63:0/2381771805 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02701377b0 0x7f02700a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 -- 172.21.15.63:0/2381771805 >> 172.21.15.63:0/2381771805 conn(0x7f0270073710 msgr2=0x7f02700a81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:41.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 -- 172.21.15.63:0/2381771805 shutdown_connections 2023-12-01T15:43:41.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.680+0000 7f026ffff700 1 -- 172.21.15.63:0/2381771805 wait complete. 2023-12-01T15:43:41.699 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-01T15:43:41.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 Processor -- start 2023-12-01T15:43:41.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 -- start start 2023-12-01T15:43:41.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fae341354b0 0x7fae3406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fae34135890 0x7fae3409b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae3409b580 0x7fae3409b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3406fb30 con 0x7fae341354b0 2023-12-01T15:43:41.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae34070730 con 0x7fae34135890 2023-12-01T15:43:41.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3406f500 con 0x7fae3409b580 2023-12-01T15:43:41.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3a542700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fae341354b0 0x7fae3406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3a542700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fae341354b0 0x7fae3406eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53270/0 (socket says 172.21.15.63:53270) 2023-12-01T15:43:41.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3a542700 1 -- 172.21.15.63:0/3123092508 learned_addr learned my addr 172.21.15.63:0/3123092508 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:41.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3ad43700 1 --2- 172.21.15.63:0/3123092508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae3409b580 0x7fae3409b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae39d41700 1 --2- 172.21.15.63:0/3123092508 >> v2:172.21.15.66:3300/0 conn(0x7fae34135890 0x7fae3409b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3a542700 1 -- 172.21.15.63:0/3123092508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae3409b580 msgr2=0x7fae3409b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:41.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3a542700 1 --2- 172.21.15.63:0/3123092508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae3409b580 0x7fae3409b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3a542700 1 -- 172.21.15.63:0/3123092508 >> v2:172.21.15.66:3300/0 conn(0x7fae34135890 msgr2=0x7fae3409b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:41.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3a542700 1 --2- 172.21.15.63:0/3123092508 >> v2:172.21.15.66:3300/0 conn(0x7fae34135890 0x7fae3409b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3a542700 1 -- 172.21.15.63:0/3123092508 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae34070060 con 0x7fae341354b0 2023-12-01T15:43:41.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae39d41700 1 --2- 172.21.15.63:0/3123092508 >> v2:172.21.15.66:3300/0 conn(0x7fae34135890 0x7fae3409b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T15:43:41.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3ad43700 1 --2- 172.21.15.63:0/3123092508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae3409b580 0x7fae3409b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:41.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3a542700 1 --2- 172.21.15.63:0/3123092508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae341354b0 0x7fae3406eef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae34099f00 tx=0x7fae24009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8703b3e3ec4e5f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:41.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae39540700 1 -- 172.21.15.63:0/3123092508 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2400b8a0 con 0x7fae341354b0 2023-12-01T15:43:41.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae39540700 1 -- 172.21.15.63:0/3123092508 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2400ba00 con 0x7fae341354b0 2023-12-01T15:43:41.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae39540700 1 -- 172.21.15.63:0/3123092508 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2400bd90 con 0x7fae341354b0 2023-12-01T15:43:41.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 -- 172.21.15.63:0/3123092508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae341354b0 msgr2=0x7fae3406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 --2- 172.21.15.63:0/3123092508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae341354b0 0x7fae3406eef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae34099f00 tx=0x7fae24009bf0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 -- 172.21.15.63:0/3123092508 shutdown_connections 2023-12-01T15:43:41.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 --2- 172.21.15.63:0/3123092508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae3409b580 0x7fae3409b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 --2- 172.21.15.63:0/3123092508 >> v2:172.21.15.66:3300/0 conn(0x7fae34135890 0x7fae3409b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 --2- 172.21.15.63:0/3123092508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae341354b0 0x7fae3406eef0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 -- 172.21.15.63:0/3123092508 >> 172.21.15.63:0/3123092508 conn(0x7fae340738c0 msgr2=0x7fae340aa840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:41.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 -- 172.21.15.63:0/3123092508 shutdown_connections 2023-12-01T15:43:41.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.808+0000 7fae3b544700 1 -- 172.21.15.63:0/3123092508 wait complete. 2023-12-01T15:43:41.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3b544700 1 Processor -- start 2023-12-01T15:43:41.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3b544700 1 -- start start 2023-12-01T15:43:41.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3b544700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae3409b580 0x7fae340a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3b544700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae341354b0 0x7fae340a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3b544700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae34135890 0x7fae340a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3b544700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae340a51e0 con 0x7fae34135890 2023-12-01T15:43:41.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3b544700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae340a5d90 con 0x7fae341354b0 2023-12-01T15:43:41.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3b544700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae34121aa0 con 0x7fae3409b580 2023-12-01T15:43:41.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3ad43700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae34135890 0x7fae340a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3a542700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae3409b580 0x7fae340a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3ad43700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae34135890 0x7fae340a4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53286/0 (socket says 172.21.15.63:53286) 2023-12-01T15:43:41.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3ad43700 1 -- 172.21.15.63:0/2520630153 learned_addr learned my addr 172.21.15.63:0/2520630153 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:41.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae39d41700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae341354b0 0x7fae340a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3ad43700 1 -- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae3409b580 msgr2=0x7fae340a36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3ad43700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae3409b580 0x7fae340a36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3ad43700 1 -- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae341354b0 msgr2=0x7fae340a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3ad43700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae341354b0 0x7fae340a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3ad43700 1 -- 172.21.15.63:0/2520630153 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24009570 con 0x7fae34135890 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3ad43700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae34135890 0x7fae340a4160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae2c007e70 tx=0x7fae2c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae2affd700 1 -- 172.21.15.63:0/2520630153 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00dd20 con 0x7fae34135890 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae2affd700 1 -- 172.21.15.63:0/2520630153 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c00f040 con 0x7fae34135890 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3b544700 1 -- 172.21.15.63:0/2520630153 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae340a5420 con 0x7fae34135890 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae2affd700 1 -- 172.21.15.63:0/2520630153 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00dea0 con 0x7fae34135890 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.812+0000 7fae3b544700 1 -- 172.21.15.63:0/2520630153 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae340a66a0 con 0x7fae34135890 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.816+0000 7fae3b544700 1 -- 172.21.15.63:0/2520630153 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae34065fb0 con 0x7fae34135890 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.816+0000 7fae2affd700 1 -- 172.21.15.63:0/2520630153 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fae2c003c80 con 0x7fae34135890 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.816+0000 7fae2affd700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fae18065ad0 0x7fae18067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:41.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.816+0000 7fae2affd700 1 -- 172.21.15.63:0/2520630153 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fae2c082790 con 0x7fae34135890 2023-12-01T15:43:41.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.816+0000 7fae3a542700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fae18065ad0 0x7fae18067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:41.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.816+0000 7fae3a542700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fae18065ad0 0x7fae18067f90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae24000c00 tx=0x7fae24008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:41.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:41.824+0000 7fae2affd700 1 -- 172.21.15.63:0/2520630153 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fae2c050a90 con 0x7fae34135890 2023-12-01T15:43:42.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 -- 172.21.15.63:0/2520630153 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae34061d90 con 0x7fae34135890 2023-12-01T15:43:42.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae2affd700 1 -- 172.21.15.63:0/2520630153 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v14) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae2c01a0a0 con 0x7fae34135890 2023-12-01T15:43:42.007 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2023-12-01T15:43:42.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 -- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fae18065ad0 msgr2=0x7fae18067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fae18065ad0 0x7fae18067f90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae24000c00 tx=0x7fae24008030 comp rx=0 tx=0).stop 2023-12-01T15:43:42.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 -- 172.21.15.63:0/2520630153 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae34135890 msgr2=0x7fae340a4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae34135890 0x7fae340a4160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae2c007e70 tx=0x7fae2c00d3b0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 -- 172.21.15.63:0/2520630153 shutdown_connections 2023-12-01T15:43:42.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fae18065ad0 0x7fae18067f90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae34135890 0x7fae340a4160 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae341354b0 0x7fae340a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 --2- 172.21.15.63:0/2520630153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae3409b580 0x7fae340a36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 -- 172.21.15.63:0/2520630153 >> 172.21.15.63:0/2520630153 conn(0x7fae340738c0 msgr2=0x7fae340a8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:42.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 -- 172.21.15.63:0/2520630153 shutdown_connections 2023-12-01T15:43:42.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.000+0000 7fae3b544700 1 -- 172.21.15.63:0/2520630153 wait complete. 2023-12-01T15:43:42.022 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T15:43:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.124+0000 7f1539536700 1 Processor -- start 2023-12-01T15:43:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.124+0000 7f1539536700 1 -- start start 2023-12-01T15:43:42.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.124+0000 7f1539536700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f153413b7e0 0x7f153413dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.124+0000 7f1539536700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f153413e110 0x7f1534140500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.124+0000 7f1539536700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1534071470 con 0x7f15341384d0 2023-12-01T15:43:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.124+0000 7f1539536700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1534070ca0 con 0x7f153413e110 2023-12-01T15:43:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.124+0000 7f1539536700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15340719e0 con 0x7f153413b7e0 2023-12-01T15:43:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.124+0000 7f1538d35700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f153413e110 0x7f1534140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.124+0000 7f1538d35700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f153413e110 0x7f1534140500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53300/0 (socket says 172.21.15.63:53300) 2023-12-01T15:43:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.124+0000 7f1538d35700 1 -- 172.21.15.63:0/613620919 learned_addr learned my addr 172.21.15.63:0/613620919 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.124+0000 7f15337fe700 1 --2- 172.21.15.63:0/613620919 >> v2:172.21.15.66:3300/0 conn(0x7f153413b7e0 0x7f153413dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1538d35700 1 -- 172.21.15.63:0/613620919 >> v2:172.21.15.66:3300/0 conn(0x7f153413b7e0 msgr2=0x7f153413dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1538d35700 1 --2- 172.21.15.63:0/613620919 >> v2:172.21.15.66:3300/0 conn(0x7f153413b7e0 0x7f153413dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1538d35700 1 -- 172.21.15.63:0/613620919 >> v1:172.21.15.66:6789/0 conn(0x7f15341384d0 legacy=0x7f1534138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1538d35700 1 -- 172.21.15.63:0/613620919 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1534139430 con 0x7f153413e110 2023-12-01T15:43:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1538d35700 1 --2- 172.21.15.63:0/613620919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f153413e110 0x7f1534140500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f153406bbd0 tx=0x7f152c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82c1957cdba258b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1532ffd700 1 -- 172.21.15.63:0/613620919 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c011830 con 0x7f153413e110 2023-12-01T15:43:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1532ffd700 1 -- 172.21.15.63:0/613620919 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c011990 con 0x7f153413e110 2023-12-01T15:43:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1532ffd700 1 -- 172.21.15.63:0/613620919 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c011d20 con 0x7f153413e110 2023-12-01T15:43:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 -- 172.21.15.63:0/613620919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f153413e110 msgr2=0x7f1534140500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 --2- 172.21.15.63:0/613620919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f153413e110 0x7f1534140500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f153406bbd0 tx=0x7f152c009bf0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 -- 172.21.15.63:0/613620919 shutdown_connections 2023-12-01T15:43:42.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 --2- 172.21.15.63:0/613620919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f153413e110 0x7f1534140500 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 --2- 172.21.15.63:0/613620919 >> v2:172.21.15.66:3300/0 conn(0x7f153413b7e0 0x7f153413dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 -- 172.21.15.63:0/613620919 >> 172.21.15.63:0/613620919 conn(0x7f15340a8bd0 msgr2=0x7f1534098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:42.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 -- 172.21.15.63:0/613620919 shutdown_connections 2023-12-01T15:43:42.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 -- 172.21.15.63:0/613620919 wait complete. 2023-12-01T15:43:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 Processor -- start 2023-12-01T15:43:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 -- start start 2023-12-01T15:43:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15341384d0 0x7f1534134e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f153413b7e0 0x7f1534135390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f153413e110 0x7f15341358d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15340a0d70 con 0x7f153413b7e0 2023-12-01T15:43:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15340a2270 con 0x7f153413e110 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f1539536700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15340a1d00 con 0x7f15341384d0 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.128+0000 7f15337fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f153413b7e0 0x7f1534135390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f1533fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15341384d0 0x7f1534134e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f15337fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f153413b7e0 0x7f1534135390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53314/0 (socket says 172.21.15.63:53314) 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f15337fe700 1 -- 172.21.15.63:0/1348905088 learned_addr learned my addr 172.21.15.63:0/1348905088 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f1538d35700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f153413e110 0x7f15341358d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f15337fe700 1 -- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15341384d0 msgr2=0x7f1534134e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f15337fe700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15341384d0 0x7f1534134e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f15337fe700 1 -- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f153413e110 msgr2=0x7f15341358d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f15337fe700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f153413e110 0x7f15341358d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f15337fe700 1 -- 172.21.15.63:0/1348905088 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c009570 con 0x7f153413b7e0 2023-12-01T15:43:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f15337fe700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f153413b7e0 0x7f1534135390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f152400efc0 tx=0x7f152400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:42.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f1530ff9700 1 -- 172.21.15.63:0/1348905088 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400cd10 con 0x7f153413b7e0 2023-12-01T15:43:42.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f1530ff9700 1 -- 172.21.15.63:0/1348905088 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152400f040 con 0x7f153413b7e0 2023-12-01T15:43:42.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f1539536700 1 -- 172.21.15.63:0/1348905088 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15340a0490 con 0x7f153413b7e0 2023-12-01T15:43:42.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f1539536700 1 -- 172.21.15.63:0/1348905088 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15340a24a0 con 0x7f153413b7e0 2023-12-01T15:43:42.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f1530ff9700 1 -- 172.21.15.63:0/1348905088 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240146a0 con 0x7f153413b7e0 2023-12-01T15:43:42.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f1539536700 1 -- 172.21.15.63:0/1348905088 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1534065fb0 con 0x7f153413b7e0 2023-12-01T15:43:42.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.132+0000 7f1530ff9700 1 -- 172.21.15.63:0/1348905088 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1524014800 con 0x7f153413b7e0 2023-12-01T15:43:42.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.136+0000 7f1530ff9700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1520065ad0 0x7f1520067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.136+0000 7f1530ff9700 1 -- 172.21.15.63:0/1348905088 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f15240833a0 con 0x7f153413b7e0 2023-12-01T15:43:42.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.136+0000 7f1533fff700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1520065ad0 0x7f1520067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.136+0000 7f1533fff700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1520065ad0 0x7f1520067f90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1528000f60 tx=0x7f1528009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:42.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.140+0000 7f1530ff9700 1 -- 172.21.15.63:0/1348905088 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1524051620 con 0x7f153413b7e0 2023-12-01T15:43:42.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.344+0000 7f1539536700 1 -- 172.21.15.63:0/1348905088 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1534061d90 con 0x7f153413b7e0 2023-12-01T15:43:42.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.344+0000 7f1530ff9700 1 -- 172.21.15.63:0/1348905088 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2012 (secure 0 0 0) 0x7f1524054c40 con 0x7f153413b7e0 2023-12-01T15:43:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:42.354 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6817/2060518783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2060518783},{"type":"v1","addr":"172.21.15.63:6817","nonce":2060518783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6819/2416365697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2416365697},{"type":"v1","addr":"172.21.15.66:6819","nonce":2416365697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-01T15:43:42.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 -- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1520065ad0 msgr2=0x7f1520067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1520065ad0 0x7f1520067f90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1528000f60 tx=0x7f1528009040 comp rx=0 tx=0).stop 2023-12-01T15:43:42.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 -- 172.21.15.63:0/1348905088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f153413b7e0 msgr2=0x7f1534135390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f153413b7e0 0x7f1534135390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f152400efc0 tx=0x7f152400c3a0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 -- 172.21.15.63:0/1348905088 shutdown_connections 2023-12-01T15:43:42.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1520065ad0 0x7f1520067f90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f153413e110 0x7f15341358d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f153413b7e0 0x7f1534135390 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 --2- 172.21.15.63:0/1348905088 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15341384d0 0x7f1534134e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 -- 172.21.15.63:0/1348905088 >> 172.21.15.63:0/1348905088 conn(0x7f15340a8bd0 msgr2=0x7f1534136760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:42.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 -- 172.21.15.63:0/1348905088 shutdown_connections 2023-12-01T15:43:42.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.348+0000 7f1539536700 1 -- 172.21.15.63:0/1348905088 wait complete. 2023-12-01T15:43:42.357 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 3 2023-12-01T15:43:42.373 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b3fff700 1 Processor -- start 2023-12-01T15:43:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b3fff700 1 -- start start 2023-12-01T15:43:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f26b41384d0 0x7f26b4138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b3fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f26b4134f60 0x7f26b41353a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f26b41358e0 0x7f26b413f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b3fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b4071d10 con 0x7f26b41358e0 2023-12-01T15:43:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b3fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b4071470 con 0x7f26b4134f60 2023-12-01T15:43:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b4070ca0 con 0x7f26b41384d0 2023-12-01T15:43:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f26b41358e0 0x7f26b413f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f26b41358e0 0x7f26b413f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53320/0 (socket says 172.21.15.63:53320) 2023-12-01T15:43:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b37fe700 1 -- 172.21.15.63:0/340304845 learned_addr learned my addr 172.21.15.63:0/340304845 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b27fc700 1 --2- 172.21.15.63:0/340304845 >> v2:172.21.15.66:3300/0 conn(0x7f26b4134f60 0x7f26b41353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b2ffd700 1 --2- 172.21.15.63:0/340304845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f26b41384d0 0x7f26b4138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b37fe700 1 -- 172.21.15.63:0/340304845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f26b41384d0 msgr2=0x7f26b4138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b37fe700 1 --2- 172.21.15.63:0/340304845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f26b41384d0 0x7f26b4138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b37fe700 1 -- 172.21.15.63:0/340304845 >> v2:172.21.15.66:3300/0 conn(0x7f26b4134f60 msgr2=0x7f26b41353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b37fe700 1 --2- 172.21.15.63:0/340304845 >> v2:172.21.15.66:3300/0 conn(0x7f26b4134f60 0x7f26b41353a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b37fe700 1 -- 172.21.15.63:0/340304845 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b40719e0 con 0x7f26b41358e0 2023-12-01T15:43:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b37fe700 1 --2- 172.21.15.63:0/340304845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b41358e0 0x7f26b413f800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f26b40a9660 tx=0x7f26ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd163f324ae9a41 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b1ffb700 1 -- 172.21.15.63:0/340304845 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00e070 con 0x7f26b41358e0 2023-12-01T15:43:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b1ffb700 1 -- 172.21.15.63:0/340304845 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac00b8d0 con 0x7f26b41358e0 2023-12-01T15:43:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b1ffb700 1 -- 172.21.15.63:0/340304845 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00bc80 con 0x7f26b41358e0 2023-12-01T15:43:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b3fff700 1 -- 172.21.15.63:0/340304845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b41358e0 msgr2=0x7f26b413f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b3fff700 1 --2- 172.21.15.63:0/340304845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b41358e0 0x7f26b413f800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f26b40a9660 tx=0x7f26ac00b330 comp rx=0 tx=0).stop 2023-12-01T15:43:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.476+0000 7f26b3fff700 1 -- 172.21.15.63:0/340304845 shutdown_connections 2023-12-01T15:43:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 --2- 172.21.15.63:0/340304845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b41358e0 0x7f26b413f800 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 --2- 172.21.15.63:0/340304845 >> v2:172.21.15.66:3300/0 conn(0x7f26b4134f60 0x7f26b41353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 --2- 172.21.15.63:0/340304845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f26b41384d0 0x7f26b4138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 -- 172.21.15.63:0/340304845 >> 172.21.15.63:0/340304845 conn(0x7f26b40a8bd0 msgr2=0x7f26b4098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 -- 172.21.15.63:0/340304845 shutdown_connections 2023-12-01T15:43:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 -- 172.21.15.63:0/340304845 wait complete. 2023-12-01T15:43:42.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 Processor -- start 2023-12-01T15:43:42.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 -- start start 2023-12-01T15:43:42.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26b4134f60 0x7f26b41cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b41358e0 0x7f26b41cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f26b41384d0 0x7f26b41cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b40a3410 con 0x7f26b41358e0 2023-12-01T15:43:42.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b40a3bc0 con 0x7f26b4134f60 2023-12-01T15:43:42.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b40a2b90 con 0x7f26b41384d0 2023-12-01T15:43:42.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b27fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b41358e0 0x7f26b41cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b27fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b41358e0 0x7f26b41cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53326/0 (socket says 172.21.15.63:53326) 2023-12-01T15:43:42.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b27fc700 1 -- 172.21.15.63:0/3629000685 learned_addr learned my addr 172.21.15.63:0/3629000685 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b37fe700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f26b41384d0 0x7f26b41cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b2ffd700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26b4134f60 0x7f26b41cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b27fc700 1 -- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f26b41384d0 msgr2=0x7f26b41cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b27fc700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f26b41384d0 0x7f26b41cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b27fc700 1 -- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26b4134f60 msgr2=0x7f26b41cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b27fc700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26b4134f60 0x7f26b41cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b27fc700 1 -- 172.21.15.63:0/3629000685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac009b30 con 0x7f26b41358e0 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.480+0000 7f26b2ffd700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26b4134f60 0x7f26b41cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.484+0000 7f26b27fc700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b41358e0 0x7f26b41cf5e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f26a400e840 tx=0x7f26a400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.484+0000 7f269b7fe700 1 -- 172.21.15.63:0/3629000685 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a40095a0 con 0x7f26b41358e0 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.484+0000 7f269b7fe700 1 -- 172.21.15.63:0/3629000685 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a4013680 con 0x7f26b41358e0 2023-12-01T15:43:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.484+0000 7f26b3fff700 1 -- 172.21.15.63:0/3629000685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b4071730 con 0x7f26b41358e0 2023-12-01T15:43:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.484+0000 7f269b7fe700 1 -- 172.21.15.63:0/3629000685 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a40139f0 con 0x7f26b41358e0 2023-12-01T15:43:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.484+0000 7f26b3fff700 1 -- 172.21.15.63:0/3629000685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b406f7c0 con 0x7f26b41358e0 2023-12-01T15:43:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.484+0000 7f26b3fff700 1 -- 172.21.15.63:0/3629000685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b4065f70 con 0x7f26b41358e0 2023-12-01T15:43:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.484+0000 7f269b7fe700 1 -- 172.21.15.63:0/3629000685 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f26a4013b50 con 0x7f26b41358e0 2023-12-01T15:43:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.484+0000 7f269b7fe700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f26a0065ad0 0x7f26a0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.484+0000 7f269b7fe700 1 -- 172.21.15.63:0/3629000685 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f26a4082730 con 0x7f26b41358e0 2023-12-01T15:43:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.488+0000 7f26b2ffd700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f26a0065ad0 0x7f26a0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.488+0000 7f26b2ffd700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f26a0065ad0 0x7f26a0067f90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009bc0 tx=0x7f26a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:42.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.492+0000 7f269b7fe700 1 -- 172.21.15.63:0/3629000685 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f26a4050a30 con 0x7f26b41358e0 2023-12-01T15:43:42.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.664+0000 7f26b3fff700 1 -- 172.21.15.63:0/3629000685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26b4061d90 con 0x7f26b41358e0 2023-12-01T15:43:42.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.664+0000 7f269b7fe700 1 -- 172.21.15.63:0/3629000685 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9410 (secure 0 0 0) 0x7f26a4017090 con 0x7f26b41358e0 2023-12-01T15:43:42.674 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:42.674 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:42.030365+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:42.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 -- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f26a0065ad0 msgr2=0x7f26a0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f26a0065ad0 0x7f26a0067f90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009bc0 tx=0x7f26a8008040 comp rx=0 tx=0).stop 2023-12-01T15:43:42.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 -- 172.21.15.63:0/3629000685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b41358e0 msgr2=0x7f26b41cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b41358e0 0x7f26b41cf5e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f26a400e840 tx=0x7f26a400eb50 comp rx=0 tx=0).stop 2023-12-01T15:43:42.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 -- 172.21.15.63:0/3629000685 shutdown_connections 2023-12-01T15:43:42.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f26a0065ad0 0x7f26a0067f90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f26b41384d0 0x7f26b41cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26b41358e0 0x7f26b41cf5e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 --2- 172.21.15.63:0/3629000685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26b4134f60 0x7f26b41cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 -- 172.21.15.63:0/3629000685 >> 172.21.15.63:0/3629000685 conn(0x7f26b40a8bd0 msgr2=0x7f26b4134250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:42.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 -- 172.21.15.63:0/3629000685 shutdown_connections 2023-12-01T15:43:42.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.668+0000 7f26b3fff700 1 -- 172.21.15.63:0/3629000685 wait complete. 2023-12-01T15:43:42.688 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T15:43:34.432064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-01T15:43:39.868591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T15:43:42.688 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T15:43:42.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.804+0000 7f67b204b700 1 Processor -- start 2023-12-01T15:43:42.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.804+0000 7f67b204b700 1 -- start start 2023-12-01T15:43:42.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.804+0000 7f67b204b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f67ac1354b0 0x7f67ac06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.804+0000 7f67b204b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67ac09b750 0x7f67ac1406c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.804+0000 7f67b204b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67ac070730 con 0x7f67ac135890 2023-12-01T15:43:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.804+0000 7f67b204b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ac06fb30 con 0x7f67ac1354b0 2023-12-01T15:43:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.804+0000 7f67b204b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac06f500 con 0x7f67ac09b750 2023-12-01T15:43:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.804+0000 7f67b1049700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f67ac1354b0 0x7f67ac06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.804+0000 7f67b1049700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f67ac1354b0 0x7f67ac06eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53340/0 (socket says 172.21.15.63:53340) 2023-12-01T15:43:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.804+0000 7f67b1049700 1 -- 172.21.15.63:0/3585146409 learned_addr learned my addr 172.21.15.63:0/3585146409 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.804+0000 7f67b184a700 1 --2- 172.21.15.63:0/3585146409 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67ac09b750 0x7f67ac1406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b1049700 1 -- 172.21.15.63:0/3585146409 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67ac09b750 msgr2=0x7f67ac1406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b1049700 1 --2- 172.21.15.63:0/3585146409 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67ac09b750 0x7f67ac1406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b1049700 1 -- 172.21.15.63:0/3585146409 >> v1:172.21.15.66:6789/0 conn(0x7f67ac135890 legacy=0x7f67ac09b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b1049700 1 -- 172.21.15.63:0/3585146409 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac070060 con 0x7f67ac1354b0 2023-12-01T15:43:42.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b1049700 1 --2- 172.21.15.63:0/3585146409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67ac1354b0 0x7f67ac06eef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009910 tx=0x7f67a8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5699163760284b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:42.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67a3fff700 1 -- 172.21.15.63:0/3585146409 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8011830 con 0x7f67ac1354b0 2023-12-01T15:43:42.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67a3fff700 1 -- 172.21.15.63:0/3585146409 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a8011990 con 0x7f67ac1354b0 2023-12-01T15:43:42.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67a3fff700 1 -- 172.21.15.63:0/3585146409 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8011d40 con 0x7f67ac1354b0 2023-12-01T15:43:42.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b204b700 1 -- 172.21.15.63:0/3585146409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67ac1354b0 msgr2=0x7f67ac06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b204b700 1 --2- 172.21.15.63:0/3585146409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67ac1354b0 0x7f67ac06eef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009910 tx=0x7f67a8009c20 comp rx=0 tx=0).stop 2023-12-01T15:43:42.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b204b700 1 -- 172.21.15.63:0/3585146409 shutdown_connections 2023-12-01T15:43:42.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b204b700 1 --2- 172.21.15.63:0/3585146409 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67ac09b750 0x7f67ac1406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b204b700 1 --2- 172.21.15.63:0/3585146409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67ac1354b0 0x7f67ac06eef0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b204b700 1 -- 172.21.15.63:0/3585146409 >> 172.21.15.63:0/3585146409 conn(0x7f67ac0738c0 msgr2=0x7f67ac0aa840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:42.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b204b700 1 -- 172.21.15.63:0/3585146409 shutdown_connections 2023-12-01T15:43:42.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b204b700 1 -- 172.21.15.63:0/3585146409 wait complete. 2023-12-01T15:43:42.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.808+0000 7f67b204b700 1 Processor -- start 2023-12-01T15:43:42.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b204b700 1 -- start start 2023-12-01T15:43:42.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b204b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67ac09b750 0x7f67ac0a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b204b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67ac1354b0 0x7f67ac1cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b204b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67ac135890 0x7f67ac1cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b204b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac1ccf30 con 0x7f67ac1354b0 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b204b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac0a1f80 con 0x7f67ac09b750 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b204b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac0a1d30 con 0x7f67ac135890 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b0848700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67ac1354b0 0x7f67ac1cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b0848700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67ac1354b0 0x7f67ac1cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53342/0 (socket says 172.21.15.63:53342) 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b0848700 1 -- 172.21.15.63:0/857117037 learned_addr learned my addr 172.21.15.63:0/857117037 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b1049700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67ac09b750 0x7f67ac0a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b184a700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67ac135890 0x7f67ac1cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b0848700 1 -- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67ac135890 msgr2=0x7f67ac1cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b0848700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67ac135890 0x7f67ac1cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b0848700 1 -- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67ac09b750 msgr2=0x7f67ac0a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b0848700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67ac09b750 0x7f67ac0a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:42.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b0848700 1 -- 172.21.15.63:0/857117037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a8009570 con 0x7f67ac1354b0 2023-12-01T15:43:42.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b0848700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67ac1354b0 0x7f67ac1cd1d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f679c00c4f0 tx=0x7f679c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:42.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67a1ffb700 1 -- 172.21.15.63:0/857117037 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0052d0 con 0x7f67ac1354b0 2023-12-01T15:43:42.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67a1ffb700 1 -- 172.21.15.63:0/857117037 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c005430 con 0x7f67ac1354b0 2023-12-01T15:43:42.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b204b700 1 -- 172.21.15.63:0/857117037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ac0a3cb0 con 0x7f67ac1354b0 2023-12-01T15:43:42.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67a1ffb700 1 -- 172.21.15.63:0/857117037 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c003930 con 0x7f67ac1354b0 2023-12-01T15:43:42.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.812+0000 7f67b204b700 1 -- 172.21.15.63:0/857117037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ac0a4e30 con 0x7f67ac1354b0 2023-12-01T15:43:42.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.816+0000 7f67a1ffb700 1 -- 172.21.15.63:0/857117037 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f679c003a90 con 0x7f67ac1354b0 2023-12-01T15:43:42.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.816+0000 7f67b204b700 1 -- 172.21.15.63:0/857117037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ac065fb0 con 0x7f67ac1354b0 2023-12-01T15:43:42.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.816+0000 7f67a1ffb700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6790065ad0 0x7f6790067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:42.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.816+0000 7f67a1ffb700 1 -- 172.21.15.63:0/857117037 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f679c081d70 con 0x7f67ac1354b0 2023-12-01T15:43:42.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.816+0000 7f67b1049700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6790065ad0 0x7f6790067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:42.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.816+0000 7f67b1049700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6790065ad0 0x7f6790067f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f67a8000c00 tx=0x7f67a8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:42.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.824+0000 7f67a1ffb700 1 -- 172.21.15.63:0/857117037 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f679c04ffd0 con 0x7f67ac1354b0 2023-12-01T15:43:42.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.988+0000 7f67b204b700 1 -- 172.21.15.63:0/857117037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67ac09a520 con 0x7f67ac1354b0 2023-12-01T15:43:42.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.988+0000 7f67a1ffb700 1 -- 172.21.15.63:0/857117037 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7f679c017020 con 0x7f67ac1354b0 2023-12-01T15:43:42.998 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-01T15:43:42.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 -- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6790065ad0 msgr2=0x7f6790067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:42.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6790065ad0 0x7f6790067f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f67a8000c00 tx=0x7f67a8008030 comp rx=0 tx=0).stop 2023-12-01T15:43:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 -- 172.21.15.63:0/857117037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67ac1354b0 msgr2=0x7f67ac1cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67ac1354b0 0x7f67ac1cd1d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f679c00c4f0 tx=0x7f679c00c800 comp rx=0 tx=0).stop 2023-12-01T15:43:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 -- 172.21.15.63:0/857117037 shutdown_connections 2023-12-01T15:43:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6790065ad0 0x7f6790067f90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67ac135890 0x7f67ac1cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67ac1354b0 0x7f67ac1cd1d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 --2- 172.21.15.63:0/857117037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67ac09b750 0x7f67ac0a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 -- 172.21.15.63:0/857117037 >> 172.21.15.63:0/857117037 conn(0x7f67ac0738c0 msgr2=0x7f67ac138200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 -- 172.21.15.63:0/857117037 shutdown_connections 2023-12-01T15:43:43.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:42.992+0000 7f67b204b700 1 -- 172.21.15.63:0/857117037 wait complete. 2023-12-01T15:43:43.012 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-01T15:43:43.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.120+0000 7f89519a8700 1 Processor -- start 2023-12-01T15:43:43.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.120+0000 7f89519a8700 1 -- start start 2023-12-01T15:43:43.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.120+0000 7f89519a8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8944021fb0 0x7f8944022390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.120+0000 7f89519a8700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f89440b9870 0x7f89440c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.120+0000 7f89519a8700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894401dfd0 con 0x7f89440228d0 2023-12-01T15:43:43.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.120+0000 7f89519a8700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894401dca0 con 0x7f89440b9870 2023-12-01T15:43:43.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.120+0000 7f89519a8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894401eff0 con 0x7f8944021fb0 2023-12-01T15:43:43.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89511a7700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f89440b9870 0x7f89440c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89509a6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8944021fb0 0x7f8944022390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89511a7700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f89440b9870 0x7f89440c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:57886/0 (socket says 172.21.15.63:57886) 2023-12-01T15:43:43.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f894bfff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f89440228d0 0x7f89440b9160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:53026/0 (socket says 172.21.15.63:53026) 2023-12-01T15:43:43.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89511a7700 1 -- 172.21.15.63:0/2438885234 learned_addr learned my addr 172.21.15.63:0/2438885234 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:43.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89511a7700 1 -- 172.21.15.63:0/2438885234 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8944021fb0 msgr2=0x7f8944022390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:43.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89511a7700 1 --2- 172.21.15.63:0/2438885234 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8944021fb0 0x7f8944022390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89511a7700 1 -- 172.21.15.63:0/2438885234 >> v1:172.21.15.66:6789/0 conn(0x7f89440228d0 legacy=0x7f89440b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89511a7700 1 -- 172.21.15.63:0/2438885234 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8944006c90 con 0x7f89440b9870 2023-12-01T15:43:43.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89511a7700 1 --2- 172.21.15.63:0/2438885234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89440b9870 0x7f89440c7dc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f894c0641e0 tx=0x7f894c0684f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3df60b02d0eb828 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:43.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f894b7fe700 1 -- 172.21.15.63:0/2438885234 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c065fb0 con 0x7f89440b9870 2023-12-01T15:43:43.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f894b7fe700 1 -- 172.21.15.63:0/2438885234 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c09a380 con 0x7f89440b9870 2023-12-01T15:43:43.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f894b7fe700 1 -- 172.21.15.63:0/2438885234 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c0008d0 con 0x7f89440b9870 2023-12-01T15:43:43.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89519a8700 1 -- 172.21.15.63:0/2438885234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89440b9870 msgr2=0x7f89440c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89519a8700 1 --2- 172.21.15.63:0/2438885234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89440b9870 0x7f89440c7dc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f894c0641e0 tx=0x7f894c0684f0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89519a8700 1 -- 172.21.15.63:0/2438885234 shutdown_connections 2023-12-01T15:43:43.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89519a8700 1 --2- 172.21.15.63:0/2438885234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89440b9870 0x7f89440c7dc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89519a8700 1 --2- 172.21.15.63:0/2438885234 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8944021fb0 0x7f8944022390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89519a8700 1 -- 172.21.15.63:0/2438885234 >> 172.21.15.63:0/2438885234 conn(0x7f8944008820 msgr2=0x7f89440309f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:43.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89519a8700 1 -- 172.21.15.63:0/2438885234 shutdown_connections 2023-12-01T15:43:43.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.124+0000 7f89519a8700 1 -- 172.21.15.63:0/2438885234 wait complete. 2023-12-01T15:43:43.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89519a8700 1 Processor -- start 2023-12-01T15:43:43.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89519a8700 1 -- start start 2023-12-01T15:43:43.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89519a8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8944021fb0 0x7f8944154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89519a8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89440228d0 0x7f8944154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89519a8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89440b9870 0x7f89441552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89519a8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440a8230 con 0x7f89440b9870 2023-12-01T15:43:43.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89519a8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440b8d10 con 0x7f8944021fb0 2023-12-01T15:43:43.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89519a8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894402c860 con 0x7f89440228d0 2023-12-01T15:43:43.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89511a7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89440b9870 0x7f89441552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89511a7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89440b9870 0x7f89441552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53358/0 (socket says 172.21.15.63:53358) 2023-12-01T15:43:43.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89511a7700 1 -- 172.21.15.63:0/1597817495 learned_addr learned my addr 172.21.15.63:0/1597817495 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:43.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89509a6700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8944021fb0 0x7f8944154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f894bfff700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89440228d0 0x7f8944154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89511a7700 1 -- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89440228d0 msgr2=0x7f8944154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89511a7700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89440228d0 0x7f8944154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89511a7700 1 -- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8944021fb0 msgr2=0x7f8944154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89511a7700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8944021fb0 0x7f8944154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89511a7700 1 -- 172.21.15.63:0/1597817495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c06b8a0 con 0x7f89440b9870 2023-12-01T15:43:43.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89511a7700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89440b9870 0x7f89441552a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f894c065dd0 tx=0x7f894c069110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:43.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89497fa700 1 -- 172.21.15.63:0/1597817495 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c06be60 con 0x7f89440b9870 2023-12-01T15:43:43.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89497fa700 1 -- 172.21.15.63:0/1597817495 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c065fb0 con 0x7f89440b9870 2023-12-01T15:43:43.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89519a8700 1 -- 172.21.15.63:0/1597817495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894402d2c0 con 0x7f89440b9870 2023-12-01T15:43:43.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89497fa700 1 -- 172.21.15.63:0/1597817495 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c0678b0 con 0x7f89440b9870 2023-12-01T15:43:43.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.128+0000 7f89519a8700 1 -- 172.21.15.63:0/1597817495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89440a7570 con 0x7f89440b9870 2023-12-01T15:43:43.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.132+0000 7f89519a8700 1 -- 172.21.15.63:0/1597817495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89440058c0 con 0x7f89440b9870 2023-12-01T15:43:43.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.132+0000 7f89497fa700 1 -- 172.21.15.63:0/1597817495 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f894c067a10 con 0x7f89440b9870 2023-12-01T15:43:43.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.132+0000 7f89497fa700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8930065ad0 0x7f8930067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.132+0000 7f89497fa700 1 -- 172.21.15.63:0/1597817495 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f894c0fbe10 con 0x7f89440b9870 2023-12-01T15:43:43.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.132+0000 7f89509a6700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8930065ad0 0x7f8930067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.136+0000 7f89509a6700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8930065ad0 0x7f8930067f90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8938009bf0 tx=0x7f8938009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:43.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.140+0000 7f89497fa700 1 -- 172.21.15.63:0/1597817495 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f894c0ca310 con 0x7f89440b9870 2023-12-01T15:43:43.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 -- 172.21.15.63:0/1597817495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8944006040 con 0x7f89440b9870 2023-12-01T15:43:43.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89497fa700 1 -- 172.21.15.63:0/1597817495 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f894c0cd930 con 0x7f89440b9870 2023-12-01T15:43:43.311 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2023-12-01T15:43:43.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 -- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8930065ad0 msgr2=0x7f8930067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8930065ad0 0x7f8930067f90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8938009bf0 tx=0x7f8938009240 comp rx=0 tx=0).stop 2023-12-01T15:43:43.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 -- 172.21.15.63:0/1597817495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89440b9870 msgr2=0x7f89441552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89440b9870 0x7f89441552a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f894c065dd0 tx=0x7f894c069110 comp rx=0 tx=0).stop 2023-12-01T15:43:43.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 -- 172.21.15.63:0/1597817495 shutdown_connections 2023-12-01T15:43:43.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8930065ad0 0x7f8930067f90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89440228d0 0x7f8944154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89440b9870 0x7f89441552a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 --2- 172.21.15.63:0/1597817495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8944021fb0 0x7f8944154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 -- 172.21.15.63:0/1597817495 >> 172.21.15.63:0/1597817495 conn(0x7f8944008820 msgr2=0x7f89440bb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:43.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 -- 172.21.15.63:0/1597817495 shutdown_connections 2023-12-01T15:43:43.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.304+0000 7f89519a8700 1 -- 172.21.15.63:0/1597817495 wait complete. 2023-12-01T15:43:43.325 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-01T15:43:43.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 Processor -- start 2023-12-01T15:43:43.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 -- start start 2023-12-01T15:43:43.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73ac1376e0 0x7f73ac137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f73ac06c5b0 0x7f73ac1428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ac09c240 con 0x7f73ac06ba50 2023-12-01T15:43:43.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ac138000 con 0x7f73ac1376e0 2023-12-01T15:43:43.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ac09bc90 con 0x7f73ac06c5b0 2023-12-01T15:43:43.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b1c01700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73ac1376e0 0x7f73ac137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b1400700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f73ac06ba50 0x7f73ac06bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33634/0 (socket says 172.21.15.63:33634) 2023-12-01T15:43:43.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b1c01700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f73ac1376e0 0x7f73ac137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53372/0 (socket says 172.21.15.63:53372) 2023-12-01T15:43:43.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b1400700 1 -- 172.21.15.63:0/3730565890 learned_addr learned my addr 172.21.15.63:0/3730565890 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:43.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2402700 1 --2- 172.21.15.63:0/3730565890 >> v2:172.21.15.66:3300/0 conn(0x7f73ac06c5b0 0x7f73ac1428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b0bff700 1 -- 172.21.15.63:0/3730565890 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394715082 0 0) 0x7f73ac09c240 con 0x7f73ac06ba50 2023-12-01T15:43:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b0bff700 1 -- 172.21.15.63:0/3730565890 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73980035d0 con 0x7f73ac06ba50 2023-12-01T15:43:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b1c01700 1 -- 172.21.15.63:0/3730565890 >> v2:172.21.15.66:3300/0 conn(0x7f73ac06c5b0 msgr2=0x7f73ac1428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b1c01700 1 --2- 172.21.15.63:0/3730565890 >> v2:172.21.15.66:3300/0 conn(0x7f73ac06c5b0 0x7f73ac1428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b1c01700 1 -- 172.21.15.63:0/3730565890 >> v1:172.21.15.63:6789/0 conn(0x7f73ac06ba50 legacy=0x7f73ac06bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b1c01700 1 -- 172.21.15.63:0/3730565890 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ac09bf80 con 0x7f73ac1376e0 2023-12-01T15:43:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b1c01700 1 --2- 172.21.15.63:0/3730565890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac1376e0 0x7f73ac137ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0ad6c0 tx=0x7f739c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69877db6d68405e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b0bff700 1 -- 172.21.15.63:0/3730565890 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c011830 con 0x7f73ac1376e0 2023-12-01T15:43:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b0bff700 1 -- 172.21.15.63:0/3730565890 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c011990 con 0x7f73ac1376e0 2023-12-01T15:43:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b0bff700 1 -- 172.21.15.63:0/3730565890 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c011d00 con 0x7f73ac1376e0 2023-12-01T15:43:43.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 -- 172.21.15.63:0/3730565890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac1376e0 msgr2=0x7f73ac137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 --2- 172.21.15.63:0/3730565890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac1376e0 0x7f73ac137ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0ad6c0 tx=0x7f739c009b30 comp rx=0 tx=0).stop 2023-12-01T15:43:43.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 -- 172.21.15.63:0/3730565890 shutdown_connections 2023-12-01T15:43:43.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 --2- 172.21.15.63:0/3730565890 >> v2:172.21.15.66:3300/0 conn(0x7f73ac06c5b0 0x7f73ac1428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 --2- 172.21.15.63:0/3730565890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac1376e0 0x7f73ac137ac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 -- 172.21.15.63:0/3730565890 >> 172.21.15.63:0/3730565890 conn(0x7f73ac0737a0 msgr2=0x7f73ac0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:43.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 -- 172.21.15.63:0/3730565890 shutdown_connections 2023-12-01T15:43:43.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.432+0000 7f73b2c03700 1 -- 172.21.15.63:0/3730565890 wait complete. 2023-12-01T15:43:43.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b2c03700 1 Processor -- start 2023-12-01T15:43:43.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b2c03700 1 -- start start 2023-12-01T15:43:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b2c03700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac06ba50 0x7f73ac1cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b2c03700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73ac06c5b0 0x7f73ac1cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b2c03700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f73ac1376e0 0x7f73ac1cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b2c03700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac1c1f20 con 0x7f73ac06ba50 2023-12-01T15:43:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b2c03700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac0a2580 con 0x7f73ac06c5b0 2023-12-01T15:43:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b2c03700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac0a4bc0 con 0x7f73ac1376e0 2023-12-01T15:43:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b1c01700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac06ba50 0x7f73ac1cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b1c01700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac06ba50 0x7f73ac1cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53388/0 (socket says 172.21.15.63:53388) 2023-12-01T15:43:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b1c01700 1 -- 172.21.15.63:0/463828596 learned_addr learned my addr 172.21.15.63:0/463828596 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b1400700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73ac06c5b0 0x7f73ac1cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b2402700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f73ac1376e0 0x7f73ac1cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b1c01700 1 -- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f73ac1376e0 msgr2=0x7f73ac1cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b1c01700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f73ac1376e0 0x7f73ac1cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b1c01700 1 -- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73ac06c5b0 msgr2=0x7f73ac1cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b1c01700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73ac06c5b0 0x7f73ac1cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b1c01700 1 -- 172.21.15.63:0/463828596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c0094b0 con 0x7f73ac06ba50 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b1c01700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac06ba50 0x7f73ac1cf200 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f739c0090b0 tx=0x7f739c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73a27fc700 1 -- 172.21.15.63:0/463828596 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c0044d0 con 0x7f73ac06ba50 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73a27fc700 1 -- 172.21.15.63:0/463828596 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c01f070 con 0x7f73ac06ba50 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b2c03700 1 -- 172.21.15.63:0/463828596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ac0a3960 con 0x7f73ac06ba50 2023-12-01T15:43:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73a27fc700 1 -- 172.21.15.63:0/463828596 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c0038c0 con 0x7f73ac06ba50 2023-12-01T15:43:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.436+0000 7f73b2c03700 1 -- 172.21.15.63:0/463828596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ac0a3600 con 0x7f73ac06ba50 2023-12-01T15:43:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.440+0000 7f73b2c03700 1 -- 172.21.15.63:0/463828596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ac0a3d40 con 0x7f73ac06ba50 2023-12-01T15:43:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.440+0000 7f73a27fc700 1 -- 172.21.15.63:0/463828596 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f739c003a20 con 0x7f73ac06ba50 2023-12-01T15:43:43.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.440+0000 7f73a27fc700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7390065ad0 0x7f7390067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.440+0000 7f73a27fc700 1 -- 172.21.15.63:0/463828596 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f739c021070 con 0x7f73ac06ba50 2023-12-01T15:43:43.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.440+0000 7f73b1400700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7390065ad0 0x7f7390067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.444+0000 7f73b1400700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7390065ad0 0x7f7390067f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0a32e0 tx=0x7f73a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:43.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.448+0000 7f73a27fc700 1 -- 172.21.15.63:0/463828596 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f739c087030 con 0x7f73ac06ba50 2023-12-01T15:43:43.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.608+0000 7f73b2c03700 1 -- 172.21.15.63:0/463828596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f73ac065f70 con 0x7f73ac06ba50 2023-12-01T15:43:43.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.608+0000 7f73a27fc700 1 -- 172.21.15.63:0/463828596 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v15) v1 ==== 84+0+126 (secure 0 0 0) 0x7f739c02b090 con 0x7f73ac06ba50 2023-12-01T15:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2023-12-01T15:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-01T15:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2023-12-01T15:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2023-12-01T15:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-01T15:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-01T15:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2023-12-01T15:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2023-12-01T15:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-01T15:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:] 2023-12-01T15:43:43.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 -- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7390065ad0 msgr2=0x7f7390067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7390065ad0 0x7f7390067f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0a32e0 tx=0x7f73a8009040 comp rx=0 tx=0).stop 2023-12-01T15:43:43.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 -- 172.21.15.63:0/463828596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac06ba50 msgr2=0x7f73ac1cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac06ba50 0x7f73ac1cf200 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f739c0090b0 tx=0x7f739c004770 comp rx=0 tx=0).stop 2023-12-01T15:43:43.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 -- 172.21.15.63:0/463828596 shutdown_connections 2023-12-01T15:43:43.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7390065ad0 0x7f7390067f90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f73ac1376e0 0x7f73ac1cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73ac06c5b0 0x7f73ac1cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 --2- 172.21.15.63:0/463828596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac06ba50 0x7f73ac1cf200 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 -- 172.21.15.63:0/463828596 >> 172.21.15.63:0/463828596 conn(0x7f73ac0737a0 msgr2=0x7f73ac135680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:43.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 -- 172.21.15.63:0/463828596 shutdown_connections 2023-12-01T15:43:43.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.612+0000 7f73b2c03700 1 -- 172.21.15.63:0/463828596 wait complete. 2023-12-01T15:43:43.633 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-01T15:43:43.633 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-01T15:43:43.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.748+0000 7fe791e18700 1 Processor -- start 2023-12-01T15:43:43.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.748+0000 7fe791e18700 1 -- start start 2023-12-01T15:43:43.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.748+0000 7fe791e18700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe78c131590 0x7fe78c137950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.748+0000 7fe791e18700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe78c13d570 0x7fe78c13f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.748+0000 7fe791e18700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c0a49b0 con 0x7fe78c1311b0 2023-12-01T15:43:43.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791e18700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c131a00 con 0x7fe78c13d570 2023-12-01T15:43:43.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791e18700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c0a2780 con 0x7fe78c131590 2023-12-01T15:43:43.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791617700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe78c13d570 0x7fe78c13f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe790e16700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe78c1311b0 0x7fe78c137240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33646/0 (socket says 172.21.15.63:33646) 2023-12-01T15:43:43.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe790e16700 1 -- 172.21.15.63:0/404105644 learned_addr learned my addr 172.21.15.63:0/404105644 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:43.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe783fff700 1 --2- 172.21.15.63:0/404105644 >> v2:172.21.15.66:3300/0 conn(0x7fe78c131590 0x7fe78c137950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791617700 1 -- 172.21.15.63:0/404105644 >> v2:172.21.15.66:3300/0 conn(0x7fe78c131590 msgr2=0x7fe78c137950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:43.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791617700 1 --2- 172.21.15.63:0/404105644 >> v2:172.21.15.66:3300/0 conn(0x7fe78c131590 0x7fe78c137950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791617700 1 -- 172.21.15.63:0/404105644 >> v1:172.21.15.63:6789/0 conn(0x7fe78c1311b0 legacy=0x7fe78c137240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe7837fe700 1 -- 172.21.15.63:0/404105644 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097369916 0 0) 0x7fe78c0a49b0 con 0x7fe78c1311b0 2023-12-01T15:43:43.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791617700 1 -- 172.21.15.63:0/404105644 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c0a1230 con 0x7fe78c13d570 2023-12-01T15:43:43.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791617700 1 --2- 172.21.15.63:0/404105644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe78c13d570 0x7fe78c13f960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe78c06bdd0 tx=0x7fe78400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f69e006024aa59 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:43.761 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe7837fe700 1 -- 172.21.15.63:0/404105644 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78400e070 con 0x7fe78c13d570 2023-12-01T15:43:43.761 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe7837fe700 1 -- 172.21.15.63:0/404105644 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78400bb20 con 0x7fe78c13d570 2023-12-01T15:43:43.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe7837fe700 1 -- 172.21.15.63:0/404105644 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784012430 con 0x7fe78c13d570 2023-12-01T15:43:43.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791e18700 1 -- 172.21.15.63:0/404105644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe78c13d570 msgr2=0x7fe78c13f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791e18700 1 --2- 172.21.15.63:0/404105644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe78c13d570 0x7fe78c13f960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe78c06bdd0 tx=0x7fe78400b330 comp rx=0 tx=0).stop 2023-12-01T15:43:43.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791e18700 1 -- 172.21.15.63:0/404105644 shutdown_connections 2023-12-01T15:43:43.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791e18700 1 --2- 172.21.15.63:0/404105644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe78c13d570 0x7fe78c13f960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791e18700 1 --2- 172.21.15.63:0/404105644 >> v2:172.21.15.66:3300/0 conn(0x7fe78c131590 0x7fe78c137950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791e18700 1 -- 172.21.15.63:0/404105644 >> 172.21.15.63:0/404105644 conn(0x7fe78c0a8a70 msgr2=0x7fe78c0a4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:43.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791e18700 1 -- 172.21.15.63:0/404105644 shutdown_connections 2023-12-01T15:43:43.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.752+0000 7fe791e18700 1 -- 172.21.15.63:0/404105644 wait complete. 2023-12-01T15:43:43.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe791e18700 1 Processor -- start 2023-12-01T15:43:43.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe791e18700 1 -- start start 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe791e18700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe78c1311b0 0x7fe78c1cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe791e18700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe78c131590 0x7fe78c1cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe791e18700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe78c13d570 0x7fe78c1cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe791e18700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c12b060 con 0x7fe78c131590 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe791e18700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c09e190 con 0x7fe78c13d570 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe791e18700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c09b6b0 con 0x7fe78c1311b0 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe783fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe78c131590 0x7fe78c1cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe783fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe78c131590 0x7fe78c1cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53400/0 (socket says 172.21.15.63:53400) 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe783fff700 1 -- 172.21.15.63:0/3917527193 learned_addr learned my addr 172.21.15.63:0/3917527193 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe790e16700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe78c1311b0 0x7fe78c1cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe791617700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe78c13d570 0x7fe78c1cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe783fff700 1 -- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe78c1311b0 msgr2=0x7fe78c1cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe783fff700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe78c1311b0 0x7fe78c1cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe783fff700 1 -- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe78c13d570 msgr2=0x7fe78c1cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:43.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe783fff700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe78c13d570 0x7fe78c1cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:43.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe783fff700 1 -- 172.21.15.63:0/3917527193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe784009a70 con 0x7fe78c131590 2023-12-01T15:43:43.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe783fff700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe78c131590 0x7fe78c1cd5e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00ea00 tx=0x7fe77c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:43.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe7817fa700 1 -- 172.21.15.63:0/3917527193 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c009720 con 0x7fe78c131590 2023-12-01T15:43:43.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe7817fa700 1 -- 172.21.15.63:0/3917527193 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c00eea0 con 0x7fe78c131590 2023-12-01T15:43:43.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe791e18700 1 -- 172.21.15.63:0/3917527193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c09b950 con 0x7fe78c131590 2023-12-01T15:43:43.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe7817fa700 1 -- 172.21.15.63:0/3917527193 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c00ca50 con 0x7fe78c131590 2023-12-01T15:43:43.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.756+0000 7fe791e18700 1 -- 172.21.15.63:0/3917527193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c12b260 con 0x7fe78c131590 2023-12-01T15:43:43.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.760+0000 7fe791e18700 1 -- 172.21.15.63:0/3917527193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c065fb0 con 0x7fe78c131590 2023-12-01T15:43:43.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.760+0000 7fe7817fa700 1 -- 172.21.15.63:0/3917527193 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe77c00cbb0 con 0x7fe78c131590 2023-12-01T15:43:43.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.760+0000 7fe7817fa700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe778065ad0 0x7fe778067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:43.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.760+0000 7fe7817fa700 1 -- 172.21.15.63:0/3917527193 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fe77c082860 con 0x7fe78c131590 2023-12-01T15:43:43.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.760+0000 7fe790e16700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe778065ad0 0x7fe778067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:43.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.764+0000 7fe790e16700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe778065ad0 0x7fe778067f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe788000f60 tx=0x7fe788007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:43.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.768+0000 7fe7817fa700 1 -- 172.21.15.63:0/3917527193 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe77c050ae0 con 0x7fe78c131590 2023-12-01T15:43:43.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:43.940+0000 7fe791e18700 1 -- 172.21.15.63:0/3917527193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe78c0a0ba0 con 0x7fe78c131590 2023-12-01T15:43:44.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.164+0000 7fe7817fa700 1 -- 172.21.15.63:0/3917527193 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v16) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe77c054100 con 0x7fe78c131590 2023-12-01T15:43:44.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 -- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe778065ad0 msgr2=0x7fe778067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:44.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe778065ad0 0x7fe778067f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe788000f60 tx=0x7fe788007e90 comp rx=0 tx=0).stop 2023-12-01T15:43:44.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 -- 172.21.15.63:0/3917527193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe78c131590 msgr2=0x7fe78c1cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:44.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe78c131590 0x7fe78c1cd5e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00ea00 tx=0x7fe77c00ed10 comp rx=0 tx=0).stop 2023-12-01T15:43:44.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 -- 172.21.15.63:0/3917527193 shutdown_connections 2023-12-01T15:43:44.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe778065ad0 0x7fe778067f90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:44.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe78c13d570 0x7fe78c1cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:44.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe78c131590 0x7fe78c1cd5e0 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00ea00 tx=0x7fe77c00ed10 comp rx=0 tx=0).stop 2023-12-01T15:43:44.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 --2- 172.21.15.63:0/3917527193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe78c1311b0 0x7fe78c1cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 -- 172.21.15.63:0/3917527193 >> 172.21.15.63:0/3917527193 conn(0x7fe78c0a8a70 msgr2=0x7fe78c09f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 -- 172.21.15.63:0/3917527193 shutdown_connections 2023-12-01T15:43:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.172+0000 7fe791e18700 1 -- 172.21.15.63:0/3917527193 wait complete. 2023-12-01T15:43:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2023-12-01T15:43:44.196 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-01T15:43:44.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.312+0000 7f6fe74d8700 1 Processor -- start 2023-12-01T15:43:44.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.312+0000 7f6fe74d8700 1 -- start start 2023-12-01T15:43:44.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe74d8700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6fe0071ca0 0x7f6fe00704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:44.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe74d8700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe0099880 con 0x7f6fe01325a0 2023-12-01T15:43:44.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe74d8700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe0069fd0 con 0x7f6fe0132980 2023-12-01T15:43:44.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe74d8700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe00722b0 con 0x7f6fe0071ca0 2023-12-01T15:43:44.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe64d6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6fe01325a0 0x7f6fe0098a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33660/0 (socket says 172.21.15.63:33660) 2023-12-01T15:43:44.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe64d6700 1 -- 172.21.15.63:0/4181237350 learned_addr learned my addr 172.21.15.63:0/4181237350 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:44.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe5cd5700 1 --2- 172.21.15.63:0/4181237350 >> v2:172.21.15.66:3300/0 conn(0x7f6fe0071ca0 0x7f6fe00704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:44.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe54d4700 1 -- 172.21.15.63:0/4181237350 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129775603 0 0) 0x7f6fe0099880 con 0x7f6fe01325a0 2023-12-01T15:43:44.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe54d4700 1 -- 172.21.15.63:0/4181237350 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fcc0035d0 con 0x7f6fe01325a0 2023-12-01T15:43:44.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe54d4700 1 -- 172.21.15.63:0/4181237350 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338759054 0 0) 0x7f6fe0069fd0 con 0x7f6fe0132980 2023-12-01T15:43:44.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe54d4700 1 -- 172.21.15.63:0/4181237350 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe0099880 con 0x7f6fe0132980 2023-12-01T15:43:44.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe5cd5700 1 -- 172.21.15.63:0/4181237350 >> v1:172.21.15.66:6789/0 conn(0x7f6fe0132980 legacy=0x7f6fe0099170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:44.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe5cd5700 1 -- 172.21.15.63:0/4181237350 >> v1:172.21.15.63:6789/0 conn(0x7f6fe01325a0 legacy=0x7f6fe0098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:44.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe5cd5700 1 -- 172.21.15.63:0/4181237350 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe006a270 con 0x7f6fe0071ca0 2023-12-01T15:43:44.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe5cd5700 1 --2- 172.21.15.63:0/4181237350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe0071ca0 0x7f6fe00704f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009850 tx=0x7f6fd0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a995cc3aacd7998 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:44.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe54d4700 1 -- 172.21.15.63:0/4181237350 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0011830 con 0x7f6fe0071ca0 2023-12-01T15:43:44.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe54d4700 1 -- 172.21.15.63:0/4181237350 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0011990 con 0x7f6fe0071ca0 2023-12-01T15:43:44.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe54d4700 1 -- 172.21.15.63:0/4181237350 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0011d40 con 0x7f6fe0071ca0 2023-12-01T15:43:44.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe74d8700 1 -- 172.21.15.63:0/4181237350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe0071ca0 msgr2=0x7f6fe00704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.316+0000 7f6fe74d8700 1 --2- 172.21.15.63:0/4181237350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe0071ca0 0x7f6fe00704f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009850 tx=0x7f6fd0009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 -- 172.21.15.63:0/4181237350 shutdown_connections 2023-12-01T15:43:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 --2- 172.21.15.63:0/4181237350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe0071ca0 0x7f6fe00704f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 -- 172.21.15.63:0/4181237350 >> 172.21.15.63:0/4181237350 conn(0x7f6fe00a96b0 msgr2=0x7f6fe00a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 -- 172.21.15.63:0/4181237350 shutdown_connections 2023-12-01T15:43:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 -- 172.21.15.63:0/4181237350 wait complete. 2023-12-01T15:43:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 Processor -- start 2023-12-01T15:43:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 -- start start 2023-12-01T15:43:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0071ca0 0x7f6fe00a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe01325a0 0x7f6fe01c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6fe0132980 0x7f6fe01ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe01caa30 con 0x7f6fe0071ca0 2023-12-01T15:43:44.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.320+0000 7f6fe74d8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00a2670 con 0x7f6fe01325a0 2023-12-01T15:43:44.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe74d8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00a1aa0 con 0x7f6fe0132980 2023-12-01T15:43:44.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe64d6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0071ca0 0x7f6fe00a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:44.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe64d6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0071ca0 0x7f6fe00a2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53402/0 (socket says 172.21.15.63:53402) 2023-12-01T15:43:44.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe64d6700 1 -- 172.21.15.63:0/3621896713 learned_addr learned my addr 172.21.15.63:0/3621896713 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:44.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe6cd7700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6fe0132980 0x7f6fe01ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:44.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe5cd5700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe01325a0 0x7f6fe01c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:44.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe64d6700 1 -- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6fe0132980 msgr2=0x7f6fe01ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:44.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe64d6700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6fe0132980 0x7f6fe01ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:44.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe64d6700 1 -- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe01325a0 msgr2=0x7f6fe01c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:44.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe64d6700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe01325a0 0x7f6fe01c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:44.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe64d6700 1 -- 172.21.15.63:0/3621896713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd00094b0 con 0x7f6fe0071ca0 2023-12-01T15:43:44.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe5cd5700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe01325a0 0x7f6fe01c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:44.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe64d6700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0071ca0 0x7f6fe00a2130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c560 tx=0x7f6fdc00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:44.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fd6ffd700 1 -- 172.21.15.63:0/3621896713 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc005d90 con 0x7f6fe0071ca0 2023-12-01T15:43:44.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fd6ffd700 1 -- 172.21.15.63:0/3621896713 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc0070d0 con 0x7f6fe0071ca0 2023-12-01T15:43:44.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe74d8700 1 -- 172.21.15.63:0/3621896713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe009fa50 con 0x7f6fe0071ca0 2023-12-01T15:43:44.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fd6ffd700 1 -- 172.21.15.63:0/3621896713 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc007440 con 0x7f6fe0071ca0 2023-12-01T15:43:44.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe74d8700 1 -- 172.21.15.63:0/3621896713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe00a1750 con 0x7f6fe0071ca0 2023-12-01T15:43:44.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.324+0000 7f6fe74d8700 1 -- 172.21.15.63:0/3621896713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe00a29b0 con 0x7f6fe0071ca0 2023-12-01T15:43:44.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.328+0000 7f6fd6ffd700 1 -- 172.21.15.63:0/3621896713 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6fdc0075a0 con 0x7f6fe0071ca0 2023-12-01T15:43:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.328+0000 7f6fd6ffd700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fc4065ad0 0x7f6fc4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.328+0000 7f6fd6ffd700 1 -- 172.21.15.63:0/3621896713 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3852+0+0 (secure 0 0 0) 0x7f6fdc081d40 con 0x7f6fe0071ca0 2023-12-01T15:43:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.328+0000 7f6fe5cd5700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fc4065ad0 0x7f6fc4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.328+0000 7f6fe5cd5700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fc4065ad0 0x7f6fc4067f90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0072080 tx=0x7f6fd0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:44.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.336+0000 7f6fd6ffd700 1 -- 172.21.15.63:0/3621896713 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6fdc04ff00 con 0x7f6fe0071ca0 2023-12-01T15:43:44.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:44.504+0000 7f6fe74d8700 1 -- 172.21.15.63:0/3621896713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6fe0065fb0 con 0x7f6fe0071ca0 2023-12-01T15:43:45.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.180+0000 7f6fd6ffd700 1 -- 172.21.15.63:0/3621896713 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v17) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6fdc0170d0 con 0x7f6fe0071ca0 2023-12-01T15:43:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 -- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fc4065ad0 msgr2=0x7f6fc4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fc4065ad0 0x7f6fc4067f90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0072080 tx=0x7f6fd0008030 comp rx=0 tx=0).stop 2023-12-01T15:43:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 -- 172.21.15.63:0/3621896713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0071ca0 msgr2=0x7f6fe00a2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0071ca0 0x7f6fe00a2130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c560 tx=0x7f6fdc00c870 comp rx=0 tx=0).stop 2023-12-01T15:43:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 -- 172.21.15.63:0/3621896713 shutdown_connections 2023-12-01T15:43:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fc4065ad0 0x7f6fc4067f90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6fe0132980 0x7f6fe01ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe01325a0 0x7f6fe01c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 --2- 172.21.15.63:0/3621896713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0071ca0 0x7f6fe00a2130 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 -- 172.21.15.63:0/3621896713 >> 172.21.15.63:0/3621896713 conn(0x7f6fe00a96b0 msgr2=0x7f6fe00a75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 -- 172.21.15.63:0/3621896713 shutdown_connections 2023-12-01T15:43:45.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.188+0000 7f6fe74d8700 1 -- 172.21.15.63:0/3621896713 wait complete. 2023-12-01T15:43:45.198 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2023-12-01T15:43:45.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-01T15:43:45.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb51914b700 1 Processor -- start 2023-12-01T15:43:45.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb51914b700 1 -- start start 2023-12-01T15:43:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb51914b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5141354b0 0x7fb51406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb51914b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb514135890 0x7fb51409b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb51914b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb514070730 con 0x7fb51409b580 2023-12-01T15:43:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb51914b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51406fb30 con 0x7fb514135890 2023-12-01T15:43:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb51914b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51406f500 con 0x7fb5141354b0 2023-12-01T15:43:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb5137fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb514135890 0x7fb51409b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb51894a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb51409b580 0x7fb51413f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33674/0 (socket says 172.21.15.63:33674) 2023-12-01T15:43:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb51894a700 1 -- 172.21.15.63:0/817021176 learned_addr learned my addr 172.21.15.63:0/817021176 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb513fff700 1 --2- 172.21.15.63:0/817021176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5141354b0 0x7fb51406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb5137fe700 1 -- 172.21.15.63:0/817021176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5141354b0 msgr2=0x7fb51406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb5137fe700 1 --2- 172.21.15.63:0/817021176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5141354b0 0x7fb51406eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb5137fe700 1 -- 172.21.15.63:0/817021176 >> v1:172.21.15.63:6789/0 conn(0x7fb51409b580 legacy=0x7fb51413f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb5137fe700 1 -- 172.21.15.63:0/817021176 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb514070060 con 0x7fb514135890 2023-12-01T15:43:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb5137fe700 1 --2- 172.21.15.63:0/817021176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb514135890 0x7fb51409b040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb504009de0 tx=0x7fb50400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd66490c171b04f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb512ffd700 1 -- 172.21.15.63:0/817021176 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400e070 con 0x7fb514135890 2023-12-01T15:43:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb512ffd700 1 -- 172.21.15.63:0/817021176 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50400b910 con 0x7fb514135890 2023-12-01T15:43:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.320+0000 7fb512ffd700 1 -- 172.21.15.63:0/817021176 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400bcc0 con 0x7fb514135890 2023-12-01T15:43:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 -- 172.21.15.63:0/817021176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb514135890 msgr2=0x7fb51409b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 --2- 172.21.15.63:0/817021176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb514135890 0x7fb51409b040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb504009de0 tx=0x7fb50400b330 comp rx=0 tx=0).stop 2023-12-01T15:43:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 -- 172.21.15.63:0/817021176 shutdown_connections 2023-12-01T15:43:45.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 --2- 172.21.15.63:0/817021176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb514135890 0x7fb51409b040 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 --2- 172.21.15.63:0/817021176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5141354b0 0x7fb51406eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 -- 172.21.15.63:0/817021176 >> 172.21.15.63:0/817021176 conn(0x7fb5140738c0 msgr2=0x7fb5140aa840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 -- 172.21.15.63:0/817021176 shutdown_connections 2023-12-01T15:43:45.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 -- 172.21.15.63:0/817021176 wait complete. 2023-12-01T15:43:45.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 Processor -- start 2023-12-01T15:43:45.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 -- start start 2023-12-01T15:43:45.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb51409b580 0x7fb5141cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5141354b0 0x7fb5141cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb514135890 0x7fb5141cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb514133720 con 0x7fb514135890 2023-12-01T15:43:45.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.324+0000 7fb51914b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb514121050 con 0x7fb5141354b0 2023-12-01T15:43:45.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51914b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51406d1e0 con 0x7fb51409b580 2023-12-01T15:43:45.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51894a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb514135890 0x7fb5141cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51894a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb514135890 0x7fb5141cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53414/0 (socket says 172.21.15.63:53414) 2023-12-01T15:43:45.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51894a700 1 -- 172.21.15.63:0/806577105 learned_addr learned my addr 172.21.15.63:0/806577105 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:45.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb5137fe700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5141354b0 0x7fb5141cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb513fff700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb51409b580 0x7fb5141cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51894a700 1 -- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb51409b580 msgr2=0x7fb5141cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51894a700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb51409b580 0x7fb5141cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51894a700 1 -- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5141354b0 msgr2=0x7fb5141cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51894a700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5141354b0 0x7fb5141cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51894a700 1 -- 172.21.15.63:0/806577105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504009a70 con 0x7fb514135890 2023-12-01T15:43:45.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51894a700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb514135890 0x7fb5141cffe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00c450 tx=0x7fb50c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:45.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb510ff9700 1 -- 172.21.15.63:0/806577105 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c005d90 con 0x7fb514135890 2023-12-01T15:43:45.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb510ff9700 1 -- 172.21.15.63:0/806577105 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c00ce20 con 0x7fb514135890 2023-12-01T15:43:45.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51914b700 1 -- 172.21.15.63:0/806577105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5140a66e0 con 0x7fb514135890 2023-12-01T15:43:45.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb510ff9700 1 -- 172.21.15.63:0/806577105 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c0072d0 con 0x7fb514135890 2023-12-01T15:43:45.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51914b700 1 -- 172.21.15.63:0/806577105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5140a71a0 con 0x7fb514135890 2023-12-01T15:43:45.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.328+0000 7fb51914b700 1 -- 172.21.15.63:0/806577105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb514065fb0 con 0x7fb514135890 2023-12-01T15:43:45.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.332+0000 7fb510ff9700 1 -- 172.21.15.63:0/806577105 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb50c007430 con 0x7fb514135890 2023-12-01T15:43:45.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.332+0000 7fb510ff9700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4f4065ad0 0x7fb4f4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.332+0000 7fb510ff9700 1 -- 172.21.15.63:0/806577105 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4234+0+0 (secure 0 0 0) 0x7fb50c082590 con 0x7fb514135890 2023-12-01T15:43:45.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.332+0000 7fb513fff700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4f4065ad0 0x7fb4f4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.332+0000 7fb513fff700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4f4065ad0 0x7fb4f4067f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009b50 tx=0x7fb4fc009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:45.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.336+0000 7fb510ff9700 1 -- 172.21.15.63:0/806577105 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb50c050630 con 0x7fb514135890 2023-12-01T15:43:45.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.536+0000 7fb51914b700 1 -- 172.21.15.63:0/806577105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb51406eb80 con 0x7fb514135890 2023-12-01T15:43:45.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.552+0000 7fb510ff9700 1 -- 172.21.15.63:0/806577105 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb50c082070 con 0x7fb514135890 2023-12-01T15:43:45.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 -- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4f4065ad0 msgr2=0x7fb4f4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4f4065ad0 0x7fb4f4067f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009b50 tx=0x7fb4fc009240 comp rx=0 tx=0).stop 2023-12-01T15:43:45.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 -- 172.21.15.63:0/806577105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb514135890 msgr2=0x7fb5141cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb514135890 0x7fb5141cffe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00c450 tx=0x7fb50c00c760 comp rx=0 tx=0).stop 2023-12-01T15:43:45.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 -- 172.21.15.63:0/806577105 shutdown_connections 2023-12-01T15:43:45.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4f4065ad0 0x7fb4f4067f90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb514135890 0x7fb5141cffe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5141354b0 0x7fb5141cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 --2- 172.21.15.63:0/806577105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb51409b580 0x7fb5141cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 -- 172.21.15.63:0/806577105 >> 172.21.15.63:0/806577105 conn(0x7fb5140738c0 msgr2=0x7fb5141361f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:45.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 -- 172.21.15.63:0/806577105 shutdown_connections 2023-12-01T15:43:45.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.560+0000 7fb51914b700 1 -- 172.21.15.63:0/806577105 wait complete. 2023-12-01T15:43:45.577 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 3 and data pool 4 2023-12-01T15:43:45.594 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 Processor -- start 2023-12-01T15:43:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- start start 2023-12-01T15:43:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0b413b330 0x7fe0b4137790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b40a2890 con 0x7fe0b4137cd0 2023-12-01T15:43:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b40a4b20 con 0x7fe0b413af50 2023-12-01T15:43:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40a3540 con 0x7fe0b413b330 2023-12-01T15:43:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b37fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe0b4137cd0 0x7fe0b4142970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33678/0 (socket says 172.21.15.63:33678) 2023-12-01T15:43:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b37fe700 1 -- 172.21.15.63:0/16975525 learned_addr learned my addr 172.21.15.63:0/16975525 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b27fc700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0b413b330 0x7fe0b4137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936198737 0 0) 0x7fe0ac001110 con 0x7fe0b4137cd0 2023-12-01T15:43:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe09c0035d0 con 0x7fe0b4137cd0 2023-12-01T15:43:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3393343830 0 0) 0x7fe09c0035d0 con 0x7fe0b4137cd0 2023-12-01T15:43:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0b413b330 msgr2=0x7fe0b4137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0b413b330 0x7fe0b4137790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 >> v1:172.21.15.66:6789/0 conn(0x7fe0b413af50 legacy=0x7fe0b4137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b40a3880 con 0x7fe0b4137cd0 2023-12-01T15:43:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3363315130 0 0) 0x7fe0ac001800 con 0x7fe0b4137cd0 2023-12-01T15:43:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 >> v1:172.21.15.63:6789/0 conn(0x7fe0b4137cd0 legacy=0x7fe0b4142970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe09c003ac0 0x7fe09c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe09c004870 0x7fe09c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe09c005280 0x7fe09c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40a3540 con 0x7fe09c004870 2023-12-01T15:43:45.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c00bff0 con 0x7fe09c003ac0 2023-12-01T15:43:45.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c00c1b0 con 0x7fe09c005280 2023-12-01T15:43:45.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b2ffd700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe09c003ac0 0x7fe09c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b27fc700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe09c004870 0x7fe09c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b37fe700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe09c005280 0x7fe09c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b2ffd700 1 -- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe09c005280 msgr2=0x7fe09c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:45.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b2ffd700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe09c005280 0x7fe09c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b2ffd700 1 -- 172.21.15.63:0/16975525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe09c004870 msgr2=0x7fe09c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b2ffd700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe09c004870 0x7fe09c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b2ffd700 1 -- 172.21.15.63:0/16975525 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0035d0 con 0x7fe09c003ac0 2023-12-01T15:43:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b37fe700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe09c005280 0x7fe09c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b27fc700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe09c004870 0x7fe09c004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b2ffd700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe09c003ac0 0x7fe09c003ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80018e0 tx=0x7fe09c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba7ff5d363cb1621 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8001520 con 0x7fe09c003ac0 2023-12-01T15:43:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a8012620 con 0x7fe09c003ac0 2023-12-01T15:43:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b1ffb700 1 -- 172.21.15.63:0/16975525 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80129d0 con 0x7fe09c003ac0 2023-12-01T15:43:45.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe09c003ac0 msgr2=0x7fe09c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 --2- 172.21.15.63:0/16975525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe09c003ac0 0x7fe09c003ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80018e0 tx=0x7fe09c0058a0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b37fe700 1 -- 172.21.15.63:0/16975525 reap_dead start 2023-12-01T15:43:45.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- 172.21.15.63:0/16975525 shutdown_connections 2023-12-01T15:43:45.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- 172.21.15.63:0/16975525 >> 172.21.15.63:0/16975525 conn(0x7fe0b40a8bd0 msgr2=0x7fe0b4098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:45.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- 172.21.15.63:0/16975525 shutdown_connections 2023-12-01T15:43:45.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- 172.21.15.63:0/16975525 wait complete. 2023-12-01T15:43:45.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 Processor -- start 2023-12-01T15:43:45.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- start start 2023-12-01T15:43:45.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe09c003ac0 0x7fe0b4133240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0b4133780 0x7fe0b4133be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0b406f150 0x7fe0b406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b411f220 con 0x7fe0b406f150 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b411f450 con 0x7fe0b4133780 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.692+0000 7fe0b3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4071190 con 0x7fe09c003ac0 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0b406f150 0x7fe0b406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0b406f150 0x7fe0b406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53430/0 (socket says 172.21.15.63:53430) 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b37fe700 1 -- 172.21.15.63:0/2641831906 learned_addr learned my addr 172.21.15.63:0/2641831906 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b27fc700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0b4133780 0x7fe0b4133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b2ffd700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe09c003ac0 0x7fe0b4133240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b37fe700 1 -- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe09c003ac0 msgr2=0x7fe0b4133240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b37fe700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe09c003ac0 0x7fe0b4133240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b37fe700 1 -- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0b4133780 msgr2=0x7fe0b4133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b37fe700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0b4133780 0x7fe0b4133be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b37fe700 1 -- 172.21.15.63:0/2641831906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b411f790 con 0x7fe0b406f150 2023-12-01T15:43:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b37fe700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0b406f150 0x7fe0b406f5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0b406bc20 tx=0x7fe0ac007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe09b7fe700 1 -- 172.21.15.63:0/2641831906 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0114f0 con 0x7fe0b406f150 2023-12-01T15:43:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe09b7fe700 1 -- 172.21.15.63:0/2641831906 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac011650 con 0x7fe0b406f150 2023-12-01T15:43:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe09b7fe700 1 -- 172.21.15.63:0/2641831906 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac011a00 con 0x7fe0b406f150 2023-12-01T15:43:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b3fff700 1 -- 172.21.15.63:0/2641831906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b411fa50 con 0x7fe0b406f150 2023-12-01T15:43:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b3fff700 1 -- 172.21.15.63:0/2641831906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b4070dd0 con 0x7fe0b406f150 2023-12-01T15:43:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe0b3fff700 1 -- 172.21.15.63:0/2641831906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b4065fb0 con 0x7fe0b406f150 2023-12-01T15:43:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe09b7fe700 1 -- 172.21.15.63:0/2641831906 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe0ac011b60 con 0x7fe0b406f150 2023-12-01T15:43:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.696+0000 7fe09b7fe700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe0a0065b00 0x7fe0a0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.700+0000 7fe09b7fe700 1 -- 172.21.15.63:0/2641831906 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fe0ac082160 con 0x7fe0b406f150 2023-12-01T15:43:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.700+0000 7fe0b2ffd700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe0a0065b00 0x7fe0a0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.700+0000 7fe0b2ffd700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe0a0065b00 0x7fe0a0067fc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8014040 tx=0x7fe0a8005040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.704+0000 7fe09b7fe700 1 -- 172.21.15.63:0/2641831906 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe0ac050110 con 0x7fe0b406f150 2023-12-01T15:43:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.864+0000 7fe0b3fff700 1 -- 172.21.15.63:0/2641831906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0b40a2890 con 0x7fe0b406f150 2023-12-01T15:43:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.868+0000 7fe09b7fe700 1 -- 172.21.15.63:0/2641831906 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13193 (secure 0 0 0) 0x7fe0b40a2890 con 0x7fe0b406f150 2023-12-01T15:43:45.875 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:45.875 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":18,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:45.544154+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 -- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe0a0065b00 msgr2=0x7fe0a0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe0a0065b00 0x7fe0a0067fc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8014040 tx=0x7fe0a8005040 comp rx=0 tx=0).stop 2023-12-01T15:43:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 -- 172.21.15.63:0/2641831906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0b406f150 msgr2=0x7fe0b406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0b406f150 0x7fe0b406f5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0b406bc20 tx=0x7fe0ac007330 comp rx=0 tx=0).stop 2023-12-01T15:43:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 -- 172.21.15.63:0/2641831906 shutdown_connections 2023-12-01T15:43:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe0a0065b00 0x7fe0a0067fc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0b406f150 0x7fe0b406f5d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0b4133780 0x7fe0b4133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 --2- 172.21.15.63:0/2641831906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe09c003ac0 0x7fe0b4133240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 -- 172.21.15.63:0/2641831906 >> 172.21.15.63:0/2641831906 conn(0x7fe0b40a8bd0 msgr2=0x7fe0b4098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 -- 172.21.15.63:0/2641831906 shutdown_connections 2023-12-01T15:43:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:45.872+0000 7fe0b3fff700 1 -- 172.21.15.63:0/2641831906 wait complete. 2023-12-01T15:43:45.896 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:46.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 Processor -- start 2023-12-01T15:43:46.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- start start 2023-12-01T15:43:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6a501376e0 0x7f6a50137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a5006c5b0 0x7f6a501428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5009c240 con 0x7f6a5006ba50 2023-12-01T15:43:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a50138000 con 0x7f6a5006c5b0 2023-12-01T15:43:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5009bc90 con 0x7f6a501376e0 2023-12-01T15:43:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a552e0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a5006c5b0 0x7f6a501428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a552e0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a5006c5b0 0x7f6a501428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53446/0 (socket says 172.21.15.63:53446) 2023-12-01T15:43:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a552e0700 1 -- 172.21.15.63:0/1961985924 learned_addr learned my addr 172.21.15.63:0/1961985924 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a54adf700 1 --2- 172.21.15.63:0/1961985924 >> v2:172.21.15.66:3300/0 conn(0x7f6a501376e0 0x7f6a50137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a552e0700 1 -- 172.21.15.63:0/1961985924 >> v2:172.21.15.66:3300/0 conn(0x7f6a501376e0 msgr2=0x7f6a50137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a552e0700 1 --2- 172.21.15.63:0/1961985924 >> v2:172.21.15.66:3300/0 conn(0x7f6a501376e0 0x7f6a50137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a552e0700 1 -- 172.21.15.63:0/1961985924 >> v1:172.21.15.66:6789/0 conn(0x7f6a5006ba50 legacy=0x7f6a5006bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a552e0700 1 -- 172.21.15.63:0/1961985924 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5009bf80 con 0x7f6a5006c5b0 2023-12-01T15:43:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a54adf700 1 --2- 172.21.15.63:0/1961985924 >> v2:172.21.15.66:3300/0 conn(0x7f6a501376e0 0x7f6a50137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a552e0700 1 --2- 172.21.15.63:0/1961985924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a5006c5b0 0x7f6a501428c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a5006d2e0 tx=0x7f6a4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0af77c65d06fbe6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a4f7fe700 1 -- 172.21.15.63:0/1961985924 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800e070 con 0x7f6a5006c5b0 2023-12-01T15:43:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a4f7fe700 1 -- 172.21.15.63:0/1961985924 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4800b9c0 con 0x7f6a5006c5b0 2023-12-01T15:43:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a4f7fe700 1 -- 172.21.15.63:0/1961985924 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800bd70 con 0x7f6a5006c5b0 2023-12-01T15:43:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- 172.21.15.63:0/1961985924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a5006c5b0 msgr2=0x7f6a501428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 --2- 172.21.15.63:0/1961985924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a5006c5b0 0x7f6a501428c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a5006d2e0 tx=0x7f6a4800b330 comp rx=0 tx=0).stop 2023-12-01T15:43:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- 172.21.15.63:0/1961985924 shutdown_connections 2023-12-01T15:43:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 --2- 172.21.15.63:0/1961985924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a5006c5b0 0x7f6a501428c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 --2- 172.21.15.63:0/1961985924 >> v2:172.21.15.66:3300/0 conn(0x7f6a501376e0 0x7f6a50137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- 172.21.15.63:0/1961985924 >> 172.21.15.63:0/1961985924 conn(0x7f6a500737a0 msgr2=0x7f6a500ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:46.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- 172.21.15.63:0/1961985924 shutdown_connections 2023-12-01T15:43:46.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- 172.21.15.63:0/1961985924 wait complete. 2023-12-01T15:43:46.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 Processor -- start 2023-12-01T15:43:46.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- start start 2023-12-01T15:43:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a5006ba50 0x7f6a50135bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6a5006c5b0 0x7f6a501360f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a501376e0 0x7f6a501cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a50123b10 con 0x7f6a501376e0 2023-12-01T15:43:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a50123d90 con 0x7f6a5006ba50 2023-12-01T15:43:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.004+0000 7f6a55ae1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a50124e70 con 0x7f6a5006c5b0 2023-12-01T15:43:46.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a552e0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a501376e0 0x7f6a501cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a552e0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a501376e0 0x7f6a501cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53460/0 (socket says 172.21.15.63:53460) 2023-12-01T15:43:46.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a552e0700 1 -- 172.21.15.63:0/3677583029 learned_addr learned my addr 172.21.15.63:0/3677583029 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:46.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a54adf700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a5006ba50 0x7f6a50135bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a4ffff700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6a5006c5b0 0x7f6a501360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a552e0700 1 -- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6a5006c5b0 msgr2=0x7f6a501360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:46.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a552e0700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6a5006c5b0 0x7f6a501360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a552e0700 1 -- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a5006ba50 msgr2=0x7f6a50135bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:46.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a552e0700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a5006ba50 0x7f6a50135bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a552e0700 1 -- 172.21.15.63:0/3677583029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48009b30 con 0x7f6a501376e0 2023-12-01T15:43:46.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a4ffff700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6a5006c5b0 0x7f6a501360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:46.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a552e0700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a501376e0 0x7f6a501cf430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a500ad960 tx=0x7f6a48004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:46.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a4d7fa700 1 -- 172.21.15.63:0/3677583029 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48004930 con 0x7f6a501376e0 2023-12-01T15:43:46.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a4d7fa700 1 -- 172.21.15.63:0/3677583029 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a480099b0 con 0x7f6a501376e0 2023-12-01T15:43:46.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a55ae1700 1 -- 172.21.15.63:0/3677583029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a500a9170 con 0x7f6a501376e0 2023-12-01T15:43:46.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a4d7fa700 1 -- 172.21.15.63:0/3677583029 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4801c680 con 0x7f6a501376e0 2023-12-01T15:43:46.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a55ae1700 1 -- 172.21.15.63:0/3677583029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a50136740 con 0x7f6a501376e0 2023-12-01T15:43:46.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.008+0000 7f6a55ae1700 1 -- 172.21.15.63:0/3677583029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a50065fb0 con 0x7f6a501376e0 2023-12-01T15:43:46.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.012+0000 7f6a4d7fa700 1 -- 172.21.15.63:0/3677583029 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a4801c7e0 con 0x7f6a501376e0 2023-12-01T15:43:46.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.012+0000 7f6a4d7fa700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6a3c065ad0 0x7f6a3c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.012+0000 7f6a4d7fa700 1 -- 172.21.15.63:0/3677583029 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f6a48084900 con 0x7f6a501376e0 2023-12-01T15:43:46.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.012+0000 7f6a54adf700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6a3c065ad0 0x7f6a3c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.012+0000 7f6a54adf700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6a3c065ad0 0x7f6a3c067f90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6a400044b0 tx=0x7f6a40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:46.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.020+0000 7f6a4d7fa700 1 -- 172.21.15.63:0/3677583029 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6a48052790 con 0x7f6a501376e0 2023-12-01T15:43:46.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.184+0000 7f6a55ae1700 1 -- 172.21.15.63:0/3677583029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a50066880 con 0x7f6a501376e0 2023-12-01T15:43:46.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.188+0000 7f6a4d7fa700 1 -- 172.21.15.63:0/3677583029 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13193 (secure 0 0 0) 0x7f6a48055db0 con 0x7f6a501376e0 2023-12-01T15:43:46.195 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:46.195 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":18,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:45.544154+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:46.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 -- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6a3c065ad0 msgr2=0x7f6a3c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:46.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6a3c065ad0 0x7f6a3c067f90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6a400044b0 tx=0x7f6a40008040 comp rx=0 tx=0).stop 2023-12-01T15:43:46.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 -- 172.21.15.63:0/3677583029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a501376e0 msgr2=0x7f6a501cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:46.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a501376e0 0x7f6a501cf430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a500ad960 tx=0x7f6a48004af0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 -- 172.21.15.63:0/3677583029 shutdown_connections 2023-12-01T15:43:46.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6a3c065ad0 0x7f6a3c067f90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6a5006c5b0 0x7f6a501360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a501376e0 0x7f6a501cf430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 --2- 172.21.15.63:0/3677583029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a5006ba50 0x7f6a50135bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 -- 172.21.15.63:0/3677583029 >> 172.21.15.63:0/3677583029 conn(0x7f6a500737a0 msgr2=0x7f6a500a20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:46.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 -- 172.21.15.63:0/3677583029 shutdown_connections 2023-12-01T15:43:46.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.192+0000 7f6a55ae1700 1 -- 172.21.15.63:0/3677583029 wait complete. 2023-12-01T15:43:46.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-01T15:43:46.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 Processor -- start 2023-12-01T15:43:46.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 -- start start 2023-12-01T15:43:46.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e9c06ba50 0x7f7e9c06be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7e9c06c370 0x7f7e9c13f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7e9c13f590 0x7f7e9c141980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c072830 con 0x7f7e9c06c370 2023-12-01T15:43:46.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c09c320 con 0x7f7e9c13f590 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c09b150 con 0x7f7e9c06ba50 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9a7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7e9c06c370 0x7f7e9c13f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9a7fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7e9c06c370 0x7f7e9c13f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46632/0 (socket says 172.21.15.63:46632) 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9a7fc700 1 -- 172.21.15.63:0/4213231427 learned_addr learned my addr 172.21.15.63:0/4213231427 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9b7fe700 1 --2- 172.21.15.63:0/4213231427 >> v2:172.21.15.66:3300/0 conn(0x7f7e9c13f590 0x7f7e9c141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9affd700 1 --2- 172.21.15.63:0/4213231427 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e9c06ba50 0x7f7e9c06be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9a7fc700 1 -- 172.21.15.63:0/4213231427 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e9c06ba50 msgr2=0x7f7e9c06be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9a7fc700 1 --2- 172.21.15.63:0/4213231427 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e9c06ba50 0x7f7e9c06be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9a7fc700 1 -- 172.21.15.63:0/4213231427 >> v2:172.21.15.66:3300/0 conn(0x7f7e9c13f590 msgr2=0x7f7e9c141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9a7fc700 1 --2- 172.21.15.63:0/4213231427 >> v2:172.21.15.66:3300/0 conn(0x7f7e9c13f590 0x7f7e9c141980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9a7fc700 1 -- 172.21.15.63:0/4213231427 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c09d1e0 con 0x7f7e9c06c370 2023-12-01T15:43:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9a7fc700 1 --2- 172.21.15.63:0/4213231427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e9c06c370 0x7f7e9c13f050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0ab6d0 tx=0x7f7e90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f2d5ef23ac7689 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:46.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e99ffb700 1 -- 172.21.15.63:0/4213231427 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e90005e50 con 0x7f7e9c06c370 2023-12-01T15:43:46.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e99ffb700 1 -- 172.21.15.63:0/4213231427 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e90006030 con 0x7f7e9c06c370 2023-12-01T15:43:46.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e99ffb700 1 -- 172.21.15.63:0/4213231427 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e900063c0 con 0x7f7e9c06c370 2023-12-01T15:43:46.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 -- 172.21.15.63:0/4213231427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e9c06c370 msgr2=0x7f7e9c13f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:46.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 --2- 172.21.15.63:0/4213231427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e9c06c370 0x7f7e9c13f050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0ab6d0 tx=0x7f7e90009bf0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 -- 172.21.15.63:0/4213231427 shutdown_connections 2023-12-01T15:43:46.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 --2- 172.21.15.63:0/4213231427 >> v2:172.21.15.66:3300/0 conn(0x7f7e9c13f590 0x7f7e9c141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 --2- 172.21.15.63:0/4213231427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e9c06c370 0x7f7e9c13f050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 --2- 172.21.15.63:0/4213231427 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e9c06ba50 0x7f7e9c06be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.332+0000 7f7e9bfff700 1 -- 172.21.15.63:0/4213231427 >> 172.21.15.63:0/4213231427 conn(0x7f7e9c0738c0 msgr2=0x7f7e9c0aa840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:46.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9bfff700 1 -- 172.21.15.63:0/4213231427 shutdown_connections 2023-12-01T15:43:46.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9bfff700 1 -- 172.21.15.63:0/4213231427 wait complete. 2023-12-01T15:43:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9bfff700 1 Processor -- start 2023-12-01T15:43:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9bfff700 1 -- start start 2023-12-01T15:43:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e9c06ba50 0x7f7e9c135fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e9c06c370 0x7f7e9c136520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e9c13f590 0x7f7e9c136a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9bfff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0a4300 con 0x7f7e9c06ba50 2023-12-01T15:43:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0a3cf0 con 0x7f7e9c06c370 2023-12-01T15:43:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0a51a0 con 0x7f7e9c13f590 2023-12-01T15:43:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e9c06ba50 0x7f7e9c135fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e9c06ba50 0x7f7e9c135fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46648/0 (socket says 172.21.15.63:46648) 2023-12-01T15:43:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9affd700 1 -- 172.21.15.63:0/3942204537 learned_addr learned my addr 172.21.15.63:0/3942204537 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9a7fc700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e9c06c370 0x7f7e9c136520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9b7fe700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e9c13f590 0x7f7e9c136a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9affd700 1 -- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e9c13f590 msgr2=0x7f7e9c136a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:46.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9affd700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e9c13f590 0x7f7e9c136a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9affd700 1 -- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e9c06c370 msgr2=0x7f7e9c136520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:46.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9affd700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e9c06c370 0x7f7e9c136520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:46.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.336+0000 7f7e9affd700 1 -- 172.21.15.63:0/3942204537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90009520 con 0x7f7e9c06ba50 2023-12-01T15:43:46.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.340+0000 7f7e9affd700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e9c06ba50 0x7f7e9c135fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00e790 tx=0x7f7e8c00eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:46.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.340+0000 7f7e837fe700 1 -- 172.21.15.63:0/3942204537 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00c070 con 0x7f7e9c06ba50 2023-12-01T15:43:46.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.340+0000 7f7e837fe700 1 -- 172.21.15.63:0/3942204537 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c013610 con 0x7f7e9c06ba50 2023-12-01T15:43:46.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.340+0000 7f7e9bfff700 1 -- 172.21.15.63:0/3942204537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c0a3a50 con 0x7f7e9c06ba50 2023-12-01T15:43:46.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.340+0000 7f7e837fe700 1 -- 172.21.15.63:0/3942204537 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c013980 con 0x7f7e9c06ba50 2023-12-01T15:43:46.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.340+0000 7f7e9bfff700 1 -- 172.21.15.63:0/3942204537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c0716a0 con 0x7f7e9c06ba50 2023-12-01T15:43:46.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.340+0000 7f7e9bfff700 1 -- 172.21.15.63:0/3942204537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c065fb0 con 0x7f7e9c06ba50 2023-12-01T15:43:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.340+0000 7f7e837fe700 1 -- 172.21.15.63:0/3942204537 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e8c013ae0 con 0x7f7e9c06ba50 2023-12-01T15:43:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.344+0000 7f7e837fe700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e88065ad0 0x7f7e88067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.344+0000 7f7e837fe700 1 -- 172.21.15.63:0/3942204537 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f7e8c082960 con 0x7f7e9c06ba50 2023-12-01T15:43:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.344+0000 7f7e9a7fc700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e88065ad0 0x7f7e88067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:46.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.344+0000 7f7e9a7fc700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e88065ad0 0x7f7e88067f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7e90000c00 tx=0x7f7e90008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:46.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.352+0000 7f7e837fe700 1 -- 172.21.15.63:0/3942204537 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f7e8c050870 con 0x7f7e9c06ba50 2023-12-01T15:43:46.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:46.552+0000 7f7e9bfff700 1 -- 172.21.15.63:0/3942204537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7e9c061d90 con 0x7f7e9c06ba50 2023-12-01T15:43:47.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.564+0000 7f7e837fe700 1 -- 172.21.15.63:0/3942204537 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7e8c053e90 con 0x7f7e9c06ba50 2023-12-01T15:43:47.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 -- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e88065ad0 msgr2=0x7f7e88067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:47.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e88065ad0 0x7f7e88067f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7e90000c00 tx=0x7f7e90008070 comp rx=0 tx=0).stop 2023-12-01T15:43:47.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 -- 172.21.15.63:0/3942204537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e9c06ba50 msgr2=0x7f7e9c135fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:47.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e9c06ba50 0x7f7e9c135fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00e790 tx=0x7f7e8c00eaa0 comp rx=0 tx=0).stop 2023-12-01T15:43:47.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 -- 172.21.15.63:0/3942204537 shutdown_connections 2023-12-01T15:43:47.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e88065ad0 0x7f7e88067f90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:47.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e9c13f590 0x7f7e9c136a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:47.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e9c06c370 0x7f7e9c136520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:47.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 --2- 172.21.15.63:0/3942204537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e9c06ba50 0x7f7e9c135fe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:47.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 -- 172.21.15.63:0/3942204537 >> 172.21.15.63:0/3942204537 conn(0x7f7e9c0738c0 msgr2=0x7f7e9c13ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:47.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 -- 172.21.15.63:0/3942204537 shutdown_connections 2023-12-01T15:43:47.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.568+0000 7f7e9bfff700 1 -- 172.21.15.63:0/3942204537 wait complete. 2023-12-01T15:43:47.591 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-01T15:43:47.592 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-01T15:43:47.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.708+0000 7f51bf59e700 1 Processor -- start 2023-12-01T15:43:47.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 -- start start 2023-12-01T15:43:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51c01347d0 0x7f51c006e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f51c0137d40 0x7f51c013f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c0134610 con 0x7f51c0134bb0 2023-12-01T15:43:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c0070010 con 0x7f51c0137d40 2023-12-01T15:43:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c006f360 con 0x7f51c01347d0 2023-12-01T15:43:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bdd9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f51c0134bb0 0x7f51c0137630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41944/0 (socket says 172.21.15.63:41944) 2023-12-01T15:43:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bdd9b700 1 -- 172.21.15.63:0/3666877639 learned_addr learned my addr 172.21.15.63:0/3666877639 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bed9d700 1 --2- 172.21.15.63:0/3666877639 >> v2:172.21.15.66:3300/0 conn(0x7f51c0137d40 0x7f51c013f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51be59c700 1 --2- 172.21.15.63:0/3666877639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51c01347d0 0x7f51c006e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bd59a700 1 -- 172.21.15.63:0/3666877639 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587887027 0 0) 0x7f51c0134610 con 0x7f51c0134bb0 2023-12-01T15:43:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bd59a700 1 -- 172.21.15.63:0/3666877639 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a80035d0 con 0x7f51c0134bb0 2023-12-01T15:43:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bed9d700 1 -- 172.21.15.63:0/3666877639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51c01347d0 msgr2=0x7f51c006e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bed9d700 1 --2- 172.21.15.63:0/3666877639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51c01347d0 0x7f51c006e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bed9d700 1 -- 172.21.15.63:0/3666877639 >> v1:172.21.15.63:6789/0 conn(0x7f51c0134bb0 legacy=0x7f51c0137630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bed9d700 1 -- 172.21.15.63:0/3666877639 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c006db00 con 0x7f51c0137d40 2023-12-01T15:43:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bed9d700 1 --2- 172.21.15.63:0/3666877639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51c0137d40 0x7f51c013f970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009dc0 tx=0x7f51b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f47ab399756343c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bd59a700 1 -- 172.21.15.63:0/3666877639 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b800e070 con 0x7f51c0137d40 2023-12-01T15:43:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bd59a700 1 -- 172.21.15.63:0/3666877639 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b800bae0 con 0x7f51c0137d40 2023-12-01T15:43:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bd59a700 1 -- 172.21.15.63:0/3666877639 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b800be50 con 0x7f51c0137d40 2023-12-01T15:43:47.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 -- 172.21.15.63:0/3666877639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51c0137d40 msgr2=0x7f51c013f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:47.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 --2- 172.21.15.63:0/3666877639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51c0137d40 0x7f51c013f970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009dc0 tx=0x7f51b800b330 comp rx=0 tx=0).stop 2023-12-01T15:43:47.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 -- 172.21.15.63:0/3666877639 shutdown_connections 2023-12-01T15:43:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 --2- 172.21.15.63:0/3666877639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51c0137d40 0x7f51c013f970 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 --2- 172.21.15.63:0/3666877639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51c01347d0 0x7f51c006e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 -- 172.21.15.63:0/3666877639 >> 172.21.15.63:0/3666877639 conn(0x7f51c00a96b0 msgr2=0x7f51c00a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 -- 172.21.15.63:0/3666877639 shutdown_connections 2023-12-01T15:43:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.712+0000 7f51bf59e700 1 -- 172.21.15.63:0/3666877639 wait complete. 2023-12-01T15:43:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51bf59e700 1 Processor -- start 2023-12-01T15:43:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51bf59e700 1 -- start start 2023-12-01T15:43:47.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51bf59e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51c01347d0 0x7f51c01322a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:47.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51bf59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51c0134bb0 0x7f51c01327e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:47.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51bf59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51c0137d40 0x7f51c0132d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:47.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51bf59e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00a6180 con 0x7f51c01347d0 2023-12-01T15:43:47.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51bf59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0135290 con 0x7f51c0137d40 2023-12-01T15:43:47.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51bf59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00a5f50 con 0x7f51c0134bb0 2023-12-01T15:43:47.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51be59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51c01347d0 0x7f51c01322a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:47.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51be59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51c01347d0 0x7f51c01322a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46664/0 (socket says 172.21.15.63:46664) 2023-12-01T15:43:47.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51be59c700 1 -- 172.21.15.63:0/3386840448 learned_addr learned my addr 172.21.15.63:0/3386840448 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:47.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51bed9d700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51c0137d40 0x7f51c0132d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:47.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51bdd9b700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51c0134bb0 0x7f51c01327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:47.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51be59c700 1 -- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51c0134bb0 msgr2=0x7f51c01327e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:47.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51be59c700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51c0134bb0 0x7f51c01327e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:47.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51be59c700 1 -- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51c0137d40 msgr2=0x7f51c0132d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:47.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51be59c700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51c0137d40 0x7f51c0132d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:47.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51be59c700 1 -- 172.21.15.63:0/3386840448 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8009a70 con 0x7f51c01347d0 2023-12-01T15:43:47.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51bdd9b700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51c0134bb0 0x7f51c01327e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:47.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.716+0000 7f51be59c700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51c01347d0 0x7f51c01322a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f51b000e870 tx=0x7f51b000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:47.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.720+0000 7f51aeffd700 1 -- 172.21.15.63:0/3386840448 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00095a0 con 0x7f51c01347d0 2023-12-01T15:43:47.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.720+0000 7f51aeffd700 1 -- 172.21.15.63:0/3386840448 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b000ee70 con 0x7f51c01347d0 2023-12-01T15:43:47.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.720+0000 7f51bf59e700 1 -- 172.21.15.63:0/3386840448 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c00a6b30 con 0x7f51c01347d0 2023-12-01T15:43:47.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.720+0000 7f51aeffd700 1 -- 172.21.15.63:0/3386840448 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000ca50 con 0x7f51c01347d0 2023-12-01T15:43:47.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.720+0000 7f51bf59e700 1 -- 172.21.15.63:0/3386840448 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c00a6e40 con 0x7f51c01347d0 2023-12-01T15:43:47.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.720+0000 7f51aeffd700 1 -- 172.21.15.63:0/3386840448 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f51b000cbb0 con 0x7f51c01347d0 2023-12-01T15:43:47.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.720+0000 7f51bf59e700 1 -- 172.21.15.63:0/3386840448 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c0120a40 con 0x7f51c01347d0 2023-12-01T15:43:47.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.720+0000 7f51aeffd700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f51a0065ad0 0x7f51a0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:47.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.720+0000 7f51aeffd700 1 -- 172.21.15.63:0/3386840448 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f51b0082b00 con 0x7f51c01347d0 2023-12-01T15:43:47.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.720+0000 7f51bdd9b700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f51a0065ad0 0x7f51a0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:47.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.724+0000 7f51bdd9b700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f51a0065ad0 0x7f51a0067f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f51c00a85b0 tx=0x7f51b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:47.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.728+0000 7f51aeffd700 1 -- 172.21.15.63:0/3386840448 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f51b0050a30 con 0x7f51c01347d0 2023-12-01T15:43:47.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:47.924+0000 7f51bf59e700 1 -- 172.21.15.63:0/3386840448 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f51c0065f70 con 0x7f51c01347d0 2023-12-01T15:43:48.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.568+0000 7f51aeffd700 1 -- 172.21.15.63:0/3386840448 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f51b0054050 con 0x7f51c01347d0 2023-12-01T15:43:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 -- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f51a0065ad0 msgr2=0x7f51a0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f51a0065ad0 0x7f51a0067f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f51c00a85b0 tx=0x7f51b4009040 comp rx=0 tx=0).stop 2023-12-01T15:43:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 -- 172.21.15.63:0/3386840448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51c01347d0 msgr2=0x7f51c01322a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51c01347d0 0x7f51c01322a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f51b000e870 tx=0x7f51b000ec30 comp rx=0 tx=0).stop 2023-12-01T15:43:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 -- 172.21.15.63:0/3386840448 shutdown_connections 2023-12-01T15:43:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f51a0065ad0 0x7f51a0067f90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51c0134bb0 0x7f51c01327e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51c0137d40 0x7f51c0132d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 --2- 172.21.15.63:0/3386840448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51c01347d0 0x7f51c01322a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 -- 172.21.15.63:0/3386840448 >> 172.21.15.63:0/3386840448 conn(0x7f51c00a96b0 msgr2=0x7f51c009af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:48.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 -- 172.21.15.63:0/3386840448 shutdown_connections 2023-12-01T15:43:48.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.572+0000 7f51bf59e700 1 -- 172.21.15.63:0/3386840448 wait complete. 2023-12-01T15:43:48.593 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-01T15:43:48.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T15:43:48.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.704+0000 7f8a6c9a1700 1 Processor -- start 2023-12-01T15:43:48.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.704+0000 7f8a6c9a1700 1 -- start start 2023-12-01T15:43:48.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a68134ad0 0x7f8a68137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:48.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8a6813d6e0 0x7f8a6813fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:48.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6806f450 con 0x7f8a681346f0 2023-12-01T15:43:48.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6806f9e0 con 0x7f8a6813d6e0 2023-12-01T15:43:48.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68099ec0 con 0x7f8a68134ad0 2023-12-01T15:43:48.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a67fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8a6813d6e0 0x7f8a6813fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:48.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a68134ad0 0x7f8a68137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:48.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a67fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8a6813d6e0 0x7f8a6813fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:48316/0 (socket says 172.21.15.63:48316) 2023-12-01T15:43:48.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a68134ad0 0x7f8a68137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:54642/0 (socket says 172.21.15.63:54642) 2023-12-01T15:43:48.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a67fff700 1 -- 172.21.15.63:0/2511686303 learned_addr learned my addr 172.21.15.63:0/2511686303 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:48.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a66ffd700 1 -- 172.21.15.63:0/2511686303 >> v2:172.21.15.66:3300/0 conn(0x7f8a6813d6e0 msgr2=0x7f8a6813fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:48.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/2511686303 >> v2:172.21.15.66:3300/0 conn(0x7f8a6813d6e0 0x7f8a6813fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a66ffd700 1 -- 172.21.15.63:0/2511686303 >> v1:172.21.15.66:6789/0 conn(0x7f8a681346f0 legacy=0x7f8a681373b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a66ffd700 1 -- 172.21.15.63:0/2511686303 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6806e760 con 0x7f8a68134ad0 2023-12-01T15:43:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/2511686303 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a68134ad0 0x7f8a68137ac0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009850 tx=0x7f8a58009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a891feb26f8bb133 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a667fc700 1 -- 172.21.15.63:0/2511686303 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58011830 con 0x7f8a68134ad0 2023-12-01T15:43:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a667fc700 1 -- 172.21.15.63:0/2511686303 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a58011990 con 0x7f8a68134ad0 2023-12-01T15:43:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a667fc700 1 -- 172.21.15.63:0/2511686303 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58011d40 con 0x7f8a68134ad0 2023-12-01T15:43:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/2511686303 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a68134ad0 msgr2=0x7f8a68137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 --2- 172.21.15.63:0/2511686303 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a68134ad0 0x7f8a68137ac0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009850 tx=0x7f8a58009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/2511686303 shutdown_connections 2023-12-01T15:43:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 --2- 172.21.15.63:0/2511686303 >> v2:172.21.15.66:3300/0 conn(0x7f8a6813d6e0 0x7f8a6813fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 --2- 172.21.15.63:0/2511686303 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a68134ad0 0x7f8a68137ac0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/2511686303 >> 172.21.15.63:0/2511686303 conn(0x7f8a680a96b0 msgr2=0x7f8a680a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:48.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/2511686303 shutdown_connections 2023-12-01T15:43:48.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.708+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/2511686303 wait complete. 2023-12-01T15:43:48.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a6c9a1700 1 Processor -- start 2023-12-01T15:43:48.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a6c9a1700 1 -- start start 2023-12-01T15:43:48.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a6c9a1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a681346f0 0x7f8a6812f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:48.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a6c9a1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a68134ad0 0x7f8a6812f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:48.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a6c9a1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a6813d6e0 0x7f8a681cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:48.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a6c9a1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6813c940 con 0x7f8a68134ad0 2023-12-01T15:43:48.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a6c9a1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6813ce10 con 0x7f8a681346f0 2023-12-01T15:43:48.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a6c9a1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a680a6f90 con 0x7f8a6813d6e0 2023-12-01T15:43:48.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a68134ad0 0x7f8a6812f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:48.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a68134ad0 0x7f8a6812f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46672/0 (socket says 172.21.15.63:46672) 2023-12-01T15:43:48.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a66ffd700 1 -- 172.21.15.63:0/4073963356 learned_addr learned my addr 172.21.15.63:0/4073963356 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:48.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a67fff700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a6813d6e0 0x7f8a681cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:48.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a677fe700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a681346f0 0x7f8a6812f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:48.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a66ffd700 1 -- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a6813d6e0 msgr2=0x7f8a681cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:48.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a6813d6e0 0x7f8a681cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a66ffd700 1 -- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a681346f0 msgr2=0x7f8a6812f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:48.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a681346f0 0x7f8a6812f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a66ffd700 1 -- 172.21.15.63:0/4073963356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a580094b0 con 0x7f8a68134ad0 2023-12-01T15:43:48.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a66ffd700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a68134ad0 0x7f8a6812f780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8a58014040 tx=0x7f8a58004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:48.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a4ffff700 1 -- 172.21.15.63:0/4073963356 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a580036c0 con 0x7f8a68134ad0 2023-12-01T15:43:48.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a4ffff700 1 -- 172.21.15.63:0/4073963356 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5801e070 con 0x7f8a68134ad0 2023-12-01T15:43:48.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/4073963356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6813ba40 con 0x7f8a68134ad0 2023-12-01T15:43:48.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a4ffff700 1 -- 172.21.15.63:0/4073963356 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58003a80 con 0x7f8a68134ad0 2023-12-01T15:43:48.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.712+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/4073963356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6813d0d0 con 0x7f8a68134ad0 2023-12-01T15:43:48.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.716+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/4073963356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a68065fb0 con 0x7f8a68134ad0 2023-12-01T15:43:48.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.716+0000 7f8a4ffff700 1 -- 172.21.15.63:0/4073963356 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8a58003be0 con 0x7f8a68134ad0 2023-12-01T15:43:48.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.716+0000 7f8a4ffff700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8a54065ad0 0x7f8a54067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:48.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.716+0000 7f8a4ffff700 1 -- 172.21.15.63:0/4073963356 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f8a58020070 con 0x7f8a68134ad0 2023-12-01T15:43:48.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.716+0000 7f8a677fe700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8a54065ad0 0x7f8a54067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:48.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.716+0000 7f8a677fe700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8a54065ad0 0x7f8a54067f90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c000f60 tx=0x7f8a5c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.724+0000 7f8a4ffff700 1 -- 172.21.15.63:0/4073963356 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f8a58051f30 con 0x7f8a68134ad0 2023-12-01T15:43:48.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.928+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/4073963356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a68061d90 con 0x7f8a68134ad0 2023-12-01T15:43:48.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.928+0000 7f8a4ffff700 1 -- 172.21.15.63:0/4073963356 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3130 (secure 0 0 0) 0x7f8a58015020 con 0x7f8a68134ad0 2023-12-01T15:43:48.932 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:48.932 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6817/2060518783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2060518783},{"type":"v1","addr":"172.21.15.63:6817","nonce":2060518783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T15:43:45.544844+0000","modified":"2023-12-01T15:43:48.562365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6819/2416365697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2416365697},{"type":"v1","addr":"172.21.15.66:6819","nonce":2416365697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T15:43:48.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.928+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8a54065ad0 msgr2=0x7f8a54067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:48.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.928+0000 7f8a6c9a1700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8a54065ad0 0x7f8a54067f90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c000f60 tx=0x7f8a5c009040 comp rx=0 tx=0).stop 2023-12-01T15:43:48.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.928+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/4073963356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a68134ad0 msgr2=0x7f8a6812f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:48.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.928+0000 7f8a6c9a1700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a68134ad0 0x7f8a6812f780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8a58014040 tx=0x7f8a58004770 comp rx=0 tx=0).stop 2023-12-01T15:43:48.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.932+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/4073963356 shutdown_connections 2023-12-01T15:43:48.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.932+0000 7f8a6c9a1700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f8a54065ad0 0x7f8a54067f90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.932+0000 7f8a6c9a1700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a6813d6e0 0x7f8a681cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.932+0000 7f8a6c9a1700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a68134ad0 0x7f8a6812f780 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.932+0000 7f8a6c9a1700 1 --2- 172.21.15.63:0/4073963356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a681346f0 0x7f8a6812f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:48.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.932+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/4073963356 >> 172.21.15.63:0/4073963356 conn(0x7f8a680a96b0 msgr2=0x7f8a68133550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:48.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.932+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/4073963356 shutdown_connections 2023-12-01T15:43:48.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:48.932+0000 7f8a6c9a1700 1 -- 172.21.15.63:0/4073963356 wait complete. 2023-12-01T15:43:48.936 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2023-12-01T15:43:48.947 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:49.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 Processor -- start 2023-12-01T15:43:49.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 -- start start 2023-12-01T15:43:49.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf58139030 0x7fbf581386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf58071a30 con 0x7fbf58138c50 2023-12-01T15:43:49.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf58071d10 con 0x7fbf580723f0 2023-12-01T15:43:49.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf580713b0 con 0x7fbf58139030 2023-12-01T15:43:49.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf567fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf58139030 0x7fbf581386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf56ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbf58138c50 0x7fbf58134ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41958/0 (socket says 172.21.15.63:41958) 2023-12-01T15:43:49.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf567fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbf58139030 0x7fbf581386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46688/0 (socket says 172.21.15.63:46688) 2023-12-01T15:43:49.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf56ffd700 1 -- 172.21.15.63:0/3624286449 learned_addr learned my addr 172.21.15.63:0/3624286449 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:49.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf567fc700 1 -- 172.21.15.63:0/3624286449 >> v1:172.21.15.66:6789/0 conn(0x7fbf580723f0 legacy=0x7fbf581355d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:49.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf567fc700 1 -- 172.21.15.63:0/3624286449 >> v1:172.21.15.63:6789/0 conn(0x7fbf58138c50 legacy=0x7fbf58134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf567fc700 1 -- 172.21.15.63:0/3624286449 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5806bb70 con 0x7fbf58139030 2023-12-01T15:43:49.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf567fc700 1 --2- 172.21.15.63:0/3624286449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf58139030 0x7fbf581386a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009d90 tx=0x7fbf4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2b40af1c9e02f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:49.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf55ffb700 1 -- 172.21.15.63:0/3624286449 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800e070 con 0x7fbf58139030 2023-12-01T15:43:49.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf55ffb700 1 -- 172.21.15.63:0/3624286449 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4800bb90 con 0x7fbf58139030 2023-12-01T15:43:49.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf55ffb700 1 -- 172.21.15.63:0/3624286449 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48003a40 con 0x7fbf58139030 2023-12-01T15:43:49.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 -- 172.21.15.63:0/3624286449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf58139030 msgr2=0x7fbf581386a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 --2- 172.21.15.63:0/3624286449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf58139030 0x7fbf581386a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009d90 tx=0x7fbf4800b330 comp rx=0 tx=0).stop 2023-12-01T15:43:49.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 -- 172.21.15.63:0/3624286449 shutdown_connections 2023-12-01T15:43:49.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 --2- 172.21.15.63:0/3624286449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf58139030 0x7fbf581386a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 -- 172.21.15.63:0/3624286449 >> 172.21.15.63:0/3624286449 conn(0x7fbf580a8bd0 msgr2=0x7fbf58098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:49.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 -- 172.21.15.63:0/3624286449 shutdown_connections 2023-12-01T15:43:49.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.060+0000 7fbf57fff700 1 -- 172.21.15.63:0/3624286449 wait complete. 2023-12-01T15:43:49.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf57fff700 1 Processor -- start 2023-12-01T15:43:49.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf57fff700 1 -- start start 2023-12-01T15:43:49.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf57fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf580723f0 0x7fbf58132170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf57fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf58138c50 0x7fbf581326b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf57fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf58139030 0x7fbf581ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf57fff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580a30e0 con 0x7fbf580723f0 2023-12-01T15:43:49.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf57fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580a4170 con 0x7fbf58139030 2023-12-01T15:43:49.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf57fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580a2ca0 con 0x7fbf58138c50 2023-12-01T15:43:49.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf56ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf580723f0 0x7fbf58132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf56ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf580723f0 0x7fbf58132170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46694/0 (socket says 172.21.15.63:46694) 2023-12-01T15:43:49.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf56ffd700 1 -- 172.21.15.63:0/3772961050 learned_addr learned my addr 172.21.15.63:0/3772961050 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf567fc700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf58138c50 0x7fbf581326b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.064+0000 7fbf577fe700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf58139030 0x7fbf581ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf56ffd700 1 -- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf58138c50 msgr2=0x7fbf581326b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf56ffd700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf58138c50 0x7fbf581326b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf56ffd700 1 -- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf58139030 msgr2=0x7fbf581ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf56ffd700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf58139030 0x7fbf581ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf56ffd700 1 -- 172.21.15.63:0/3772961050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf48009a70 con 0x7fbf580723f0 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf577fe700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf58139030 0x7fbf581ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf56ffd700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf580723f0 0x7fbf58132170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00c530 tx=0x7fbf4c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf3f7fe700 1 -- 172.21.15.63:0/3772961050 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c005d90 con 0x7fbf580723f0 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf3f7fe700 1 -- 172.21.15.63:0/3772961050 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c0070d0 con 0x7fbf580723f0 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf57fff700 1 -- 172.21.15.63:0/3772961050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf580a2330 con 0x7fbf580723f0 2023-12-01T15:43:49.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf3f7fe700 1 -- 172.21.15.63:0/3772961050 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c007460 con 0x7fbf580723f0 2023-12-01T15:43:49.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf57fff700 1 -- 172.21.15.63:0/3772961050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf580a3c20 con 0x7fbf580723f0 2023-12-01T15:43:49.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf57fff700 1 -- 172.21.15.63:0/3772961050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf58065fb0 con 0x7fbf580723f0 2023-12-01T15:43:49.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.068+0000 7fbf3f7fe700 1 -- 172.21.15.63:0/3772961050 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbf4c0075c0 con 0x7fbf580723f0 2023-12-01T15:43:49.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.072+0000 7fbf3f7fe700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbf44065ad0 0x7fbf44067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.072+0000 7fbf3f7fe700 1 -- 172.21.15.63:0/3772961050 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fbf4c081fc0 con 0x7fbf580723f0 2023-12-01T15:43:49.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.072+0000 7fbf567fc700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbf44065ad0 0x7fbf44067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.072+0000 7fbf567fc700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbf44065ad0 0x7fbf44067f90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf48000f80 tx=0x7fbf48011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:49.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.080+0000 7fbf3f7fe700 1 -- 172.21.15.63:0/3772961050 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fbf4c04fed0 con 0x7fbf580723f0 2023-12-01T15:43:49.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.244+0000 7fbf57fff700 1 -- 172.21.15.63:0/3772961050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf58061d90 con 0x7fbf580723f0 2023-12-01T15:43:49.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.244+0000 7fbf3f7fe700 1 -- 172.21.15.63:0/3772961050 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7fbf4c017020 con 0x7fbf580723f0 2023-12-01T15:43:49.248 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:49.248 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:46.548806+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:49.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 -- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbf44065ad0 msgr2=0x7fbf44067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbf44065ad0 0x7fbf44067f90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf48000f80 tx=0x7fbf48011000 comp rx=0 tx=0).stop 2023-12-01T15:43:49.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 -- 172.21.15.63:0/3772961050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf580723f0 msgr2=0x7fbf58132170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf580723f0 0x7fbf58132170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00c530 tx=0x7fbf4c00c840 comp rx=0 tx=0).stop 2023-12-01T15:43:49.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 -- 172.21.15.63:0/3772961050 shutdown_connections 2023-12-01T15:43:49.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbf44065ad0 0x7fbf44067f90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf58138c50 0x7fbf581326b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf58139030 0x7fbf581ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 --2- 172.21.15.63:0/3772961050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf580723f0 0x7fbf58132170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 -- 172.21.15.63:0/3772961050 >> 172.21.15.63:0/3772961050 conn(0x7fbf580a8bd0 msgr2=0x7fbf58136c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:49.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 -- 172.21.15.63:0/3772961050 shutdown_connections 2023-12-01T15:43:49.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.248+0000 7fbf57fff700 1 -- 172.21.15.63:0/3772961050 wait complete. 2023-12-01T15:43:49.263 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-01T15:43:49.263 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T15:43:49.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.368+0000 7f95e1eca700 1 Processor -- start 2023-12-01T15:43:49.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.368+0000 7f95e1eca700 1 -- start start 2023-12-01T15:43:49.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.368+0000 7f95e1eca700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f95dc1386a0 0x7f95dc138f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.368+0000 7f95e1eca700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95dc0723f0 0x7f95dc1355d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95dc071c80 con 0x7f95dc138ba0 2023-12-01T15:43:49.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95dc0713b0 con 0x7f95dc1386a0 2023-12-01T15:43:49.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc0a5dc0 con 0x7f95dc0723f0 2023-12-01T15:43:49.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95dbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f95dc1386a0 0x7f95dc138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95dbfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f95dc1386a0 0x7f95dc138f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46706/0 (socket says 172.21.15.63:46706) 2023-12-01T15:43:49.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95dbfff700 1 -- 172.21.15.63:0/3156396638 learned_addr learned my addr 172.21.15.63:0/3156396638 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:49.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95dbfff700 1 -- 172.21.15.63:0/3156396638 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95dc0723f0 msgr2=0x7f95dc1355d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:49.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e16c9700 1 --2- 172.21.15.63:0/3156396638 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95dc0723f0 0x7f95dc1355d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95dbfff700 1 --2- 172.21.15.63:0/3156396638 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95dc0723f0 0x7f95dc1355d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95dbfff700 1 -- 172.21.15.63:0/3156396638 >> v1:172.21.15.66:6789/0 conn(0x7f95dc138ba0 legacy=0x7f95dc134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95dbfff700 1 -- 172.21.15.63:0/3156396638 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc0715d0 con 0x7f95dc1386a0 2023-12-01T15:43:49.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e16c9700 1 --2- 172.21.15.63:0/3156396638 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95dc0723f0 0x7f95dc1355d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T15:43:49.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95dbfff700 1 --2- 172.21.15.63:0/3156396638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95dc1386a0 0x7f95dc138f80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009910 tx=0x7f95cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837c62ec2895aea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:49.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95db7fe700 1 -- 172.21.15.63:0/3156396638 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00ba60 con 0x7f95dc1386a0 2023-12-01T15:43:49.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95db7fe700 1 -- 172.21.15.63:0/3156396638 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc00bbc0 con 0x7f95dc1386a0 2023-12-01T15:43:49.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95db7fe700 1 -- 172.21.15.63:0/3156396638 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc009e60 con 0x7f95dc1386a0 2023-12-01T15:43:49.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 -- 172.21.15.63:0/3156396638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95dc1386a0 msgr2=0x7f95dc138f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 --2- 172.21.15.63:0/3156396638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95dc1386a0 0x7f95dc138f80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009910 tx=0x7f95cc009c20 comp rx=0 tx=0).stop 2023-12-01T15:43:49.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 -- 172.21.15.63:0/3156396638 shutdown_connections 2023-12-01T15:43:49.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 --2- 172.21.15.63:0/3156396638 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95dc0723f0 0x7f95dc1355d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 --2- 172.21.15.63:0/3156396638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95dc1386a0 0x7f95dc138f80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 -- 172.21.15.63:0/3156396638 >> 172.21.15.63:0/3156396638 conn(0x7f95dc0a8bd0 msgr2=0x7f95dc098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:49.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 -- 172.21.15.63:0/3156396638 shutdown_connections 2023-12-01T15:43:49.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 -- 172.21.15.63:0/3156396638 wait complete. 2023-12-01T15:43:49.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 Processor -- start 2023-12-01T15:43:49.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.372+0000 7f95e1eca700 1 -- start start 2023-12-01T15:43:49.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e1eca700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95dc0723f0 0x7f95dc1c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e1eca700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95dc1386a0 0x7f95dc1c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e1eca700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95dc138ba0 0x7f95dc1ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e1eca700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc0a1da0 con 0x7f95dc0723f0 2023-12-01T15:43:49.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e1eca700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc0a2eb0 con 0x7f95dc1386a0 2023-12-01T15:43:49.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e1eca700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc0a3af0 con 0x7f95dc138ba0 2023-12-01T15:43:49.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e0ec8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95dc0723f0 0x7f95dc1c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95dbfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95dc1386a0 0x7f95dc1c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e16c9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95dc138ba0 0x7f95dc1ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e0ec8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95dc0723f0 0x7f95dc1c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46718/0 (socket says 172.21.15.63:46718) 2023-12-01T15:43:49.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e0ec8700 1 -- 172.21.15.63:0/113462618 learned_addr learned my addr 172.21.15.63:0/113462618 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:49.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e0ec8700 1 -- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95dc138ba0 msgr2=0x7f95dc1ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e0ec8700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95dc138ba0 0x7f95dc1ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e0ec8700 1 -- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95dc1386a0 msgr2=0x7f95dc1c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e0ec8700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95dc1386a0 0x7f95dc1c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e0ec8700 1 -- 172.21.15.63:0/113462618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc009570 con 0x7f95dc0723f0 2023-12-01T15:43:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95dbfff700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95dc1386a0 0x7f95dc1c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e0ec8700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95dc0723f0 0x7f95dc1c9920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f95d000c500 tx=0x7f95d000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95d97fa700 1 -- 172.21.15.63:0/113462618 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d00052d0 con 0x7f95dc0723f0 2023-12-01T15:43:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95d97fa700 1 -- 172.21.15.63:0/113462618 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d0005430 con 0x7f95dc0723f0 2023-12-01T15:43:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e1eca700 1 -- 172.21.15.63:0/113462618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95dc0a29c0 con 0x7f95dc0723f0 2023-12-01T15:43:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95d97fa700 1 -- 172.21.15.63:0/113462618 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d00055a0 con 0x7f95dc0723f0 2023-12-01T15:43:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.376+0000 7f95e1eca700 1 -- 172.21.15.63:0/113462618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95dc0a4c70 con 0x7f95dc0723f0 2023-12-01T15:43:49.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.380+0000 7f95e1eca700 1 -- 172.21.15.63:0/113462618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95dc065fb0 con 0x7f95dc0723f0 2023-12-01T15:43:49.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.380+0000 7f95d97fa700 1 -- 172.21.15.63:0/113462618 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f95d00038e0 con 0x7f95dc0723f0 2023-12-01T15:43:49.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.380+0000 7f95d97fa700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95c8065ad0 0x7f95c8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.380+0000 7f95d97fa700 1 -- 172.21.15.63:0/113462618 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f95d0081f00 con 0x7f95dc0723f0 2023-12-01T15:43:49.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.380+0000 7f95dbfff700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95c8065ad0 0x7f95c8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.380+0000 7f95dbfff700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95c8065ad0 0x7f95c8067f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:49.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.388+0000 7f95d97fa700 1 -- 172.21.15.63:0/113462618 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f95d004feb0 con 0x7f95dc0723f0 2023-12-01T15:43:49.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.548+0000 7f95e1eca700 1 -- 172.21.15.63:0/113462618 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95dc0719c0 con 0x7f95c8065ad0 2023-12-01T15:43:49.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.564+0000 7f95d97fa700 1 -- 172.21.15.63:0/113462618 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261589 (secure 0 0 0) 0x7f95cc00bd30 con 0x7f95c8065ad0 2023-12-01T15:43:49.573 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 -- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95c8065ad0 msgr2=0x7f95c8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95c8065ad0 0x7f95c8067f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc008030 comp rx=0 tx=0).stop 2023-12-01T15:43:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 -- 172.21.15.63:0/113462618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95dc0723f0 msgr2=0x7f95dc1c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95dc0723f0 0x7f95dc1c9920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f95d000c500 tx=0x7f95d000c810 comp rx=0 tx=0).stop 2023-12-01T15:43:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 -- 172.21.15.63:0/113462618 shutdown_connections 2023-12-01T15:43:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95c8065ad0 0x7f95c8067f90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95dc138ba0 0x7f95dc1ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95dc1386a0 0x7f95dc1c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 --2- 172.21.15.63:0/113462618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95dc0723f0 0x7f95dc1c9920 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 -- 172.21.15.63:0/113462618 >> 172.21.15.63:0/113462618 conn(0x7f95dc0a8bd0 msgr2=0x7f95dc134e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 -- 172.21.15.63:0/113462618 shutdown_connections 2023-12-01T15:43:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.572+0000 7f95e1eca700 1 -- 172.21.15.63:0/113462618 wait complete. 2023-12-01T15:43:49.577 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T15:43:49.591 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-01T15:43:48.370305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109496,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377864,"statfs":{"total":386547056640,"available":386434932736,"internally_reserved":0,"allocated":1728512,"data_stored":1353596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.201911"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177835+0000","last_change":"2023-12-01T15:43:44.177835+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177835+0000","last_undegraded":"2023-12-01T15:43:44.177835+0000","last_fullsized":"2023-12-01T15:43:44.177835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177678+0000","last_change":"2023-12-01T15:43:44.177678+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177678+0000","last_undegraded":"2023-12-01T15:43:44.177678+0000","last_fullsized":"2023-12-01T15:43:44.177678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178829+0000","last_change":"2023-12-01T15:43:44.178829+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178829+0000","last_undegraded":"2023-12-01T15:43:44.178829+0000","last_fullsized":"2023-12-01T15:43:44.178829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177445+0000","last_change":"2023-12-01T15:43:44.177445+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177445+0000","last_undegraded":"2023-12-01T15:43:44.177445+0000","last_fullsized":"2023-12-01T15:43:44.177445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.173621+0000","last_change":"2023-12-01T15:43:44.173621+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.173621+0000","last_undegraded":"2023-12-01T15:43:44.173621+0000","last_fullsized":"2023-12-01T15:43:44.173621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172367+0000","last_change":"2023-12-01T15:43:44.172367+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172367+0000","last_undegraded":"2023-12-01T15:43:44.172367+0000","last_fullsized":"2023-12-01T15:43:44.172367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177596+0000","last_change":"2023-12-01T15:43:44.177596+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177596+0000","last_undegraded":"2023-12-01T15:43:44.177596+0000","last_fullsized":"2023-12-01T15:43:44.177596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178034+0000","last_change":"2023-12-01T15:43:44.178034+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178034+0000","last_undegraded":"2023-12-01T15:43:44.178034+0000","last_fullsized":"2023-12-01T15:43:44.178034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174493+0000","last_change":"2023-12-01T15:43:44.174493+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174493+0000","last_undegraded":"2023-12-01T15:43:44.174493+0000","last_fullsized":"2023-12-01T15:43:44.174493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178340+0000","last_change":"2023-12-01T15:43:44.178340+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178340+0000","last_undegraded":"2023-12-01T15:43:44.178340+0000","last_fullsized":"2023-12-01T15:43:44.178340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178112+0000","last_change":"2023-12-01T15:43:44.178112+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178112+0000","last_undegraded":"2023-12-01T15:43:44.178112+0000","last_fullsized":"2023-12-01T15:43:44.178112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174492+0000","last_change":"2023-12-01T15:43:44.174492+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174492+0000","last_undegraded":"2023-12-01T15:43:44.174492+0000","last_fullsized":"2023-12-01T15:43:44.174492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":164,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-01T15:43:42.415749+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:43:42.415749+0000","last_peered":"2023-12-01T15:43:42.415749+0000","last_clean":"2023-12-01T15:43:42.415749+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:43:42.415749+0000","last_undegraded":"2023-12-01T15:43:42.415749+0000","last_fullsized":"2023-12-01T15:43:42.415749+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:09:18.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180408+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:43:44.180408+0000","last_peered":"2023-12-01T15:43:44.180408+0000","last_clean":"2023-12-01T15:43:44.180408+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:43:44.180408+0000","last_undegraded":"2023-12-01T15:43:44.180408+0000","last_fullsized":"2023-12-01T15:43:44.180408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:10:37.881379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172555+0000","last_change":"2023-12-01T15:43:44.172555+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172555+0000","last_undegraded":"2023-12-01T15:43:44.172555+0000","last_fullsized":"2023-12-01T15:43:44.172555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180785+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:43:44.180785+0000","last_peered":"2023-12-01T15:43:44.180785+0000","last_clean":"2023-12-01T15:43:44.180785+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:43:44.180785+0000","last_undegraded":"2023-12-01T15:43:44.180785+0000","last_fullsized":"2023-12-01T15:43:44.180785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177601+0000","last_change":"2023-12-01T15:43:44.177601+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177601+0000","last_undegraded":"2023-12-01T15:43:44.177601+0000","last_fullsized":"2023-12-01T15:43:44.177601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.169629+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:43:44.169629+0000","last_peered":"2023-12-01T15:43:44.169629+0000","last_clean":"2023-12-01T15:43:44.169629+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:43:44.169629+0000","last_undegraded":"2023-12-01T15:43:44.169629+0000","last_fullsized":"2023-12-01T15:43:44.169629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:05:36.049760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172302+0000","last_change":"2023-12-01T15:43:44.172302+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172302+0000","last_undegraded":"2023-12-01T15:43:44.172302+0000","last_fullsized":"2023-12-01T15:43:44.172302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180183+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:43:44.180183+0000","last_peered":"2023-12-01T15:43:44.180183+0000","last_clean":"2023-12-01T15:43:44.180183+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:43:44.180183+0000","last_undegraded":"2023-12-01T15:43:44.180183+0000","last_fullsized":"2023-12-01T15:43:44.180183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:11:42.240939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172880+0000","last_change":"2023-12-01T15:43:44.172880+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172880+0000","last_undegraded":"2023-12-01T15:43:44.172880+0000","last_fullsized":"2023-12-01T15:43:44.172880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172301+0000","last_change":"2023-12-01T15:43:44.172301+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172301+0000","last_undegraded":"2023-12-01T15:43:44.172301+0000","last_fullsized":"2023-12-01T15:43:44.172301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.169631+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:43:44.169631+0000","last_peered":"2023-12-01T15:43:44.169631+0000","last_clean":"2023-12-01T15:43:44.169631+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:43:44.169631+0000","last_undegraded":"2023-12-01T15:43:44.169631+0000","last_fullsized":"2023-12-01T15:43:44.169631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172354+0000","last_change":"2023-12-01T15:43:44.172354+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172354+0000","last_undegraded":"2023-12-01T15:43:44.172354+0000","last_fullsized":"2023-12-01T15:43:44.172354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180267+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:43:44.180267+0000","last_peered":"2023-12-01T15:43:44.180267+0000","last_clean":"2023-12-01T15:43:44.180267+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:43:44.180267+0000","last_undegraded":"2023-12-01T15:43:44.180267+0000","last_fullsized":"2023-12-01T15:43:44.180267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:50:39.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172429+0000","last_change":"2023-12-01T15:43:44.172429+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172429+0000","last_undegraded":"2023-12-01T15:43:44.172429+0000","last_fullsized":"2023-12-01T15:43:44.172429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.169724+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:43:44.169724+0000","last_peered":"2023-12-01T15:43:44.169724+0000","last_clean":"2023-12-01T15:43:44.169724+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:43:44.169724+0000","last_undegraded":"2023-12-01T15:43:44.169724+0000","last_fullsized":"2023-12-01T15:43:44.169724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:40:03.704778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178100+0000","last_change":"2023-12-01T15:43:44.178100+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178100+0000","last_undegraded":"2023-12-01T15:43:44.178100+0000","last_fullsized":"2023-12-01T15:43:44.178100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180310+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:43:44.180310+0000","last_peered":"2023-12-01T15:43:44.180310+0000","last_clean":"2023-12-01T15:43:44.180310+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:43:44.180310+0000","last_undegraded":"2023-12-01T15:43:44.180310+0000","last_fullsized":"2023-12-01T15:43:44.180310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:55:21.181781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178608+0000","last_change":"2023-12-01T15:43:44.178608+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178608+0000","last_undegraded":"2023-12-01T15:43:44.178608+0000","last_fullsized":"2023-12-01T15:43:44.178608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174268+0000","last_change":"2023-12-01T15:43:44.174268+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174268+0000","last_undegraded":"2023-12-01T15:43:44.174268+0000","last_fullsized":"2023-12-01T15:43:44.174268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174492+0000","last_change":"2023-12-01T15:43:44.174492+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174492+0000","last_undegraded":"2023-12-01T15:43:44.174492+0000","last_fullsized":"2023-12-01T15:43:44.174492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177467+0000","last_change":"2023-12-01T15:43:44.177467+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177467+0000","last_undegraded":"2023-12-01T15:43:44.177467+0000","last_fullsized":"2023-12-01T15:43:44.177467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.175824+0000","last_change":"2023-12-01T15:43:44.175824+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.175824+0000","last_undegraded":"2023-12-01T15:43:44.175824+0000","last_fullsized":"2023-12-01T15:43:44.175824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.175900+0000","last_change":"2023-12-01T15:43:44.175900+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.175900+0000","last_undegraded":"2023-12-01T15:43:44.175900+0000","last_fullsized":"2023-12-01T15:43:44.175900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172211+0000","last_change":"2023-12-01T15:43:44.172211+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172211+0000","last_undegraded":"2023-12-01T15:43:44.172211+0000","last_fullsized":"2023-12-01T15:43:44.172211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177339+0000","last_change":"2023-12-01T15:43:44.177339+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177339+0000","last_undegraded":"2023-12-01T15:43:44.177339+0000","last_fullsized":"2023-12-01T15:43:44.177339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.173504+0000","last_change":"2023-12-01T15:43:44.173504+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.173504+0000","last_undegraded":"2023-12-01T15:43:44.173504+0000","last_fullsized":"2023-12-01T15:43:44.173504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.179586+0000","last_change":"2023-12-01T15:43:44.179586+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.179586+0000","last_undegraded":"2023-12-01T15:43:44.179586+0000","last_fullsized":"2023-12-01T15:43:44.179586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.180072+0000","last_change":"2023-12-01T15:43:44.180072+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.180072+0000","last_undegraded":"2023-12-01T15:43:44.180072+0000","last_fullsized":"2023-12-01T15:43:44.180072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.180062+0000","last_change":"2023-12-01T15:43:44.180062+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.180062+0000","last_undegraded":"2023-12-01T15:43:44.180062+0000","last_fullsized":"2023-12-01T15:43:44.180062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":733184,"data_stored":635804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":131072,"data_stored":40994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27088,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344752,"statfs":{"total":96636764160,"available":96609026048,"internally_reserved":0,"allocated":139264,"data_stored":45436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":724992,"data_stored":631362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T15:43:49.596 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T15:43:49.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71359e700 1 Processor -- start 2023-12-01T15:43:49.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71359e700 1 -- start start 2023-12-01T15:43:49.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa7141376e0 0x7fa714137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa71406ba50 0x7fa71406bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71409c240 con 0x7fa71406c3e0 2023-12-01T15:43:49.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa714138000 con 0x7fa7141376e0 2023-12-01T15:43:49.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71406c870 con 0x7fa71406ba50 2023-12-01T15:43:49.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa7141376e0 0x7fa714137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa711d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa71406ba50 0x7fa71406bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa711d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa71406ba50 0x7fa71406bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:54696/0 (socket says 172.21.15.63:54696) 2023-12-01T15:43:49.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa711d9b700 1 -- 172.21.15.63:0/2401706079 learned_addr learned my addr 172.21.15.63:0/2401706079 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:49.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa7141376e0 0x7fa714137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46730/0 (socket says 172.21.15.63:46730) 2023-12-01T15:43:49.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71159a700 1 -- 172.21.15.63:0/2401706079 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605507342 0 0) 0x7fa71409c240 con 0x7fa71406c3e0 2023-12-01T15:43:49.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71159a700 1 -- 172.21.15.63:0/2401706079 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6fc0035d0 con 0x7fa71406c3e0 2023-12-01T15:43:49.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71259c700 1 -- 172.21.15.63:0/2401706079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa71406ba50 msgr2=0x7fa71406bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:49.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71259c700 1 --2- 172.21.15.63:0/2401706079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa71406ba50 0x7fa71406bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71259c700 1 -- 172.21.15.63:0/2401706079 >> v1:172.21.15.66:6789/0 conn(0x7fa71406c3e0 legacy=0x7fa7141418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa71259c700 1 -- 172.21.15.63:0/2401706079 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71409bc90 con 0x7fa7141376e0 2023-12-01T15:43:49.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.708+0000 7fa711d9b700 1 --2- 172.21.15.63:0/2401706079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa71406ba50 0x7fa71406bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71259c700 1 --2- 172.21.15.63:0/2401706079 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7141376e0 0x7fa714137ac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa708009850 tx=0x7fa708009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47584ee5cfe78e9e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71159a700 1 -- 172.21.15.63:0/2401706079 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708011830 con 0x7fa7141376e0 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71159a700 1 -- 172.21.15.63:0/2401706079 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa708011990 con 0x7fa7141376e0 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71159a700 1 -- 172.21.15.63:0/2401706079 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708011d40 con 0x7fa7141376e0 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 -- 172.21.15.63:0/2401706079 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7141376e0 msgr2=0x7fa714137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 --2- 172.21.15.63:0/2401706079 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7141376e0 0x7fa714137ac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa708009850 tx=0x7fa708009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 -- 172.21.15.63:0/2401706079 shutdown_connections 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 --2- 172.21.15.63:0/2401706079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa71406ba50 0x7fa71406bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 --2- 172.21.15.63:0/2401706079 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7141376e0 0x7fa714137ac0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 -- 172.21.15.63:0/2401706079 >> 172.21.15.63:0/2401706079 conn(0x7fa7140737a0 msgr2=0x7fa7140ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 -- 172.21.15.63:0/2401706079 shutdown_connections 2023-12-01T15:43:49.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 -- 172.21.15.63:0/2401706079 wait complete. 2023-12-01T15:43:49.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 Processor -- start 2023-12-01T15:43:49.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 -- start start 2023-12-01T15:43:49.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa71406ba50 0x7fa7141cf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71406c3e0 0x7fa7141cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7141376e0 0x7fa7140a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7141d00f0 con 0x7fa71406ba50 2023-12-01T15:43:49.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa714138170 con 0x7fa71406c3e0 2023-12-01T15:43:49.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140a8400 con 0x7fa7141376e0 2023-12-01T15:43:49.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa71406ba50 0x7fa7141cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa71406ba50 0x7fa7141cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46738/0 (socket says 172.21.15.63:46738) 2023-12-01T15:43:49.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa71259c700 1 -- 172.21.15.63:0/2328971162 learned_addr learned my addr 172.21.15.63:0/2328971162 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:49.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa711d9b700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71406c3e0 0x7fa7141cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.712+0000 7fa712d9d700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7141376e0 0x7fa7140a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa71259c700 1 -- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7141376e0 msgr2=0x7fa7140a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa71259c700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7141376e0 0x7fa7140a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa71259c700 1 -- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71406c3e0 msgr2=0x7fa7141cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa71259c700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71406c3e0 0x7fa7141cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa71259c700 1 -- 172.21.15.63:0/2328971162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa704009570 con 0x7fa71406ba50 2023-12-01T15:43:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa71259c700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa71406ba50 0x7fa7141cf670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7080090b0 tx=0x7fa708004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa702ffd700 1 -- 172.21.15.63:0/2328971162 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708004590 con 0x7fa71406ba50 2023-12-01T15:43:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa702ffd700 1 -- 172.21.15.63:0/2328971162 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7080036c0 con 0x7fa71406ba50 2023-12-01T15:43:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa71359e700 1 -- 172.21.15.63:0/2328971162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7080094b0 con 0x7fa71406ba50 2023-12-01T15:43:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa702ffd700 1 -- 172.21.15.63:0/2328971162 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708003a70 con 0x7fa71406ba50 2023-12-01T15:43:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa71359e700 1 -- 172.21.15.63:0/2328971162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7140a9c50 con 0x7fa71406ba50 2023-12-01T15:43:49.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.716+0000 7fa71359e700 1 -- 172.21.15.63:0/2328971162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71409b7e0 con 0x7fa71406ba50 2023-12-01T15:43:49.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.720+0000 7fa702ffd700 1 -- 172.21.15.63:0/2328971162 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa708021070 con 0x7fa71406ba50 2023-12-01T15:43:49.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.720+0000 7fa702ffd700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6f4065b00 0x7fa6f4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:49.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.720+0000 7fa702ffd700 1 -- 172.21.15.63:0/2328971162 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fa708083f30 con 0x7fa71406ba50 2023-12-01T15:43:49.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.720+0000 7fa711d9b700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6f4065b00 0x7fa6f4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:49.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.720+0000 7fa711d9b700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6f4065b00 0x7fa6f4067fc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7140a7c40 tx=0x7fa7040092e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:49.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.728+0000 7fa702ffd700 1 -- 172.21.15.63:0/2328971162 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa708051ee0 con 0x7fa71406ba50 2023-12-01T15:43:49.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.892+0000 7fa71359e700 1 -- 172.21.15.63:0/2328971162 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa71409ebd0 con 0x7fa6f4065b00 2023-12-01T15:43:49.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.908+0000 7fa702ffd700 1 -- 172.21.15.63:0/2328971162 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261589 (secure 0 0 0) 0x7fa704011b10 con 0x7fa6f4065b00 2023-12-01T15:43:49.916 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:49.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 -- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6f4065b00 msgr2=0x7fa6f4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6f4065b00 0x7fa6f4067fc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7140a7c40 tx=0x7fa7040092e0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 -- 172.21.15.63:0/2328971162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa71406ba50 msgr2=0x7fa7141cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:49.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa71406ba50 0x7fa7141cf670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7080090b0 tx=0x7fa708004770 comp rx=0 tx=0).stop 2023-12-01T15:43:49.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 -- 172.21.15.63:0/2328971162 shutdown_connections 2023-12-01T15:43:49.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6f4065b00 0x7fa6f4067fc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7141376e0 0x7fa7140a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71406c3e0 0x7fa7141cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 --2- 172.21.15.63:0/2328971162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa71406ba50 0x7fa7141cf670 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:49.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 -- 172.21.15.63:0/2328971162 >> 172.21.15.63:0/2328971162 conn(0x7fa7140737a0 msgr2=0x7fa7140aa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:49.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 -- 172.21.15.63:0/2328971162 shutdown_connections 2023-12-01T15:43:49.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:49.912+0000 7fa71359e700 1 -- 172.21.15.63:0/2328971162 wait complete. 2023-12-01T15:43:49.919 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T15:43:49.931 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-01T15:43:48.370305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109496,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377864,"statfs":{"total":386547056640,"available":386434932736,"internally_reserved":0,"allocated":1728512,"data_stored":1353596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.201911"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177835+0000","last_change":"2023-12-01T15:43:44.177835+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177835+0000","last_undegraded":"2023-12-01T15:43:44.177835+0000","last_fullsized":"2023-12-01T15:43:44.177835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177678+0000","last_change":"2023-12-01T15:43:44.177678+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177678+0000","last_undegraded":"2023-12-01T15:43:44.177678+0000","last_fullsized":"2023-12-01T15:43:44.177678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178829+0000","last_change":"2023-12-01T15:43:44.178829+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178829+0000","last_undegraded":"2023-12-01T15:43:44.178829+0000","last_fullsized":"2023-12-01T15:43:44.178829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177445+0000","last_change":"2023-12-01T15:43:44.177445+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177445+0000","last_undegraded":"2023-12-01T15:43:44.177445+0000","last_fullsized":"2023-12-01T15:43:44.177445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.173621+0000","last_change":"2023-12-01T15:43:44.173621+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.173621+0000","last_undegraded":"2023-12-01T15:43:44.173621+0000","last_fullsized":"2023-12-01T15:43:44.173621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172367+0000","last_change":"2023-12-01T15:43:44.172367+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172367+0000","last_undegraded":"2023-12-01T15:43:44.172367+0000","last_fullsized":"2023-12-01T15:43:44.172367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177596+0000","last_change":"2023-12-01T15:43:44.177596+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177596+0000","last_undegraded":"2023-12-01T15:43:44.177596+0000","last_fullsized":"2023-12-01T15:43:44.177596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178034+0000","last_change":"2023-12-01T15:43:44.178034+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178034+0000","last_undegraded":"2023-12-01T15:43:44.178034+0000","last_fullsized":"2023-12-01T15:43:44.178034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174493+0000","last_change":"2023-12-01T15:43:44.174493+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174493+0000","last_undegraded":"2023-12-01T15:43:44.174493+0000","last_fullsized":"2023-12-01T15:43:44.174493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178340+0000","last_change":"2023-12-01T15:43:44.178340+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178340+0000","last_undegraded":"2023-12-01T15:43:44.178340+0000","last_fullsized":"2023-12-01T15:43:44.178340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178112+0000","last_change":"2023-12-01T15:43:44.178112+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178112+0000","last_undegraded":"2023-12-01T15:43:44.178112+0000","last_fullsized":"2023-12-01T15:43:44.178112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174492+0000","last_change":"2023-12-01T15:43:44.174492+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174492+0000","last_undegraded":"2023-12-01T15:43:44.174492+0000","last_fullsized":"2023-12-01T15:43:44.174492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":164,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-01T15:43:42.415749+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:43:42.415749+0000","last_peered":"2023-12-01T15:43:42.415749+0000","last_clean":"2023-12-01T15:43:42.415749+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:43:42.415749+0000","last_undegraded":"2023-12-01T15:43:42.415749+0000","last_fullsized":"2023-12-01T15:43:42.415749+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:09:18.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180408+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:43:44.180408+0000","last_peered":"2023-12-01T15:43:44.180408+0000","last_clean":"2023-12-01T15:43:44.180408+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:43:44.180408+0000","last_undegraded":"2023-12-01T15:43:44.180408+0000","last_fullsized":"2023-12-01T15:43:44.180408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:10:37.881379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172555+0000","last_change":"2023-12-01T15:43:44.172555+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172555+0000","last_undegraded":"2023-12-01T15:43:44.172555+0000","last_fullsized":"2023-12-01T15:43:44.172555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180785+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:43:44.180785+0000","last_peered":"2023-12-01T15:43:44.180785+0000","last_clean":"2023-12-01T15:43:44.180785+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:43:44.180785+0000","last_undegraded":"2023-12-01T15:43:44.180785+0000","last_fullsized":"2023-12-01T15:43:44.180785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177601+0000","last_change":"2023-12-01T15:43:44.177601+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177601+0000","last_undegraded":"2023-12-01T15:43:44.177601+0000","last_fullsized":"2023-12-01T15:43:44.177601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.169629+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:43:44.169629+0000","last_peered":"2023-12-01T15:43:44.169629+0000","last_clean":"2023-12-01T15:43:44.169629+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:43:44.169629+0000","last_undegraded":"2023-12-01T15:43:44.169629+0000","last_fullsized":"2023-12-01T15:43:44.169629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:05:36.049760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172302+0000","last_change":"2023-12-01T15:43:44.172302+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172302+0000","last_undegraded":"2023-12-01T15:43:44.172302+0000","last_fullsized":"2023-12-01T15:43:44.172302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180183+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:43:44.180183+0000","last_peered":"2023-12-01T15:43:44.180183+0000","last_clean":"2023-12-01T15:43:44.180183+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:43:44.180183+0000","last_undegraded":"2023-12-01T15:43:44.180183+0000","last_fullsized":"2023-12-01T15:43:44.180183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:11:42.240939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172880+0000","last_change":"2023-12-01T15:43:44.172880+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172880+0000","last_undegraded":"2023-12-01T15:43:44.172880+0000","last_fullsized":"2023-12-01T15:43:44.172880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172301+0000","last_change":"2023-12-01T15:43:44.172301+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172301+0000","last_undegraded":"2023-12-01T15:43:44.172301+0000","last_fullsized":"2023-12-01T15:43:44.172301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.169631+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:43:44.169631+0000","last_peered":"2023-12-01T15:43:44.169631+0000","last_clean":"2023-12-01T15:43:44.169631+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:43:44.169631+0000","last_undegraded":"2023-12-01T15:43:44.169631+0000","last_fullsized":"2023-12-01T15:43:44.169631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172354+0000","last_change":"2023-12-01T15:43:44.172354+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172354+0000","last_undegraded":"2023-12-01T15:43:44.172354+0000","last_fullsized":"2023-12-01T15:43:44.172354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180267+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:43:44.180267+0000","last_peered":"2023-12-01T15:43:44.180267+0000","last_clean":"2023-12-01T15:43:44.180267+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:43:44.180267+0000","last_undegraded":"2023-12-01T15:43:44.180267+0000","last_fullsized":"2023-12-01T15:43:44.180267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:50:39.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172429+0000","last_change":"2023-12-01T15:43:44.172429+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172429+0000","last_undegraded":"2023-12-01T15:43:44.172429+0000","last_fullsized":"2023-12-01T15:43:44.172429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.169724+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:43:44.169724+0000","last_peered":"2023-12-01T15:43:44.169724+0000","last_clean":"2023-12-01T15:43:44.169724+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:43:44.169724+0000","last_undegraded":"2023-12-01T15:43:44.169724+0000","last_fullsized":"2023-12-01T15:43:44.169724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:40:03.704778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178100+0000","last_change":"2023-12-01T15:43:44.178100+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178100+0000","last_undegraded":"2023-12-01T15:43:44.178100+0000","last_fullsized":"2023-12-01T15:43:44.178100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180310+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:43:44.180310+0000","last_peered":"2023-12-01T15:43:44.180310+0000","last_clean":"2023-12-01T15:43:44.180310+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:43:44.180310+0000","last_undegraded":"2023-12-01T15:43:44.180310+0000","last_fullsized":"2023-12-01T15:43:44.180310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:55:21.181781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178608+0000","last_change":"2023-12-01T15:43:44.178608+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178608+0000","last_undegraded":"2023-12-01T15:43:44.178608+0000","last_fullsized":"2023-12-01T15:43:44.178608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174268+0000","last_change":"2023-12-01T15:43:44.174268+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174268+0000","last_undegraded":"2023-12-01T15:43:44.174268+0000","last_fullsized":"2023-12-01T15:43:44.174268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174492+0000","last_change":"2023-12-01T15:43:44.174492+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174492+0000","last_undegraded":"2023-12-01T15:43:44.174492+0000","last_fullsized":"2023-12-01T15:43:44.174492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177467+0000","last_change":"2023-12-01T15:43:44.177467+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177467+0000","last_undegraded":"2023-12-01T15:43:44.177467+0000","last_fullsized":"2023-12-01T15:43:44.177467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.175824+0000","last_change":"2023-12-01T15:43:44.175824+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.175824+0000","last_undegraded":"2023-12-01T15:43:44.175824+0000","last_fullsized":"2023-12-01T15:43:44.175824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.175900+0000","last_change":"2023-12-01T15:43:44.175900+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.175900+0000","last_undegraded":"2023-12-01T15:43:44.175900+0000","last_fullsized":"2023-12-01T15:43:44.175900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172211+0000","last_change":"2023-12-01T15:43:44.172211+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172211+0000","last_undegraded":"2023-12-01T15:43:44.172211+0000","last_fullsized":"2023-12-01T15:43:44.172211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177339+0000","last_change":"2023-12-01T15:43:44.177339+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177339+0000","last_undegraded":"2023-12-01T15:43:44.177339+0000","last_fullsized":"2023-12-01T15:43:44.177339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.173504+0000","last_change":"2023-12-01T15:43:44.173504+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.173504+0000","last_undegraded":"2023-12-01T15:43:44.173504+0000","last_fullsized":"2023-12-01T15:43:44.173504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.179586+0000","last_change":"2023-12-01T15:43:44.179586+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.179586+0000","last_undegraded":"2023-12-01T15:43:44.179586+0000","last_fullsized":"2023-12-01T15:43:44.179586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.180072+0000","last_change":"2023-12-01T15:43:44.180072+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.180072+0000","last_undegraded":"2023-12-01T15:43:44.180072+0000","last_fullsized":"2023-12-01T15:43:44.180072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.180062+0000","last_change":"2023-12-01T15:43:44.180062+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.180062+0000","last_undegraded":"2023-12-01T15:43:44.180062+0000","last_fullsized":"2023-12-01T15:43:44.180062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":733184,"data_stored":635804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":131072,"data_stored":40994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27088,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344752,"statfs":{"total":96636764160,"available":96609026048,"internally_reserved":0,"allocated":139264,"data_stored":45436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":724992,"data_stored":631362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T15:43:49.936 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T15:43:50.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.044+0000 7fdcb4a52700 1 Processor -- start 2023-12-01T15:43:50.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.044+0000 7fdcb4a52700 1 -- start start 2023-12-01T15:43:50.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcb01376e0 0x7fdcb0137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdcb006c580 0x7fdcb01428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb009c240 con 0x7fdcb006ba50 2023-12-01T15:43:50.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb0138000 con 0x7fdcb006c580 2023-12-01T15:43:50.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb009bc90 con 0x7fdcb01376e0 2023-12-01T15:43:50.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcaf59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdcb006c580 0x7fdcb01428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcaf59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdcb006c580 0x7fdcb01428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46740/0 (socket says 172.21.15.63:46740) 2023-12-01T15:43:50.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcaf59e700 1 -- 172.21.15.63:0/3756010511 learned_addr learned my addr 172.21.15.63:0/3756010511 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:50.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcaed9d700 1 --2- 172.21.15.63:0/3756010511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcb01376e0 0x7fdcb0137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcaf59e700 1 -- 172.21.15.63:0/3756010511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcb01376e0 msgr2=0x7fdcb0137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:50.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcaf59e700 1 --2- 172.21.15.63:0/3756010511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcb01376e0 0x7fdcb0137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcaf59e700 1 -- 172.21.15.63:0/3756010511 >> v1:172.21.15.66:6789/0 conn(0x7fdcb006ba50 legacy=0x7fdcb006be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcaf59e700 1 -- 172.21.15.63:0/3756010511 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb009bf80 con 0x7fdcb006c580 2023-12-01T15:43:50.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcaf59e700 1 --2- 172.21.15.63:0/3756010511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb006c580 0x7fdcb01428c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009e50 tx=0x7fdca800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4182a40ac9b61454 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:50.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcadd9b700 1 -- 172.21.15.63:0/3756010511 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca800e070 con 0x7fdcb006c580 2023-12-01T15:43:50.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcadd9b700 1 -- 172.21.15.63:0/3756010511 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca800b910 con 0x7fdcb006c580 2023-12-01T15:43:50.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcadd9b700 1 -- 172.21.15.63:0/3756010511 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca800bcc0 con 0x7fdcb006c580 2023-12-01T15:43:50.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 -- 172.21.15.63:0/3756010511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb006c580 msgr2=0x7fdcb01428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 --2- 172.21.15.63:0/3756010511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb006c580 0x7fdcb01428c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009e50 tx=0x7fdca800b330 comp rx=0 tx=0).stop 2023-12-01T15:43:50.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 -- 172.21.15.63:0/3756010511 shutdown_connections 2023-12-01T15:43:50.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 --2- 172.21.15.63:0/3756010511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb006c580 0x7fdcb01428c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 --2- 172.21.15.63:0/3756010511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcb01376e0 0x7fdcb0137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 -- 172.21.15.63:0/3756010511 >> 172.21.15.63:0/3756010511 conn(0x7fdcb00737a0 msgr2=0x7fdcb00ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:50.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 -- 172.21.15.63:0/3756010511 shutdown_connections 2023-12-01T15:43:50.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.048+0000 7fdcb4a52700 1 -- 172.21.15.63:0/3756010511 wait complete. 2023-12-01T15:43:50.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcb4a52700 1 Processor -- start 2023-12-01T15:43:50.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcb4a52700 1 -- start start 2023-12-01T15:43:50.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcb4a52700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcb006ba50 0x7fdcb01cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcb4a52700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb006c580 0x7fdcb01cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcb4a52700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcb01376e0 0x7fdcb01cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcb4a52700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00a9e20 con 0x7fdcb006c580 2023-12-01T15:43:50.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcb4a52700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0123a30 con 0x7fdcb006ba50 2023-12-01T15:43:50.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcb4a52700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0123f00 con 0x7fdcb01376e0 2023-12-01T15:43:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcae59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb006c580 0x7fdcb01cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcaed9d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcb006ba50 0x7fdcb01cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcae59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb006c580 0x7fdcb01cf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46746/0 (socket says 172.21.15.63:46746) 2023-12-01T15:43:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcae59c700 1 -- 172.21.15.63:0/4290686419 learned_addr learned my addr 172.21.15.63:0/4290686419 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcaf59e700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcb01376e0 0x7fdcb01cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcae59c700 1 -- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcb01376e0 msgr2=0x7fdcb01cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcae59c700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcb01376e0 0x7fdcb01cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcae59c700 1 -- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcb006ba50 msgr2=0x7fdcb01cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcae59c700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcb006ba50 0x7fdcb01cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcae59c700 1 -- 172.21.15.63:0/4290686419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca8009b30 con 0x7fdcb006c580 2023-12-01T15:43:50.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcae59c700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb006c580 0x7fdcb01cf860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c500 tx=0x7fdca400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdc977fe700 1 -- 172.21.15.63:0/4290686419 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40052d0 con 0x7fdcb006c580 2023-12-01T15:43:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdc977fe700 1 -- 172.21.15.63:0/4290686419 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca4005430 con 0x7fdcb006c580 2023-12-01T15:43:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcb4a52700 1 -- 172.21.15.63:0/4290686419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb00a86b0 con 0x7fdcb006c580 2023-12-01T15:43:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdc977fe700 1 -- 172.21.15.63:0/4290686419 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40055a0 con 0x7fdcb006c580 2023-12-01T15:43:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.052+0000 7fdcb4a52700 1 -- 172.21.15.63:0/4290686419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb00a8f90 con 0x7fdcb006c580 2023-12-01T15:43:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.056+0000 7fdcb4a52700 1 -- 172.21.15.63:0/4290686419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb0065fb0 con 0x7fdcb006c580 2023-12-01T15:43:50.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.056+0000 7fdc977fe700 1 -- 172.21.15.63:0/4290686419 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdca40038e0 con 0x7fdcb006c580 2023-12-01T15:43:50.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.056+0000 7fdc977fe700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdc9c065ad0 0x7fdc9c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.056+0000 7fdc977fe700 1 -- 172.21.15.63:0/4290686419 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fdca4081ec0 con 0x7fdcb006c580 2023-12-01T15:43:50.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.056+0000 7fdcaed9d700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdc9c065ad0 0x7fdc9c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.060+0000 7fdcaed9d700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdc9c065ad0 0x7fdc9c067f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009bf0 tx=0x7fdca0009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:50.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.064+0000 7fdc977fe700 1 -- 172.21.15.63:0/4290686419 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fdca404fdd0 con 0x7fdcb006c580 2023-12-01T15:43:50.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.228+0000 7fdcb4a52700 1 -- 172.21.15.63:0/4290686419 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdcb009e8a0 con 0x7fdc9c065ad0 2023-12-01T15:43:50.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.244+0000 7fdc977fe700 1 -- 172.21.15.63:0/4290686419 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261589 (secure 0 0 0) 0x7fdca00118c0 con 0x7fdc9c065ad0 2023-12-01T15:43:50.252 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:50.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.248+0000 7fdcb4a52700 1 -- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdc9c065ad0 msgr2=0x7fdc9c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.248+0000 7fdcb4a52700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdc9c065ad0 0x7fdc9c067f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009bf0 tx=0x7fdca0009240 comp rx=0 tx=0).stop 2023-12-01T15:43:50.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.248+0000 7fdcb4a52700 1 -- 172.21.15.63:0/4290686419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb006c580 msgr2=0x7fdcb01cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.248+0000 7fdcb4a52700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb006c580 0x7fdcb01cf860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c500 tx=0x7fdca400c810 comp rx=0 tx=0).stop 2023-12-01T15:43:50.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.248+0000 7fdcb4a52700 1 -- 172.21.15.63:0/4290686419 shutdown_connections 2023-12-01T15:43:50.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.248+0000 7fdcb4a52700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdc9c065ad0 0x7fdc9c067f90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.248+0000 7fdcb4a52700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcb01376e0 0x7fdcb01cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.248+0000 7fdcb4a52700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb006c580 0x7fdcb01cf860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.248+0000 7fdcb4a52700 1 --2- 172.21.15.63:0/4290686419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcb006ba50 0x7fdcb01cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.248+0000 7fdcb4a52700 1 -- 172.21.15.63:0/4290686419 >> 172.21.15.63:0/4290686419 conn(0x7fdcb00737a0 msgr2=0x7fdcb00aa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:50.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.252+0000 7fdcb4a52700 1 -- 172.21.15.63:0/4290686419 shutdown_connections 2023-12-01T15:43:50.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.252+0000 7fdcb4a52700 1 -- 172.21.15.63:0/4290686419 wait complete. 2023-12-01T15:43:50.255 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T15:43:50.269 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-01T15:43:48.370305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109496,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377864,"statfs":{"total":386547056640,"available":386434932736,"internally_reserved":0,"allocated":1728512,"data_stored":1353596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.201911"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177835+0000","last_change":"2023-12-01T15:43:44.177835+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177835+0000","last_undegraded":"2023-12-01T15:43:44.177835+0000","last_fullsized":"2023-12-01T15:43:44.177835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177678+0000","last_change":"2023-12-01T15:43:44.177678+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177678+0000","last_undegraded":"2023-12-01T15:43:44.177678+0000","last_fullsized":"2023-12-01T15:43:44.177678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178829+0000","last_change":"2023-12-01T15:43:44.178829+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178829+0000","last_undegraded":"2023-12-01T15:43:44.178829+0000","last_fullsized":"2023-12-01T15:43:44.178829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177445+0000","last_change":"2023-12-01T15:43:44.177445+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177445+0000","last_undegraded":"2023-12-01T15:43:44.177445+0000","last_fullsized":"2023-12-01T15:43:44.177445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.173621+0000","last_change":"2023-12-01T15:43:44.173621+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.173621+0000","last_undegraded":"2023-12-01T15:43:44.173621+0000","last_fullsized":"2023-12-01T15:43:44.173621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172367+0000","last_change":"2023-12-01T15:43:44.172367+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172367+0000","last_undegraded":"2023-12-01T15:43:44.172367+0000","last_fullsized":"2023-12-01T15:43:44.172367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177596+0000","last_change":"2023-12-01T15:43:44.177596+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177596+0000","last_undegraded":"2023-12-01T15:43:44.177596+0000","last_fullsized":"2023-12-01T15:43:44.177596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178034+0000","last_change":"2023-12-01T15:43:44.178034+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178034+0000","last_undegraded":"2023-12-01T15:43:44.178034+0000","last_fullsized":"2023-12-01T15:43:44.178034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174493+0000","last_change":"2023-12-01T15:43:44.174493+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174493+0000","last_undegraded":"2023-12-01T15:43:44.174493+0000","last_fullsized":"2023-12-01T15:43:44.174493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178340+0000","last_change":"2023-12-01T15:43:44.178340+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178340+0000","last_undegraded":"2023-12-01T15:43:44.178340+0000","last_fullsized":"2023-12-01T15:43:44.178340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178112+0000","last_change":"2023-12-01T15:43:44.178112+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178112+0000","last_undegraded":"2023-12-01T15:43:44.178112+0000","last_fullsized":"2023-12-01T15:43:44.178112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174492+0000","last_change":"2023-12-01T15:43:44.174492+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174492+0000","last_undegraded":"2023-12-01T15:43:44.174492+0000","last_fullsized":"2023-12-01T15:43:44.174492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":164,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-01T15:43:42.415749+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:43:42.415749+0000","last_peered":"2023-12-01T15:43:42.415749+0000","last_clean":"2023-12-01T15:43:42.415749+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:43:42.415749+0000","last_undegraded":"2023-12-01T15:43:42.415749+0000","last_fullsized":"2023-12-01T15:43:42.415749+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:09:18.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180408+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:43:44.180408+0000","last_peered":"2023-12-01T15:43:44.180408+0000","last_clean":"2023-12-01T15:43:44.180408+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:43:44.180408+0000","last_undegraded":"2023-12-01T15:43:44.180408+0000","last_fullsized":"2023-12-01T15:43:44.180408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:10:37.881379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172555+0000","last_change":"2023-12-01T15:43:44.172555+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172555+0000","last_undegraded":"2023-12-01T15:43:44.172555+0000","last_fullsized":"2023-12-01T15:43:44.172555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180785+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:43:44.180785+0000","last_peered":"2023-12-01T15:43:44.180785+0000","last_clean":"2023-12-01T15:43:44.180785+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:43:44.180785+0000","last_undegraded":"2023-12-01T15:43:44.180785+0000","last_fullsized":"2023-12-01T15:43:44.180785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177601+0000","last_change":"2023-12-01T15:43:44.177601+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177601+0000","last_undegraded":"2023-12-01T15:43:44.177601+0000","last_fullsized":"2023-12-01T15:43:44.177601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.169629+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:43:44.169629+0000","last_peered":"2023-12-01T15:43:44.169629+0000","last_clean":"2023-12-01T15:43:44.169629+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:43:44.169629+0000","last_undegraded":"2023-12-01T15:43:44.169629+0000","last_fullsized":"2023-12-01T15:43:44.169629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:05:36.049760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172302+0000","last_change":"2023-12-01T15:43:44.172302+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172302+0000","last_undegraded":"2023-12-01T15:43:44.172302+0000","last_fullsized":"2023-12-01T15:43:44.172302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180183+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:43:44.180183+0000","last_peered":"2023-12-01T15:43:44.180183+0000","last_clean":"2023-12-01T15:43:44.180183+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:43:44.180183+0000","last_undegraded":"2023-12-01T15:43:44.180183+0000","last_fullsized":"2023-12-01T15:43:44.180183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:11:42.240939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172880+0000","last_change":"2023-12-01T15:43:44.172880+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172880+0000","last_undegraded":"2023-12-01T15:43:44.172880+0000","last_fullsized":"2023-12-01T15:43:44.172880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172301+0000","last_change":"2023-12-01T15:43:44.172301+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172301+0000","last_undegraded":"2023-12-01T15:43:44.172301+0000","last_fullsized":"2023-12-01T15:43:44.172301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.169631+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:43:44.169631+0000","last_peered":"2023-12-01T15:43:44.169631+0000","last_clean":"2023-12-01T15:43:44.169631+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:43:44.169631+0000","last_undegraded":"2023-12-01T15:43:44.169631+0000","last_fullsized":"2023-12-01T15:43:44.169631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172354+0000","last_change":"2023-12-01T15:43:44.172354+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172354+0000","last_undegraded":"2023-12-01T15:43:44.172354+0000","last_fullsized":"2023-12-01T15:43:44.172354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180267+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:43:44.180267+0000","last_peered":"2023-12-01T15:43:44.180267+0000","last_clean":"2023-12-01T15:43:44.180267+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:43:44.180267+0000","last_undegraded":"2023-12-01T15:43:44.180267+0000","last_fullsized":"2023-12-01T15:43:44.180267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:50:39.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172429+0000","last_change":"2023-12-01T15:43:44.172429+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172429+0000","last_undegraded":"2023-12-01T15:43:44.172429+0000","last_fullsized":"2023-12-01T15:43:44.172429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.169724+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:43:44.169724+0000","last_peered":"2023-12-01T15:43:44.169724+0000","last_clean":"2023-12-01T15:43:44.169724+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:43:44.169724+0000","last_undegraded":"2023-12-01T15:43:44.169724+0000","last_fullsized":"2023-12-01T15:43:44.169724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:40:03.704778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178100+0000","last_change":"2023-12-01T15:43:44.178100+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178100+0000","last_undegraded":"2023-12-01T15:43:44.178100+0000","last_fullsized":"2023-12-01T15:43:44.178100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-01T15:43:44.180310+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:43:44.180310+0000","last_peered":"2023-12-01T15:43:44.180310+0000","last_clean":"2023-12-01T15:43:44.180310+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:43:44.180310+0000","last_undegraded":"2023-12-01T15:43:44.180310+0000","last_fullsized":"2023-12-01T15:43:44.180310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:55:21.181781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.178608+0000","last_change":"2023-12-01T15:43:44.178608+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.178608+0000","last_undegraded":"2023-12-01T15:43:44.178608+0000","last_fullsized":"2023-12-01T15:43:44.178608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174268+0000","last_change":"2023-12-01T15:43:44.174268+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174268+0000","last_undegraded":"2023-12-01T15:43:44.174268+0000","last_fullsized":"2023-12-01T15:43:44.174268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.174492+0000","last_change":"2023-12-01T15:43:44.174492+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.174492+0000","last_undegraded":"2023-12-01T15:43:44.174492+0000","last_fullsized":"2023-12-01T15:43:44.174492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177467+0000","last_change":"2023-12-01T15:43:44.177467+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177467+0000","last_undegraded":"2023-12-01T15:43:44.177467+0000","last_fullsized":"2023-12-01T15:43:44.177467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.175824+0000","last_change":"2023-12-01T15:43:44.175824+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.175824+0000","last_undegraded":"2023-12-01T15:43:44.175824+0000","last_fullsized":"2023-12-01T15:43:44.175824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.175900+0000","last_change":"2023-12-01T15:43:44.175900+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.175900+0000","last_undegraded":"2023-12-01T15:43:44.175900+0000","last_fullsized":"2023-12-01T15:43:44.175900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.172211+0000","last_change":"2023-12-01T15:43:44.172211+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.172211+0000","last_undegraded":"2023-12-01T15:43:44.172211+0000","last_fullsized":"2023-12-01T15:43:44.172211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.177339+0000","last_change":"2023-12-01T15:43:44.177339+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.177339+0000","last_undegraded":"2023-12-01T15:43:44.177339+0000","last_fullsized":"2023-12-01T15:43:44.177339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.173504+0000","last_change":"2023-12-01T15:43:44.173504+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.173504+0000","last_undegraded":"2023-12-01T15:43:44.173504+0000","last_fullsized":"2023-12-01T15:43:44.173504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.179586+0000","last_change":"2023-12-01T15:43:44.179586+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.179586+0000","last_undegraded":"2023-12-01T15:43:44.179586+0000","last_fullsized":"2023-12-01T15:43:44.179586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.180072+0000","last_change":"2023-12-01T15:43:44.180072+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.180072+0000","last_undegraded":"2023-12-01T15:43:44.180072+0000","last_fullsized":"2023-12-01T15:43:44.180072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-01T15:43:45.166620+0000","last_change":"2023-12-01T15:43:45.166620+0000","last_active":"2023-12-01T15:43:45.166620+0000","last_peered":"2023-12-01T15:43:45.166620+0000","last_clean":"2023-12-01T15:43:45.166620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:45.166620+0000","last_undegraded":"2023-12-01T15:43:45.166620+0000","last_fullsized":"2023-12-01T15:43:45.166620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-12-01T15:43:44.180062+0000","last_change":"2023-12-01T15:43:44.180062+0000","last_active":"2023-12-01T15:43:44.161907+0000","last_peered":"2023-12-01T15:43:44.161907+0000","last_clean":"2023-12-01T15:43:44.161907+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-01T15:43:44.180062+0000","last_undegraded":"2023-12-01T15:43:44.180062+0000","last_fullsized":"2023-12-01T15:43:44.180062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":733184,"data_stored":635804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":131072,"data_stored":40994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27088,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344752,"statfs":{"total":96636764160,"available":96609026048,"internally_reserved":0,"allocated":139264,"data_stored":45436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":724992,"data_stored":631362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T15:43:50.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-12-01T15:43:50.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-12-01T15:43:50.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-12-01T15:43:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-12-01T15:43:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-12-01T15:43:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-12-01T15:43:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-12-01T15:43:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-12-01T15:43:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-12-01T15:43:50.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-12-01T15:43:50.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-12-01T15:43:50.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-12-01T15:43:50.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-12-01T15:43:50.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-12-01T15:43:50.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-12-01T15:43:50.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-12-01T15:43:50.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-12-01T15:43:50.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-12-01T15:43:50.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-12-01T15:43:50.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-12-01T15:43:50.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-12-01T15:43:50.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-12-01T15:43:50.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-12-01T15:43:50.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-12-01T15:43:50.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-12-01T15:43:50.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-12-01T15:43:50.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-12-01T15:43:50.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-12-01T15:43:50.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-12-01T15:43:50.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-12-01T15:43:50.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-12-01T15:43:50.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-12-01T15:43:50.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-12-01T15:43:50.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-12-01T15:43:50.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.177835+0000', 'last_change': '2023-12-01T15:43:44.177835+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.177835+0000', 'last_undegraded': '2023-12-01T15:43:44.177835+0000', 'last_fullsized': '2023-12-01T15:43:44.177835+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-01T15:43:50.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-12-01T15:43:50.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-12-01T15:43:50.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.177678+0000', 'last_change': '2023-12-01T15:43:44.177678+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.177678+0000', 'last_undegraded': '2023-12-01T15:43:44.177678+0000', 'last_fullsized': '2023-12-01T15:43:44.177678+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-01T15:43:50.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-12-01T15:43:50.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-12-01T15:43:50.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.178829+0000', 'last_change': '2023-12-01T15:43:44.178829+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.178829+0000', 'last_undegraded': '2023-12-01T15:43:44.178829+0000', 'last_fullsized': '2023-12-01T15:43:44.178829+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-01T15:43:50.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-12-01T15:43:50.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-12-01T15:43:50.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.177445+0000', 'last_change': '2023-12-01T15:43:44.177445+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.177445+0000', 'last_undegraded': '2023-12-01T15:43:44.177445+0000', 'last_fullsized': '2023-12-01T15:43:44.177445+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-01T15:43:50.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-12-01T15:43:50.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.173621+0000', 'last_change': '2023-12-01T15:43:44.173621+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.173621+0000', 'last_undegraded': '2023-12-01T15:43:44.173621+0000', 'last_fullsized': '2023-12-01T15:43:44.173621+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-01T15:43:50.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-12-01T15:43:50.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-12-01T15:43:50.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.172367+0000', 'last_change': '2023-12-01T15:43:44.172367+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.172367+0000', 'last_undegraded': '2023-12-01T15:43:44.172367+0000', 'last_fullsized': '2023-12-01T15:43:44.172367+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-01T15:43:50.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-12-01T15:43:50.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-12-01T15:43:50.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.177596+0000', 'last_change': '2023-12-01T15:43:44.177596+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.177596+0000', 'last_undegraded': '2023-12-01T15:43:44.177596+0000', 'last_fullsized': '2023-12-01T15:43:44.177596+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-01T15:43:50.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-12-01T15:43:50.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-12-01T15:43:50.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.178034+0000', 'last_change': '2023-12-01T15:43:44.178034+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.178034+0000', 'last_undegraded': '2023-12-01T15:43:44.178034+0000', 'last_fullsized': '2023-12-01T15:43:44.178034+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-01T15:43:50.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-12-01T15:43:50.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-12-01T15:43:50.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.174493+0000', 'last_change': '2023-12-01T15:43:44.174493+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.174493+0000', 'last_undegraded': '2023-12-01T15:43:44.174493+0000', 'last_fullsized': '2023-12-01T15:43:44.174493+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-01T15:43:50.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-12-01T15:43:50.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-12-01T15:43:50.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.178340+0000', 'last_change': '2023-12-01T15:43:44.178340+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.178340+0000', 'last_undegraded': '2023-12-01T15:43:44.178340+0000', 'last_fullsized': '2023-12-01T15:43:44.178340+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-01T15:43:50.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-12-01T15:43:50.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-12-01T15:43:50.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.178112+0000', 'last_change': '2023-12-01T15:43:44.178112+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.178112+0000', 'last_undegraded': '2023-12-01T15:43:44.178112+0000', 'last_fullsized': '2023-12-01T15:43:44.178112+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-01T15:43:50.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-12-01T15:43:50.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-12-01T15:43:50.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.174492+0000', 'last_change': '2023-12-01T15:43:44.174492+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.174492+0000', 'last_undegraded': '2023-12-01T15:43:44.174492+0000', 'last_fullsized': '2023-12-01T15:43:44.174492+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-01T15:43:50.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-12-01T15:43:50.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-12-01T15:43:50.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.172555+0000', 'last_change': '2023-12-01T15:43:44.172555+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.172555+0000', 'last_undegraded': '2023-12-01T15:43:44.172555+0000', 'last_fullsized': '2023-12-01T15:43:44.172555+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-01T15:43:50.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-12-01T15:43:50.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-12-01T15:43:50.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.177601+0000', 'last_change': '2023-12-01T15:43:44.177601+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.177601+0000', 'last_undegraded': '2023-12-01T15:43:44.177601+0000', 'last_fullsized': '2023-12-01T15:43:44.177601+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-01T15:43:50.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-12-01T15:43:50.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-12-01T15:43:50.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.172302+0000', 'last_change': '2023-12-01T15:43:44.172302+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.172302+0000', 'last_undegraded': '2023-12-01T15:43:44.172302+0000', 'last_fullsized': '2023-12-01T15:43:44.172302+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-01T15:43:50.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-12-01T15:43:50.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-12-01T15:43:50.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.172880+0000', 'last_change': '2023-12-01T15:43:44.172880+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.172880+0000', 'last_undegraded': '2023-12-01T15:43:44.172880+0000', 'last_fullsized': '2023-12-01T15:43:44.172880+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-01T15:43:50.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-12-01T15:43:50.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-12-01T15:43:50.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.172301+0000', 'last_change': '2023-12-01T15:43:44.172301+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.172301+0000', 'last_undegraded': '2023-12-01T15:43:44.172301+0000', 'last_fullsized': '2023-12-01T15:43:44.172301+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-01T15:43:50.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-12-01T15:43:50.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-12-01T15:43:50.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.172354+0000', 'last_change': '2023-12-01T15:43:44.172354+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.172354+0000', 'last_undegraded': '2023-12-01T15:43:44.172354+0000', 'last_fullsized': '2023-12-01T15:43:44.172354+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-01T15:43:50.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-12-01T15:43:50.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-12-01T15:43:50.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.172429+0000', 'last_change': '2023-12-01T15:43:44.172429+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.172429+0000', 'last_undegraded': '2023-12-01T15:43:44.172429+0000', 'last_fullsized': '2023-12-01T15:43:44.172429+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-01T15:43:50.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-12-01T15:43:50.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-12-01T15:43:50.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.178100+0000', 'last_change': '2023-12-01T15:43:44.178100+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.178100+0000', 'last_undegraded': '2023-12-01T15:43:44.178100+0000', 'last_fullsized': '2023-12-01T15:43:44.178100+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-01T15:43:50.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-12-01T15:43:50.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-12-01T15:43:50.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-12-01T15:43:50.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.178608+0000', 'last_change': '2023-12-01T15:43:44.178608+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.178608+0000', 'last_undegraded': '2023-12-01T15:43:44.178608+0000', 'last_fullsized': '2023-12-01T15:43:44.178608+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-01T15:43:50.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-12-01T15:43:50.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-12-01T15:43:50.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.174268+0000', 'last_change': '2023-12-01T15:43:44.174268+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.174268+0000', 'last_undegraded': '2023-12-01T15:43:44.174268+0000', 'last_fullsized': '2023-12-01T15:43:44.174268+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-01T15:43:50.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-12-01T15:43:50.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.174492+0000', 'last_change': '2023-12-01T15:43:44.174492+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.174492+0000', 'last_undegraded': '2023-12-01T15:43:44.174492+0000', 'last_fullsized': '2023-12-01T15:43:44.174492+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-01T15:43:50.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-12-01T15:43:50.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-12-01T15:43:50.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.177467+0000', 'last_change': '2023-12-01T15:43:44.177467+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.177467+0000', 'last_undegraded': '2023-12-01T15:43:44.177467+0000', 'last_fullsized': '2023-12-01T15:43:44.177467+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-01T15:43:50.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-12-01T15:43:50.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-12-01T15:43:50.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-12-01T15:43:50.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.175824+0000', 'last_change': '2023-12-01T15:43:44.175824+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.175824+0000', 'last_undegraded': '2023-12-01T15:43:44.175824+0000', 'last_fullsized': '2023-12-01T15:43:44.175824+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-01T15:43:50.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-12-01T15:43:50.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-12-01T15:43:50.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.175900+0000', 'last_change': '2023-12-01T15:43:44.175900+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.175900+0000', 'last_undegraded': '2023-12-01T15:43:44.175900+0000', 'last_fullsized': '2023-12-01T15:43:44.175900+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-01T15:43:50.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-12-01T15:43:50.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-12-01T15:43:50.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.172211+0000', 'last_change': '2023-12-01T15:43:44.172211+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.172211+0000', 'last_undegraded': '2023-12-01T15:43:44.172211+0000', 'last_fullsized': '2023-12-01T15:43:44.172211+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-01T15:43:50.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-12-01T15:43:50.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-12-01T15:43:50.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.177339+0000', 'last_change': '2023-12-01T15:43:44.177339+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.177339+0000', 'last_undegraded': '2023-12-01T15:43:44.177339+0000', 'last_fullsized': '2023-12-01T15:43:44.177339+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-01T15:43:50.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-12-01T15:43:50.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-12-01T15:43:50.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.173504+0000', 'last_change': '2023-12-01T15:43:44.173504+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.173504+0000', 'last_undegraded': '2023-12-01T15:43:44.173504+0000', 'last_fullsized': '2023-12-01T15:43:44.173504+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-01T15:43:50.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-12-01T15:43:50.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-12-01T15:43:50.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.179586+0000', 'last_change': '2023-12-01T15:43:44.179586+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.179586+0000', 'last_undegraded': '2023-12-01T15:43:44.179586+0000', 'last_fullsized': '2023-12-01T15:43:44.179586+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-01T15:43:50.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-12-01T15:43:50.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-12-01T15:43:50.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.180072+0000', 'last_change': '2023-12-01T15:43:44.180072+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.180072+0000', 'last_undegraded': '2023-12-01T15:43:44.180072+0000', 'last_fullsized': '2023-12-01T15:43:44.180072+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-01T15:43:50.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-12-01T15:43:50.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-01T15:43:45.166620+0000', 'last_change': '2023-12-01T15:43:45.166620+0000', 'last_active': '2023-12-01T15:43:45.166620+0000', 'last_peered': '2023-12-01T15:43:45.166620+0000', 'last_clean': '2023-12-01T15:43:45.166620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:45.166620+0000', 'last_undegraded': '2023-12-01T15:43:45.166620+0000', 'last_fullsized': '2023-12-01T15:43:45.166620+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:45.166620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-01T15:43:50.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-12-01T15:43:50.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-12-01T15:43:44.180062+0000', 'last_change': '2023-12-01T15:43:44.180062+0000', 'last_active': '2023-12-01T15:43:44.161907+0000', 'last_peered': '2023-12-01T15:43:44.161907+0000', 'last_clean': '2023-12-01T15:43:44.161907+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-01T15:43:44.180062+0000', 'last_undegraded': '2023-12-01T15:43:44.180062+0000', 'last_fullsized': '2023-12-01T15:43:44.180062+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'last_clean_scrub_stamp': '2023-12-01T15:43:44.161907+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-01T15:43:50.296 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-01T15:43:50.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbb59e700 1 Processor -- start 2023-12-01T15:43:50.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbb59e700 1 -- start start 2023-12-01T15:43:50.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbb59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc1376e0 0x7f1cbc137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbb59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1cbc06c580 0x7f1cbc1428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbb59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc09c240 con 0x7f1cbc06ba50 2023-12-01T15:43:50.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbb59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cbc138000 con 0x7f1cbc06c580 2023-12-01T15:43:50.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbb59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc09bc90 con 0x7f1cbc1376e0 2023-12-01T15:43:50.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbad9d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1cbc06c580 0x7f1cbc1428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cba59c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc1376e0 0x7f1cbc137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbad9d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1cbc06c580 0x7f1cbc1428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:48370/0 (socket says 172.21.15.63:48370) 2023-12-01T15:43:50.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cba59c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc1376e0 0x7f1cbc137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:54748/0 (socket says 172.21.15.63:54748) 2023-12-01T15:43:50.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbad9d700 1 -- 172.21.15.63:0/3268938262 learned_addr learned my addr 172.21.15.63:0/3268938262 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:50.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbad9d700 1 -- 172.21.15.63:0/3268938262 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc1376e0 msgr2=0x7f1cbc137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:50.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.404+0000 7f1cbad9d700 1 --2- 172.21.15.63:0/3268938262 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc1376e0 0x7f1cbc137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbad9d700 1 -- 172.21.15.63:0/3268938262 >> v1:172.21.15.66:6789/0 conn(0x7f1cbc06ba50 legacy=0x7f1cbc06be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cb959a700 1 -- 172.21.15.63:0/3268938262 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815543373 0 0) 0x7f1cbc09c240 con 0x7f1cbc06ba50 2023-12-01T15:43:50.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbad9d700 1 -- 172.21.15.63:0/3268938262 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc09bf80 con 0x7f1cbc06c580 2023-12-01T15:43:50.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cba59c700 1 --2- 172.21.15.63:0/3268938262 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc1376e0 0x7f1cbc137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:50.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbad9d700 1 --2- 172.21.15.63:0/3268938262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cbc06c580 0x7f1cbc1428c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009e50 tx=0x7f1cb400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7bd2796e7f2804f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:50.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cb959a700 1 -- 172.21.15.63:0/3268938262 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400e070 con 0x7f1cbc06c580 2023-12-01T15:43:50.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cb959a700 1 -- 172.21.15.63:0/3268938262 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb400b910 con 0x7f1cbc06c580 2023-12-01T15:43:50.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cb959a700 1 -- 172.21.15.63:0/3268938262 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400bcc0 con 0x7f1cbc06c580 2023-12-01T15:43:50.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 -- 172.21.15.63:0/3268938262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cbc06c580 msgr2=0x7f1cbc1428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 --2- 172.21.15.63:0/3268938262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cbc06c580 0x7f1cbc1428c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009e50 tx=0x7f1cb400b330 comp rx=0 tx=0).stop 2023-12-01T15:43:50.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 -- 172.21.15.63:0/3268938262 shutdown_connections 2023-12-01T15:43:50.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 --2- 172.21.15.63:0/3268938262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cbc06c580 0x7f1cbc1428c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 --2- 172.21.15.63:0/3268938262 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc1376e0 0x7f1cbc137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 -- 172.21.15.63:0/3268938262 >> 172.21.15.63:0/3268938262 conn(0x7f1cbc0737a0 msgr2=0x7f1cbc0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:50.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 -- 172.21.15.63:0/3268938262 shutdown_connections 2023-12-01T15:43:50.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 -- 172.21.15.63:0/3268938262 wait complete. 2023-12-01T15:43:50.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 Processor -- start 2023-12-01T15:43:50.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 -- start start 2023-12-01T15:43:50.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc06ba50 0x7f1cbc1cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cbc06c580 0x7f1cbc1cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cbc1376e0 0x7f1cbc1cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc138200 con 0x7f1cbc06c580 2023-12-01T15:43:50.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc1cb9e0 con 0x7f1cbc1376e0 2023-12-01T15:43:50.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cbb59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0a33b0 con 0x7f1cbc06ba50 2023-12-01T15:43:50.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.408+0000 7f1cb9d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cbc06c580 0x7f1cbc1cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cba59c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc06ba50 0x7f1cbc1cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cb9d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cbc06c580 0x7f1cbc1cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46748/0 (socket says 172.21.15.63:46748) 2023-12-01T15:43:50.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cbad9d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cbc1376e0 0x7f1cbc1cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cba59c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc06ba50 0x7f1cbc1cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:54760/0 (socket says 172.21.15.63:54760) 2023-12-01T15:43:50.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cba59c700 1 -- 172.21.15.63:0/2540411533 learned_addr learned my addr 172.21.15.63:0/2540411533 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:50.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cb9d9b700 1 -- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc06ba50 msgr2=0x7f1cbc1cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cb9d9b700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc06ba50 0x7f1cbc1cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cb9d9b700 1 -- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cbc1376e0 msgr2=0x7f1cbc1cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cb9d9b700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cbc1376e0 0x7f1cbc1cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cb9d9b700 1 -- 172.21.15.63:0/2540411533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0094b0 con 0x7f1cbc06c580 2023-12-01T15:43:50.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cba59c700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc06ba50 0x7f1cbc1cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:50.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cb9d9b700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cbc06c580 0x7f1cbc1cc350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000c410 tx=0x7f1cb000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:50.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1caaffd700 1 -- 172.21.15.63:0/2540411533 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb00054e0 con 0x7f1cbc06c580 2023-12-01T15:43:50.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1caaffd700 1 -- 172.21.15.63:0/2540411533 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb000ce20 con 0x7f1cbc06c580 2023-12-01T15:43:50.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cbb59e700 1 -- 172.21.15.63:0/2540411533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb4009b30 con 0x7f1cbc06c580 2023-12-01T15:43:50.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1caaffd700 1 -- 172.21.15.63:0/2540411533 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb00038e0 con 0x7f1cbc06c580 2023-12-01T15:43:50.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cbb59e700 1 -- 172.21.15.63:0/2540411533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc0a1a80 con 0x7f1cbc06c580 2023-12-01T15:43:50.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.412+0000 7f1cbb59e700 1 -- 172.21.15.63:0/2540411533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cbc065f70 con 0x7f1cbc06c580 2023-12-01T15:43:50.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.416+0000 7f1caaffd700 1 -- 172.21.15.63:0/2540411533 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1cb0003a40 con 0x7f1cbc06c580 2023-12-01T15:43:50.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.416+0000 7f1caaffd700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1c9c065b00 0x7f1c9c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.416+0000 7f1caaffd700 1 -- 172.21.15.63:0/2540411533 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f1cb0082250 con 0x7f1cbc06c580 2023-12-01T15:43:50.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.416+0000 7f1cba59c700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1c9c065b00 0x7f1c9c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.416+0000 7f1cba59c700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1c9c065b00 0x7f1c9c067fc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0ac590 tx=0x7f1cac009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:50.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.420+0000 7f1caaffd700 1 -- 172.21.15.63:0/2540411533 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1cb0050200 con 0x7f1cbc06c580 2023-12-01T15:43:50.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.644+0000 7f1cbb59e700 1 -- 172.21.15.63:0/2540411533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1cbc061d90 con 0x7f1cbc06c580 2023-12-01T15:43:50.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.644+0000 7f1caaffd700 1 -- 172.21.15.63:0/2540411533 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7f1cb0017020 con 0x7f1cbc06c580 2023-12-01T15:43:50.649 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:50.649 INFO:teuthology.orchestra.run.smithi063.stdout:{"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":27,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":19,"num_osds":4,"num_up_osds":4,"osd_up_since":1701445413,"num_in_osds":4,"osd_in_since":1701445405,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":112353280,"bytes_avail":386434703360,"bytes_total":386547056640,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4212}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-12-01T15:43:23.090741+0000","services":{}},"progress_events":{}} 2023-12-01T15:43:50.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 -- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1c9c065b00 msgr2=0x7f1c9c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1c9c065b00 0x7f1c9c067fc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0ac590 tx=0x7f1cac009240 comp rx=0 tx=0).stop 2023-12-01T15:43:50.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 -- 172.21.15.63:0/2540411533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cbc06c580 msgr2=0x7f1cbc1cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cbc06c580 0x7f1cbc1cc350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000c410 tx=0x7f1cb000c720 comp rx=0 tx=0).stop 2023-12-01T15:43:50.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 -- 172.21.15.63:0/2540411533 shutdown_connections 2023-12-01T15:43:50.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1c9c065b00 0x7f1c9c067fc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cbc1376e0 0x7f1cbc1cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cbc06c580 0x7f1cbc1cc350 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 --2- 172.21.15.63:0/2540411533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1cbc06ba50 0x7f1cbc1cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 -- 172.21.15.63:0/2540411533 >> 172.21.15.63:0/2540411533 conn(0x7f1cbc0737a0 msgr2=0x7f1cbc1356c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:50.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 -- 172.21.15.63:0/2540411533 shutdown_connections 2023-12-01T15:43:50.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.648+0000 7f1cbb59e700 1 -- 172.21.15.63:0/2540411533 wait complete. 2023-12-01T15:43:50.668 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-01T15:43:50.668 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T15:43:50.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.772+0000 7f76ea2ca700 1 Processor -- start 2023-12-01T15:43:50.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.772+0000 7f76ea2ca700 1 -- start start 2023-12-01T15:43:50.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.772+0000 7f76ea2ca700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f76e41377a0 0x7f76e4098a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.772+0000 7f76ea2ca700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f76e40a4b40 0x7f76e4098fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.772+0000 7f76ea2ca700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 0x7f76e40994e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.772+0000 7f76ea2ca700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e40a5410 con 0x7f76e40a4b40 2023-12-01T15:43:50.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.772+0000 7f76ea2ca700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e4136f80 con 0x7f76e41377a0 2023-12-01T15:43:50.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.772+0000 7f76ea2ca700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e41316a0 con 0x7f76e4137b80 2023-12-01T15:43:50.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.772+0000 7f76e8ac7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f76e40a4b40 0x7f76e4098fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.772+0000 7f76e8ac7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f76e40a4b40 0x7f76e4098fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46752/0 (socket says 172.21.15.63:46752) 2023-12-01T15:43:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.772+0000 7f76e8ac7700 1 -- 172.21.15.63:0/3861392564 learned_addr learned my addr 172.21.15.63:0/3861392564 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:50.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76e92c8700 1 --2- 172.21.15.63:0/3861392564 >> v2:172.21.15.66:3300/0 conn(0x7f76e41377a0 0x7f76e4098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76e9ac9700 1 --2- 172.21.15.63:0/3861392564 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 0x7f76e40994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76e8ac7700 1 -- 172.21.15.63:0/3861392564 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 msgr2=0x7f76e40994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76e8ac7700 1 --2- 172.21.15.63:0/3861392564 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 0x7f76e40994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76e8ac7700 1 -- 172.21.15.63:0/3861392564 >> v2:172.21.15.66:3300/0 conn(0x7f76e41377a0 msgr2=0x7f76e4098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76e8ac7700 1 --2- 172.21.15.63:0/3861392564 >> v2:172.21.15.66:3300/0 conn(0x7f76e41377a0 0x7f76e4098a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76e8ac7700 1 -- 172.21.15.63:0/3861392564 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e40a4320 con 0x7f76e40a4b40 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76e92c8700 1 --2- 172.21.15.63:0/3861392564 >> v2:172.21.15.66:3300/0 conn(0x7f76e41377a0 0x7f76e4098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76e9ac9700 1 --2- 172.21.15.63:0/3861392564 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 0x7f76e40994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76e8ac7700 1 --2- 172.21.15.63:0/3861392564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76e40a4b40 0x7f76e4098fa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76e40734a0 tx=0x7f76e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6875e1368453b0a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76dbfff700 1 -- 172.21.15.63:0/3861392564 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e000e070 con 0x7f76e40a4b40 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76dbfff700 1 -- 172.21.15.63:0/3861392564 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e000b9c0 con 0x7f76e40a4b40 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76dbfff700 1 -- 172.21.15.63:0/3861392564 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e000bd70 con 0x7f76e40a4b40 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 -- 172.21.15.63:0/3861392564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76e40a4b40 msgr2=0x7f76e4098fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 --2- 172.21.15.63:0/3861392564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76e40a4b40 0x7f76e4098fa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76e40734a0 tx=0x7f76e000b330 comp rx=0 tx=0).stop 2023-12-01T15:43:50.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 -- 172.21.15.63:0/3861392564 shutdown_connections 2023-12-01T15:43:50.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 --2- 172.21.15.63:0/3861392564 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 0x7f76e40994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 --2- 172.21.15.63:0/3861392564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76e40a4b40 0x7f76e4098fa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 --2- 172.21.15.63:0/3861392564 >> v2:172.21.15.66:3300/0 conn(0x7f76e41377a0 0x7f76e4098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 -- 172.21.15.63:0/3861392564 >> 172.21.15.63:0/3861392564 conn(0x7f76e40a58a0 msgr2=0x7f76e40a5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:50.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 -- 172.21.15.63:0/3861392564 shutdown_connections 2023-12-01T15:43:50.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 -- 172.21.15.63:0/3861392564 wait complete. 2023-12-01T15:43:50.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 Processor -- start 2023-12-01T15:43:50.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 -- start start 2023-12-01T15:43:50.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76e40a4b40 0x7f76e406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e41377a0 0x7f76e406e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 0x7f76e406e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4070c90 con 0x7f76e40a4b40 2023-12-01T15:43:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4070a60 con 0x7f76e41377a0 2023-12-01T15:43:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.776+0000 7f76ea2ca700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4071900 con 0x7f76e4137b80 2023-12-01T15:43:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e92c8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76e40a4b40 0x7f76e406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e92c8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76e40a4b40 0x7f76e406dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46762/0 (socket says 172.21.15.63:46762) 2023-12-01T15:43:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e92c8700 1 -- 172.21.15.63:0/758148285 learned_addr learned my addr 172.21.15.63:0/758148285 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e9ac9700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 0x7f76e406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e8ac7700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e41377a0 0x7f76e406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e92c8700 1 -- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 msgr2=0x7f76e406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e92c8700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 0x7f76e406e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e92c8700 1 -- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e41377a0 msgr2=0x7f76e406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e92c8700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e41377a0 0x7f76e406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e92c8700 1 -- 172.21.15.63:0/758148285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e0009b30 con 0x7f76e40a4b40 2023-12-01T15:43:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e9ac9700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 0x7f76e406e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76e92c8700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76e40a4b40 0x7f76e406dac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76d400c7c0 tx=0x7f76d400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76d9ffb700 1 -- 172.21.15.63:0/758148285 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4011800 con 0x7f76e40a4b40 2023-12-01T15:43:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76d9ffb700 1 -- 172.21.15.63:0/758148285 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4011960 con 0x7f76e40a4b40 2023-12-01T15:43:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76ea2ca700 1 -- 172.21.15.63:0/758148285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e406f8f0 con 0x7f76e40a4b40 2023-12-01T15:43:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76d9ffb700 1 -- 172.21.15.63:0/758148285 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4011cd0 con 0x7f76e40a4b40 2023-12-01T15:43:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76ea2ca700 1 -- 172.21.15.63:0/758148285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e41200e0 con 0x7f76e40a4b40 2023-12-01T15:43:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76ea2ca700 1 -- 172.21.15.63:0/758148285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e4071750 con 0x7f76e40a4b40 2023-12-01T15:43:50.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76d9ffb700 1 -- 172.21.15.63:0/758148285 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f76d4021350 con 0x7f76e40a4b40 2023-12-01T15:43:50.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76d9ffb700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f76c8065ad0 0x7f76c8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:50.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.780+0000 7f76d9ffb700 1 -- 172.21.15.63:0/758148285 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f76d4082b40 con 0x7f76e40a4b40 2023-12-01T15:43:50.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.784+0000 7f76e8ac7700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f76c8065ad0 0x7f76c8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:50.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.784+0000 7f76e8ac7700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f76c8065ad0 0x7f76c8067f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f76e000b370 tx=0x7f76e0009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:50.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.792+0000 7f76d9ffb700 1 -- 172.21.15.63:0/758148285 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f76d4050af0 con 0x7f76e40a4b40 2023-12-01T15:43:50.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.948+0000 7f76ea2ca700 1 -- 172.21.15.63:0/758148285 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76e40a37a0 con 0x7f76c8065ad0 2023-12-01T15:43:50.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.964+0000 7f76d9ffb700 1 -- 172.21.15.63:0/758148285 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271388 (secure 0 0 0) 0x7f76e0003a40 con 0x7f76c8065ad0 2023-12-01T15:43:50.973 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:50.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 -- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f76c8065ad0 msgr2=0x7f76c8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f76c8065ad0 0x7f76c8067f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f76e000b370 tx=0x7f76e0009000 comp rx=0 tx=0).stop 2023-12-01T15:43:50.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 -- 172.21.15.63:0/758148285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76e40a4b40 msgr2=0x7f76e406dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:50.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76e40a4b40 0x7f76e406dac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76d400c7c0 tx=0x7f76d400cb80 comp rx=0 tx=0).stop 2023-12-01T15:43:50.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 -- 172.21.15.63:0/758148285 shutdown_connections 2023-12-01T15:43:50.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f76c8065ad0 0x7f76c8067f90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76e4137b80 0x7f76e406e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e41377a0 0x7f76e406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 --2- 172.21.15.63:0/758148285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76e40a4b40 0x7f76e406dac0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:50.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 -- 172.21.15.63:0/758148285 >> 172.21.15.63:0/758148285 conn(0x7f76e40a58a0 msgr2=0x7f76e40a2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:50.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 -- 172.21.15.63:0/758148285 shutdown_connections 2023-12-01T15:43:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:50.972+0000 7f76ea2ca700 1 -- 172.21.15.63:0/758148285 wait complete. 2023-12-01T15:43:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T15:43:50.989 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-01T15:43:50.370905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109720,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377640,"statfs":{"total":386547056640,"available":386434703360,"internally_reserved":0,"allocated":1957888,"data_stored":1427848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001884"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842184+0000","last_change":"2023-12-01T15:43:45.574989+0000","last_active":"2023-12-01T15:43:46.842184+0000","last_peered":"2023-12-01T15:43:46.842184+0000","last_clean":"2023-12-01T15:43:46.842184+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:43:46.842184+0000","last_undegraded":"2023-12-01T15:43:46.842184+0000","last_fullsized":"2023-12-01T15:43:46.842184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843053+0000","last_change":"2023-12-01T15:43:45.575246+0000","last_active":"2023-12-01T15:43:46.843053+0000","last_peered":"2023-12-01T15:43:46.843053+0000","last_clean":"2023-12-01T15:43:46.843053+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T15:43:46.843053+0000","last_undegraded":"2023-12-01T15:43:46.843053+0000","last_fullsized":"2023-12-01T15:43:46.843053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568537+0000","last_change":"2023-12-01T15:43:45.586026+0000","last_active":"2023-12-01T15:43:46.568537+0000","last_peered":"2023-12-01T15:43:46.568537+0000","last_clean":"2023-12-01T15:43:46.568537+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:43:46.568537+0000","last_undegraded":"2023-12-01T15:43:46.568537+0000","last_fullsized":"2023-12-01T15:43:46.568537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:52:46.242732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843058+0000","last_change":"2023-12-01T15:43:45.573330+0000","last_active":"2023-12-01T15:43:46.843058+0000","last_peered":"2023-12-01T15:43:46.843058+0000","last_clean":"2023-12-01T15:43:46.843058+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:43:46.843058+0000","last_undegraded":"2023-12-01T15:43:46.843058+0000","last_fullsized":"2023-12-01T15:43:46.843058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841670+0000","last_change":"2023-12-01T15:43:45.573581+0000","last_active":"2023-12-01T15:43:46.841670+0000","last_peered":"2023-12-01T15:43:46.841670+0000","last_clean":"2023-12-01T15:43:46.841670+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T15:43:46.841670+0000","last_undegraded":"2023-12-01T15:43:46.841670+0000","last_fullsized":"2023-12-01T15:43:46.841670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567773+0000","last_change":"2023-12-01T15:43:45.587387+0000","last_active":"2023-12-01T15:43:46.567773+0000","last_peered":"2023-12-01T15:43:46.567773+0000","last_clean":"2023-12-01T15:43:46.567773+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T15:43:46.567773+0000","last_undegraded":"2023-12-01T15:43:46.567773+0000","last_fullsized":"2023-12-01T15:43:46.567773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567363+0000","last_change":"2023-12-01T15:43:45.586845+0000","last_active":"2023-12-01T15:43:46.567363+0000","last_peered":"2023-12-01T15:43:46.567363+0000","last_clean":"2023-12-01T15:43:46.567363+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T15:43:46.567363+0000","last_undegraded":"2023-12-01T15:43:46.567363+0000","last_fullsized":"2023-12-01T15:43:46.567363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567330+0000","last_change":"2023-12-01T15:43:45.589296+0000","last_active":"2023-12-01T15:43:46.567330+0000","last_peered":"2023-12-01T15:43:46.567330+0000","last_clean":"2023-12-01T15:43:46.567330+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:43:46.567330+0000","last_undegraded":"2023-12-01T15:43:46.567330+0000","last_fullsized":"2023-12-01T15:43:46.567330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:31:59.832465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841569+0000","last_change":"2023-12-01T15:43:45.574868+0000","last_active":"2023-12-01T15:43:46.841569+0000","last_peered":"2023-12-01T15:43:46.841569+0000","last_clean":"2023-12-01T15:43:46.841569+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:43:46.841569+0000","last_undegraded":"2023-12-01T15:43:46.841569+0000","last_fullsized":"2023-12-01T15:43:46.841569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568612+0000","last_change":"2023-12-01T15:43:45.586227+0000","last_active":"2023-12-01T15:43:46.568612+0000","last_peered":"2023-12-01T15:43:46.568612+0000","last_clean":"2023-12-01T15:43:46.568612+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:43:46.568612+0000","last_undegraded":"2023-12-01T15:43:46.568612+0000","last_fullsized":"2023-12-01T15:43:46.568612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:00:15.540017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842485+0000","last_change":"2023-12-01T15:43:45.581083+0000","last_active":"2023-12-01T15:43:46.842485+0000","last_peered":"2023-12-01T15:43:46.842485+0000","last_clean":"2023-12-01T15:43:46.842485+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:43:46.842485+0000","last_undegraded":"2023-12-01T15:43:46.842485+0000","last_fullsized":"2023-12-01T15:43:46.842485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565931+0000","last_change":"2023-12-01T15:43:45.573173+0000","last_active":"2023-12-01T15:43:46.565931+0000","last_peered":"2023-12-01T15:43:46.565931+0000","last_clean":"2023-12-01T15:43:46.565931+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T15:43:46.565931+0000","last_undegraded":"2023-12-01T15:43:46.565931+0000","last_fullsized":"2023-12-01T15:43:46.565931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840739+0000","last_change":"2023-12-01T15:43:45.566533+0000","last_active":"2023-12-01T15:43:46.840739+0000","last_peered":"2023-12-01T15:43:46.840739+0000","last_clean":"2023-12-01T15:43:46.840739+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T15:43:46.840739+0000","last_undegraded":"2023-12-01T15:43:46.840739+0000","last_fullsized":"2023-12-01T15:43:46.840739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841752+0000","last_change":"2023-12-01T15:43:45.574865+0000","last_active":"2023-12-01T15:43:46.841752+0000","last_peered":"2023-12-01T15:43:46.841752+0000","last_clean":"2023-12-01T15:43:46.841752+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T15:43:46.841752+0000","last_undegraded":"2023-12-01T15:43:46.841752+0000","last_fullsized":"2023-12-01T15:43:46.841752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841669+0000","last_change":"2023-12-01T15:43:45.575488+0000","last_active":"2023-12-01T15:43:46.841669+0000","last_peered":"2023-12-01T15:43:46.841669+0000","last_clean":"2023-12-01T15:43:46.841669+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:43:46.841669+0000","last_undegraded":"2023-12-01T15:43:46.841669+0000","last_fullsized":"2023-12-01T15:43:46.841669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567257+0000","last_change":"2023-12-01T15:43:45.586172+0000","last_active":"2023-12-01T15:43:46.567257+0000","last_peered":"2023-12-01T15:43:46.567257+0000","last_clean":"2023-12-01T15:43:46.567257+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T15:43:46.567257+0000","last_undegraded":"2023-12-01T15:43:46.567257+0000","last_fullsized":"2023-12-01T15:43:46.567257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:23.641161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841715+0000","last_change":"2023-12-01T15:43:45.571920+0000","last_active":"2023-12-01T15:43:46.841715+0000","last_peered":"2023-12-01T15:43:46.841715+0000","last_clean":"2023-12-01T15:43:46.841715+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T15:43:46.841715+0000","last_undegraded":"2023-12-01T15:43:46.841715+0000","last_fullsized":"2023-12-01T15:43:46.841715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568738+0000","last_change":"2023-12-01T15:43:45.587983+0000","last_active":"2023-12-01T15:43:46.568738+0000","last_peered":"2023-12-01T15:43:46.568738+0000","last_clean":"2023-12-01T15:43:46.568738+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T15:43:46.568738+0000","last_undegraded":"2023-12-01T15:43:46.568738+0000","last_fullsized":"2023-12-01T15:43:46.568738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:46:31.135544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841641+0000","last_change":"2023-12-01T15:43:45.580927+0000","last_active":"2023-12-01T15:43:46.841641+0000","last_peered":"2023-12-01T15:43:46.841641+0000","last_clean":"2023-12-01T15:43:46.841641+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T15:43:46.841641+0000","last_undegraded":"2023-12-01T15:43:46.841641+0000","last_fullsized":"2023-12-01T15:43:46.841641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568127+0000","last_change":"2023-12-01T15:43:45.585911+0000","last_active":"2023-12-01T15:43:46.568127+0000","last_peered":"2023-12-01T15:43:46.568127+0000","last_clean":"2023-12-01T15:43:46.568127+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:43:46.568127+0000","last_undegraded":"2023-12-01T15:43:46.568127+0000","last_fullsized":"2023-12-01T15:43:46.568127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:50.215328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842133+0000","last_change":"2023-12-01T15:43:45.577853+0000","last_active":"2023-12-01T15:43:46.842133+0000","last_peered":"2023-12-01T15:43:46.842133+0000","last_clean":"2023-12-01T15:43:46.842133+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T15:43:46.842133+0000","last_undegraded":"2023-12-01T15:43:46.842133+0000","last_fullsized":"2023-12-01T15:43:46.842133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840481+0000","last_change":"2023-12-01T15:43:45.571656+0000","last_active":"2023-12-01T15:43:46.840481+0000","last_peered":"2023-12-01T15:43:46.840481+0000","last_clean":"2023-12-01T15:43:46.840481+0000","last_became_active":"2023-12-01T15:43:45.571345+0000","last_became_peered":"2023-12-01T15:43:45.571345+0000","last_unstale":"2023-12-01T15:43:46.840481+0000","last_undegraded":"2023-12-01T15:43:46.840481+0000","last_fullsized":"2023-12-01T15:43:46.840481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565285+0000","last_change":"2023-12-01T15:43:45.571661+0000","last_active":"2023-12-01T15:43:46.565285+0000","last_peered":"2023-12-01T15:43:46.565285+0000","last_clean":"2023-12-01T15:43:46.565285+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T15:43:46.565285+0000","last_undegraded":"2023-12-01T15:43:46.565285+0000","last_fullsized":"2023-12-01T15:43:46.565285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567380+0000","last_change":"2023-12-01T15:43:45.588988+0000","last_active":"2023-12-01T15:43:46.567380+0000","last_peered":"2023-12-01T15:43:46.567380+0000","last_clean":"2023-12-01T15:43:46.567380+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:43:46.567380+0000","last_undegraded":"2023-12-01T15:43:46.567380+0000","last_fullsized":"2023-12-01T15:43:46.567380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:16:11.702379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566677+0000","last_change":"2023-12-01T15:43:45.583230+0000","last_active":"2023-12-01T15:43:46.566677+0000","last_peered":"2023-12-01T15:43:46.566677+0000","last_clean":"2023-12-01T15:43:46.566677+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T15:43:46.566677+0000","last_undegraded":"2023-12-01T15:43:46.566677+0000","last_fullsized":"2023-12-01T15:43:46.566677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566484+0000","last_change":"2023-12-01T15:43:45.571094+0000","last_active":"2023-12-01T15:43:46.566484+0000","last_peered":"2023-12-01T15:43:46.566484+0000","last_clean":"2023-12-01T15:43:46.566484+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T15:43:46.566484+0000","last_undegraded":"2023-12-01T15:43:46.566484+0000","last_fullsized":"2023-12-01T15:43:46.566484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568844+0000","last_change":"2023-12-01T15:43:45.588871+0000","last_active":"2023-12-01T15:43:46.568844+0000","last_peered":"2023-12-01T15:43:46.568844+0000","last_clean":"2023-12-01T15:43:46.568844+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T15:43:46.568844+0000","last_undegraded":"2023-12-01T15:43:46.568844+0000","last_fullsized":"2023-12-01T15:43:46.568844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:34:06.793940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566378+0000","last_change":"2023-12-01T15:43:45.581308+0000","last_active":"2023-12-01T15:43:46.566378+0000","last_peered":"2023-12-01T15:43:46.566378+0000","last_clean":"2023-12-01T15:43:46.566378+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T15:43:46.566378+0000","last_undegraded":"2023-12-01T15:43:46.566378+0000","last_fullsized":"2023-12-01T15:43:46.566378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841105+0000","last_change":"2023-12-01T15:43:45.573417+0000","last_active":"2023-12-01T15:43:46.841105+0000","last_peered":"2023-12-01T15:43:46.841105+0000","last_clean":"2023-12-01T15:43:46.841105+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T15:43:46.841105+0000","last_undegraded":"2023-12-01T15:43:46.841105+0000","last_fullsized":"2023-12-01T15:43:46.841105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567788+0000","last_change":"2023-12-01T15:43:45.587201+0000","last_active":"2023-12-01T15:43:46.567788+0000","last_peered":"2023-12-01T15:43:46.567788+0000","last_clean":"2023-12-01T15:43:46.567788+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:43:46.567788+0000","last_undegraded":"2023-12-01T15:43:46.567788+0000","last_fullsized":"2023-12-01T15:43:46.567788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565272+0000","last_change":"2023-12-01T15:43:45.575004+0000","last_active":"2023-12-01T15:43:46.565272+0000","last_peered":"2023-12-01T15:43:46.565272+0000","last_clean":"2023-12-01T15:43:46.565272+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T15:43:46.565272+0000","last_undegraded":"2023-12-01T15:43:46.565272+0000","last_fullsized":"2023-12-01T15:43:46.565272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842058+0000","last_change":"2023-12-01T15:43:45.572838+0000","last_active":"2023-12-01T15:43:46.842058+0000","last_peered":"2023-12-01T15:43:46.842058+0000","last_clean":"2023-12-01T15:43:46.842058+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T15:43:46.842058+0000","last_undegraded":"2023-12-01T15:43:46.842058+0000","last_fullsized":"2023-12-01T15:43:46.842058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566010+0000","last_change":"2023-12-01T15:43:45.581131+0000","last_active":"2023-12-01T15:43:46.566010+0000","last_peered":"2023-12-01T15:43:46.566010+0000","last_clean":"2023-12-01T15:43:46.566010+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:43:46.566010+0000","last_undegraded":"2023-12-01T15:43:46.566010+0000","last_fullsized":"2023-12-01T15:43:46.566010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.591056+0000","last_change":"2023-12-01T15:43:45.205685+0000","last_active":"2023-12-01T15:43:45.591056+0000","last_peered":"2023-12-01T15:43:45.591056+0000","last_clean":"2023-12-01T15:43:45.591056+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T15:43:45.591056+0000","last_undegraded":"2023-12-01T15:43:45.591056+0000","last_fullsized":"2023-12-01T15:43:45.591056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568613+0000","last_change":"2023-12-01T15:43:45.587537+0000","last_active":"2023-12-01T15:43:46.568613+0000","last_peered":"2023-12-01T15:43:46.568613+0000","last_clean":"2023-12-01T15:43:46.568613+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:43:46.568613+0000","last_undegraded":"2023-12-01T15:43:46.568613+0000","last_fullsized":"2023-12-01T15:43:46.568613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:53:22.216155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.553424+0000","last_change":"2023-12-01T15:43:45.203521+0000","last_active":"2023-12-01T15:43:45.553424+0000","last_peered":"2023-12-01T15:43:45.553424+0000","last_clean":"2023-12-01T15:43:45.553424+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T15:43:45.553424+0000","last_undegraded":"2023-12-01T15:43:45.553424+0000","last_fullsized":"2023-12-01T15:43:45.553424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842265+0000","last_change":"2023-12-01T15:43:45.566866+0000","last_active":"2023-12-01T15:43:46.842265+0000","last_peered":"2023-12-01T15:43:46.842265+0000","last_clean":"2023-12-01T15:43:46.842265+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:43:46.842265+0000","last_undegraded":"2023-12-01T15:43:46.842265+0000","last_fullsized":"2023-12-01T15:43:46.842265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.572883+0000","last_change":"2023-12-01T15:43:45.205291+0000","last_active":"2023-12-01T15:43:45.572883+0000","last_peered":"2023-12-01T15:43:45.572883+0000","last_clean":"2023-12-01T15:43:45.572883+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T15:43:45.572883+0000","last_undegraded":"2023-12-01T15:43:45.572883+0000","last_fullsized":"2023-12-01T15:43:45.572883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841968+0000","last_change":"2023-12-01T15:43:45.580597+0000","last_active":"2023-12-01T15:43:46.841968+0000","last_peered":"2023-12-01T15:43:46.841968+0000","last_clean":"2023-12-01T15:43:46.841968+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:43:46.841968+0000","last_undegraded":"2023-12-01T15:43:46.841968+0000","last_fullsized":"2023-12-01T15:43:46.841968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.593904+0000","last_change":"2023-12-01T15:43:45.207762+0000","last_active":"2023-12-01T15:43:45.593904+0000","last_peered":"2023-12-01T15:43:45.593904+0000","last_clean":"2023-12-01T15:43:45.593904+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T15:43:45.593904+0000","last_undegraded":"2023-12-01T15:43:45.593904+0000","last_fullsized":"2023-12-01T15:43:45.593904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571832+0000","last_change":"2023-12-01T15:43:45.203999+0000","last_active":"2023-12-01T15:43:45.571832+0000","last_peered":"2023-12-01T15:43:45.571832+0000","last_clean":"2023-12-01T15:43:45.571832+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T15:43:45.571832+0000","last_undegraded":"2023-12-01T15:43:45.571832+0000","last_fullsized":"2023-12-01T15:43:45.571832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567659+0000","last_change":"2023-12-01T15:43:45.589689+0000","last_active":"2023-12-01T15:43:46.567659+0000","last_peered":"2023-12-01T15:43:46.567659+0000","last_clean":"2023-12-01T15:43:46.567659+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:43:46.567659+0000","last_undegraded":"2023-12-01T15:43:46.567659+0000","last_fullsized":"2023-12-01T15:43:46.567659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:40:12.233063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.574715+0000","last_change":"2023-12-01T15:43:45.201303+0000","last_active":"2023-12-01T15:43:45.574715+0000","last_peered":"2023-12-01T15:43:45.574715+0000","last_clean":"2023-12-01T15:43:45.574715+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T15:43:45.574715+0000","last_undegraded":"2023-12-01T15:43:45.574715+0000","last_fullsized":"2023-12-01T15:43:45.574715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842340+0000","last_change":"2023-12-01T15:43:45.573607+0000","last_active":"2023-12-01T15:43:46.842340+0000","last_peered":"2023-12-01T15:43:46.842340+0000","last_clean":"2023-12-01T15:43:46.842340+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:43:46.842340+0000","last_undegraded":"2023-12-01T15:43:46.842340+0000","last_fullsized":"2023-12-01T15:43:46.842340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.587428+0000","last_change":"2023-12-01T15:43:45.207098+0000","last_active":"2023-12-01T15:43:45.587428+0000","last_peered":"2023-12-01T15:43:45.587428+0000","last_clean":"2023-12-01T15:43:45.587428+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T15:43:45.587428+0000","last_undegraded":"2023-12-01T15:43:45.587428+0000","last_fullsized":"2023-12-01T15:43:45.587428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842099+0000","last_change":"2023-12-01T15:43:45.582490+0000","last_active":"2023-12-01T15:43:46.842099+0000","last_peered":"2023-12-01T15:43:46.842099+0000","last_clean":"2023-12-01T15:43:46.842099+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:43:46.842099+0000","last_undegraded":"2023-12-01T15:43:46.842099+0000","last_fullsized":"2023-12-01T15:43:46.842099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:32:00.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.575523+0000","last_change":"2023-12-01T15:43:45.206777+0000","last_active":"2023-12-01T15:43:45.575523+0000","last_peered":"2023-12-01T15:43:45.575523+0000","last_clean":"2023-12-01T15:43:45.575523+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T15:43:45.575523+0000","last_undegraded":"2023-12-01T15:43:45.575523+0000","last_fullsized":"2023-12-01T15:43:45.575523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841297+0000","last_change":"2023-12-01T15:43:45.573244+0000","last_active":"2023-12-01T15:43:46.841297+0000","last_peered":"2023-12-01T15:43:46.841297+0000","last_clean":"2023-12-01T15:43:46.841297+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:43:46.841297+0000","last_undegraded":"2023-12-01T15:43:46.841297+0000","last_fullsized":"2023-12-01T15:43:46.841297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.581110+0000","last_change":"2023-12-01T15:43:45.204182+0000","last_active":"2023-12-01T15:43:45.581110+0000","last_peered":"2023-12-01T15:43:45.581110+0000","last_clean":"2023-12-01T15:43:45.581110+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T15:43:45.581110+0000","last_undegraded":"2023-12-01T15:43:45.581110+0000","last_fullsized":"2023-12-01T15:43:45.581110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568216+0000","last_change":"2023-12-01T15:43:45.587544+0000","last_active":"2023-12-01T15:43:46.568216+0000","last_peered":"2023-12-01T15:43:46.568216+0000","last_clean":"2023-12-01T15:43:46.568216+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T15:43:46.568216+0000","last_undegraded":"2023-12-01T15:43:46.568216+0000","last_fullsized":"2023-12-01T15:43:46.568216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573616+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:43:45.573616+0000","last_peered":"2023-12-01T15:43:45.573616+0000","last_clean":"2023-12-01T15:43:45.573616+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:43:45.573616+0000","last_undegraded":"2023-12-01T15:43:45.573616+0000","last_fullsized":"2023-12-01T15:43:45.573616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568613+0000","last_change":"2023-12-01T15:43:45.587006+0000","last_active":"2023-12-01T15:43:46.568613+0000","last_peered":"2023-12-01T15:43:46.568613+0000","last_clean":"2023-12-01T15:43:46.568613+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:43:46.568613+0000","last_undegraded":"2023-12-01T15:43:46.568613+0000","last_fullsized":"2023-12-01T15:43:46.568613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:51.219271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573182+0000","last_change":"2023-12-01T15:43:45.206261+0000","last_active":"2023-12-01T15:43:45.573182+0000","last_peered":"2023-12-01T15:43:45.573182+0000","last_clean":"2023-12-01T15:43:45.573182+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T15:43:45.573182+0000","last_undegraded":"2023-12-01T15:43:45.573182+0000","last_fullsized":"2023-12-01T15:43:45.573182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843197+0000","last_change":"2023-12-01T15:43:45.575553+0000","last_active":"2023-12-01T15:43:46.843197+0000","last_peered":"2023-12-01T15:43:46.843197+0000","last_clean":"2023-12-01T15:43:46.843197+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T15:43:46.843197+0000","last_undegraded":"2023-12-01T15:43:46.843197+0000","last_fullsized":"2023-12-01T15:43:46.843197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565758+0000","last_change":"2023-12-01T15:43:45.200481+0000","last_active":"2023-12-01T15:43:45.565758+0000","last_peered":"2023-12-01T15:43:45.565758+0000","last_clean":"2023-12-01T15:43:45.565758+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T15:43:45.565758+0000","last_undegraded":"2023-12-01T15:43:45.565758+0000","last_fullsized":"2023-12-01T15:43:45.565758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566765+0000","last_change":"2023-12-01T15:43:45.583342+0000","last_active":"2023-12-01T15:43:46.566765+0000","last_peered":"2023-12-01T15:43:46.566765+0000","last_clean":"2023-12-01T15:43:46.566765+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:43:46.566765+0000","last_undegraded":"2023-12-01T15:43:46.566765+0000","last_fullsized":"2023-12-01T15:43:46.566765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":167,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.576181+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:43:45.576181+0000","last_peered":"2023-12-01T15:43:45.576181+0000","last_clean":"2023-12-01T15:43:45.576181+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:43:45.576181+0000","last_undegraded":"2023-12-01T15:43:45.576181+0000","last_fullsized":"2023-12-01T15:43:45.576181+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:09:18.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573475+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:43:45.573475+0000","last_peered":"2023-12-01T15:43:45.573475+0000","last_clean":"2023-12-01T15:43:45.573475+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:43:45.573475+0000","last_undegraded":"2023-12-01T15:43:45.573475+0000","last_fullsized":"2023-12-01T15:43:45.573475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:10:37.881379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566049+0000","last_change":"2023-12-01T15:43:45.201766+0000","last_active":"2023-12-01T15:43:45.566049+0000","last_peered":"2023-12-01T15:43:45.566049+0000","last_clean":"2023-12-01T15:43:45.566049+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T15:43:45.566049+0000","last_undegraded":"2023-12-01T15:43:45.566049+0000","last_fullsized":"2023-12-01T15:43:45.566049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568848+0000","last_change":"2023-12-01T15:43:45.590436+0000","last_active":"2023-12-01T15:43:46.568848+0000","last_peered":"2023-12-01T15:43:46.568848+0000","last_clean":"2023-12-01T15:43:46.568848+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:43:46.568848+0000","last_undegraded":"2023-12-01T15:43:46.568848+0000","last_fullsized":"2023-12-01T15:43:46.568848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.576059+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:43:45.576059+0000","last_peered":"2023-12-01T15:43:45.576059+0000","last_clean":"2023-12-01T15:43:45.576059+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:43:45.576059+0000","last_undegraded":"2023-12-01T15:43:45.576059+0000","last_fullsized":"2023-12-01T15:43:45.576059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.553541+0000","last_change":"2023-12-01T15:43:45.209138+0000","last_active":"2023-12-01T15:43:45.553541+0000","last_peered":"2023-12-01T15:43:45.553541+0000","last_clean":"2023-12-01T15:43:45.553541+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T15:43:45.553541+0000","last_undegraded":"2023-12-01T15:43:45.553541+0000","last_fullsized":"2023-12-01T15:43:45.553541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842011+0000","last_change":"2023-12-01T15:43:45.571537+0000","last_active":"2023-12-01T15:43:46.842011+0000","last_peered":"2023-12-01T15:43:46.842011+0000","last_clean":"2023-12-01T15:43:46.842011+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T15:43:46.842011+0000","last_undegraded":"2023-12-01T15:43:46.842011+0000","last_fullsized":"2023-12-01T15:43:46.842011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566045+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:43:45.566045+0000","last_peered":"2023-12-01T15:43:45.566045+0000","last_clean":"2023-12-01T15:43:45.566045+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:43:45.566045+0000","last_undegraded":"2023-12-01T15:43:45.566045+0000","last_fullsized":"2023-12-01T15:43:45.566045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:05:36.049760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565894+0000","last_change":"2023-12-01T15:43:45.204466+0000","last_active":"2023-12-01T15:43:45.565894+0000","last_peered":"2023-12-01T15:43:45.565894+0000","last_clean":"2023-12-01T15:43:45.565894+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T15:43:45.565894+0000","last_undegraded":"2023-12-01T15:43:45.565894+0000","last_fullsized":"2023-12-01T15:43:45.565894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566877+0000","last_change":"2023-12-01T15:43:45.583120+0000","last_active":"2023-12-01T15:43:46.566877+0000","last_peered":"2023-12-01T15:43:46.566877+0000","last_clean":"2023-12-01T15:43:46.566877+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:43:46.566877+0000","last_undegraded":"2023-12-01T15:43:46.566877+0000","last_fullsized":"2023-12-01T15:43:46.566877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573724+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:43:45.573724+0000","last_peered":"2023-12-01T15:43:45.573724+0000","last_clean":"2023-12-01T15:43:45.573724+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:43:45.573724+0000","last_undegraded":"2023-12-01T15:43:45.573724+0000","last_fullsized":"2023-12-01T15:43:45.573724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:11:42.240939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.560516+0000","last_change":"2023-12-01T15:43:45.207506+0000","last_active":"2023-12-01T15:43:45.560516+0000","last_peered":"2023-12-01T15:43:45.560516+0000","last_clean":"2023-12-01T15:43:45.560516+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T15:43:45.560516+0000","last_undegraded":"2023-12-01T15:43:45.560516+0000","last_fullsized":"2023-12-01T15:43:45.560516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566104+0000","last_change":"2023-12-01T15:43:45.574596+0000","last_active":"2023-12-01T15:43:46.566104+0000","last_peered":"2023-12-01T15:43:46.566104+0000","last_clean":"2023-12-01T15:43:46.566104+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:43:46.566104+0000","last_undegraded":"2023-12-01T15:43:46.566104+0000","last_fullsized":"2023-12-01T15:43:46.566104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.559471+0000","last_change":"2023-12-01T15:43:45.210575+0000","last_active":"2023-12-01T15:43:45.559471+0000","last_peered":"2023-12-01T15:43:45.559471+0000","last_clean":"2023-12-01T15:43:45.559471+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T15:43:45.559471+0000","last_undegraded":"2023-12-01T15:43:45.559471+0000","last_fullsized":"2023-12-01T15:43:45.559471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566296+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:43:45.566296+0000","last_peered":"2023-12-01T15:43:45.566296+0000","last_clean":"2023-12-01T15:43:45.566296+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:43:45.566296+0000","last_undegraded":"2023-12-01T15:43:45.566296+0000","last_fullsized":"2023-12-01T15:43:45.566296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565752+0000","last_change":"2023-12-01T15:43:45.582851+0000","last_active":"2023-12-01T15:43:46.565752+0000","last_peered":"2023-12-01T15:43:46.565752+0000","last_clean":"2023-12-01T15:43:46.565752+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:43:46.565752+0000","last_undegraded":"2023-12-01T15:43:46.565752+0000","last_fullsized":"2023-12-01T15:43:46.565752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566272+0000","last_change":"2023-12-01T15:43:45.200408+0000","last_active":"2023-12-01T15:43:45.566272+0000","last_peered":"2023-12-01T15:43:45.566272+0000","last_clean":"2023-12-01T15:43:45.566272+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T15:43:45.566272+0000","last_undegraded":"2023-12-01T15:43:45.566272+0000","last_fullsized":"2023-12-01T15:43:45.566272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.578703+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:43:45.578703+0000","last_peered":"2023-12-01T15:43:45.578703+0000","last_clean":"2023-12-01T15:43:45.578703+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:43:45.578703+0000","last_undegraded":"2023-12-01T15:43:45.578703+0000","last_fullsized":"2023-12-01T15:43:45.578703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:50:39.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841404+0000","last_change":"2023-12-01T15:43:45.575493+0000","last_active":"2023-12-01T15:43:46.841404+0000","last_peered":"2023-12-01T15:43:46.841404+0000","last_clean":"2023-12-01T15:43:46.841404+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T15:43:46.841404+0000","last_undegraded":"2023-12-01T15:43:46.841404+0000","last_fullsized":"2023-12-01T15:43:46.841404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:19.706992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.580835+0000","last_change":"2023-12-01T15:43:45.203186+0000","last_active":"2023-12-01T15:43:45.580835+0000","last_peered":"2023-12-01T15:43:45.580835+0000","last_clean":"2023-12-01T15:43:45.580835+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T15:43:45.580835+0000","last_undegraded":"2023-12-01T15:43:45.580835+0000","last_fullsized":"2023-12-01T15:43:45.580835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566535+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:43:45.566535+0000","last_peered":"2023-12-01T15:43:45.566535+0000","last_clean":"2023-12-01T15:43:45.566535+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:43:45.566535+0000","last_undegraded":"2023-12-01T15:43:45.566535+0000","last_fullsized":"2023-12-01T15:43:45.566535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:40:03.704778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840408+0000","last_change":"2023-12-01T15:43:45.566432+0000","last_active":"2023-12-01T15:43:46.840408+0000","last_peered":"2023-12-01T15:43:46.840408+0000","last_clean":"2023-12-01T15:43:46.840408+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:43:46.840408+0000","last_undegraded":"2023-12-01T15:43:46.840408+0000","last_fullsized":"2023-12-01T15:43:46.840408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.556977+0000","last_change":"2023-12-01T15:43:45.205286+0000","last_active":"2023-12-01T15:43:45.556977+0000","last_peered":"2023-12-01T15:43:45.556977+0000","last_clean":"2023-12-01T15:43:45.556977+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T15:43:45.556977+0000","last_undegraded":"2023-12-01T15:43:45.556977+0000","last_fullsized":"2023-12-01T15:43:45.556977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.577882+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:43:45.577882+0000","last_peered":"2023-12-01T15:43:45.577882+0000","last_clean":"2023-12-01T15:43:45.577882+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:43:45.577882+0000","last_undegraded":"2023-12-01T15:43:45.577882+0000","last_fullsized":"2023-12-01T15:43:45.577882+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:55:21.181781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841996+0000","last_change":"2023-12-01T15:43:45.581071+0000","last_active":"2023-12-01T15:43:46.841996+0000","last_peered":"2023-12-01T15:43:46.841996+0000","last_clean":"2023-12-01T15:43:46.841996+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T15:43:46.841996+0000","last_undegraded":"2023-12-01T15:43:46.841996+0000","last_fullsized":"2023-12-01T15:43:46.841996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842819+0000","last_change":"2023-12-01T15:43:45.576345+0000","last_active":"2023-12-01T15:43:46.842819+0000","last_peered":"2023-12-01T15:43:46.842819+0000","last_clean":"2023-12-01T15:43:46.842819+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:43:46.842819+0000","last_undegraded":"2023-12-01T15:43:46.842819+0000","last_fullsized":"2023-12-01T15:43:46.842819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:21:55.500677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.593872+0000","last_change":"2023-12-01T15:43:45.208015+0000","last_active":"2023-12-01T15:43:45.593872+0000","last_peered":"2023-12-01T15:43:45.593872+0000","last_clean":"2023-12-01T15:43:45.593872+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T15:43:45.593872+0000","last_undegraded":"2023-12-01T15:43:45.593872+0000","last_fullsized":"2023-12-01T15:43:45.593872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565594+0000","last_change":"2023-12-01T15:43:45.582830+0000","last_active":"2023-12-01T15:43:46.565594+0000","last_peered":"2023-12-01T15:43:46.565594+0000","last_clean":"2023-12-01T15:43:46.565594+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T15:43:46.565594+0000","last_undegraded":"2023-12-01T15:43:46.565594+0000","last_fullsized":"2023-12-01T15:43:46.565594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573539+0000","last_change":"2023-12-01T15:43:45.210538+0000","last_active":"2023-12-01T15:43:45.573539+0000","last_peered":"2023-12-01T15:43:45.573539+0000","last_clean":"2023-12-01T15:43:45.573539+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T15:43:45.573539+0000","last_undegraded":"2023-12-01T15:43:45.573539+0000","last_fullsized":"2023-12-01T15:43:45.573539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.562469+0000","last_change":"2023-12-01T15:43:45.204325+0000","last_active":"2023-12-01T15:43:45.562469+0000","last_peered":"2023-12-01T15:43:45.562469+0000","last_clean":"2023-12-01T15:43:45.562469+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T15:43:45.562469+0000","last_undegraded":"2023-12-01T15:43:45.562469+0000","last_fullsized":"2023-12-01T15:43:45.562469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840881+0000","last_change":"2023-12-01T15:43:45.583931+0000","last_active":"2023-12-01T15:43:46.840881+0000","last_peered":"2023-12-01T15:43:46.840881+0000","last_clean":"2023-12-01T15:43:46.840881+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T15:43:46.840881+0000","last_undegraded":"2023-12-01T15:43:46.840881+0000","last_fullsized":"2023-12-01T15:43:46.840881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:36.724287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.556940+0000","last_change":"2023-12-01T15:43:45.203624+0000","last_active":"2023-12-01T15:43:45.556940+0000","last_peered":"2023-12-01T15:43:45.556940+0000","last_clean":"2023-12-01T15:43:45.556940+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T15:43:45.556940+0000","last_undegraded":"2023-12-01T15:43:45.556940+0000","last_fullsized":"2023-12-01T15:43:45.556940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565039+0000","last_change":"2023-12-01T15:43:45.572933+0000","last_active":"2023-12-01T15:43:46.565039+0000","last_peered":"2023-12-01T15:43:46.565039+0000","last_clean":"2023-12-01T15:43:46.565039+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:43:46.565039+0000","last_undegraded":"2023-12-01T15:43:46.565039+0000","last_fullsized":"2023-12-01T15:43:46.565039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568640+0000","last_change":"2023-12-01T15:43:45.587913+0000","last_active":"2023-12-01T15:43:46.568640+0000","last_peered":"2023-12-01T15:43:46.568640+0000","last_clean":"2023-12-01T15:43:46.568640+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:43:46.568640+0000","last_undegraded":"2023-12-01T15:43:46.568640+0000","last_fullsized":"2023-12-01T15:43:46.568640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:20.675396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565673+0000","last_change":"2023-12-01T15:43:45.205650+0000","last_active":"2023-12-01T15:43:45.565673+0000","last_peered":"2023-12-01T15:43:45.565673+0000","last_clean":"2023-12-01T15:43:45.565673+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:43:45.565673+0000","last_undegraded":"2023-12-01T15:43:45.565673+0000","last_fullsized":"2023-12-01T15:43:45.565673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841953+0000","last_change":"2023-12-01T15:43:45.574378+0000","last_active":"2023-12-01T15:43:46.841953+0000","last_peered":"2023-12-01T15:43:46.841953+0000","last_clean":"2023-12-01T15:43:46.841953+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T15:43:46.841953+0000","last_undegraded":"2023-12-01T15:43:46.841953+0000","last_fullsized":"2023-12-01T15:43:46.841953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565955+0000","last_change":"2023-12-01T15:43:45.200400+0000","last_active":"2023-12-01T15:43:45.565955+0000","last_peered":"2023-12-01T15:43:45.565955+0000","last_clean":"2023-12-01T15:43:45.565955+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:43:45.565955+0000","last_undegraded":"2023-12-01T15:43:45.565955+0000","last_fullsized":"2023-12-01T15:43:45.565955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841820+0000","last_change":"2023-12-01T15:43:45.570253+0000","last_active":"2023-12-01T15:43:46.841820+0000","last_peered":"2023-12-01T15:43:46.841820+0000","last_clean":"2023-12-01T15:43:46.841820+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:43:46.841820+0000","last_undegraded":"2023-12-01T15:43:46.841820+0000","last_fullsized":"2023-12-01T15:43:46.841820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.574389+0000","last_change":"2023-12-01T15:43:45.200975+0000","last_active":"2023-12-01T15:43:45.574389+0000","last_peered":"2023-12-01T15:43:45.574389+0000","last_clean":"2023-12-01T15:43:45.574389+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:43:45.574389+0000","last_undegraded":"2023-12-01T15:43:45.574389+0000","last_fullsized":"2023-12-01T15:43:45.574389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566128+0000","last_change":"2023-12-01T15:43:45.575004+0000","last_active":"2023-12-01T15:43:46.566128+0000","last_peered":"2023-12-01T15:43:46.566128+0000","last_clean":"2023-12-01T15:43:46.566128+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T15:43:46.566128+0000","last_undegraded":"2023-12-01T15:43:46.566128+0000","last_fullsized":"2023-12-01T15:43:46.566128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.569598+0000","last_change":"2023-12-01T15:43:45.208899+0000","last_active":"2023-12-01T15:43:45.569598+0000","last_peered":"2023-12-01T15:43:45.569598+0000","last_clean":"2023-12-01T15:43:45.569598+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T15:43:45.569598+0000","last_undegraded":"2023-12-01T15:43:45.569598+0000","last_fullsized":"2023-12-01T15:43:45.569598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842631+0000","last_change":"2023-12-01T15:43:45.578059+0000","last_active":"2023-12-01T15:43:46.842631+0000","last_peered":"2023-12-01T15:43:46.842631+0000","last_clean":"2023-12-01T15:43:46.842631+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T15:43:46.842631+0000","last_undegraded":"2023-12-01T15:43:46.842631+0000","last_fullsized":"2023-12-01T15:43:46.842631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.570848+0000","last_change":"2023-12-01T15:43:45.203471+0000","last_active":"2023-12-01T15:43:45.570848+0000","last_peered":"2023-12-01T15:43:45.570848+0000","last_clean":"2023-12-01T15:43:45.570848+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T15:43:45.570848+0000","last_undegraded":"2023-12-01T15:43:45.570848+0000","last_fullsized":"2023-12-01T15:43:45.570848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841785+0000","last_change":"2023-12-01T15:43:45.573522+0000","last_active":"2023-12-01T15:43:46.841785+0000","last_peered":"2023-12-01T15:43:46.841785+0000","last_clean":"2023-12-01T15:43:46.841785+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:43:46.841785+0000","last_undegraded":"2023-12-01T15:43:46.841785+0000","last_fullsized":"2023-12-01T15:43:46.841785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.591060+0000","last_change":"2023-12-01T15:43:45.208222+0000","last_active":"2023-12-01T15:43:45.591060+0000","last_peered":"2023-12-01T15:43:45.591060+0000","last_clean":"2023-12-01T15:43:45.591060+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:43:45.591060+0000","last_undegraded":"2023-12-01T15:43:45.591060+0000","last_fullsized":"2023-12-01T15:43:45.591060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840961+0000","last_change":"2023-12-01T15:43:45.571469+0000","last_active":"2023-12-01T15:43:46.840961+0000","last_peered":"2023-12-01T15:43:46.840961+0000","last_clean":"2023-12-01T15:43:46.840961+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:43:46.840961+0000","last_undegraded":"2023-12-01T15:43:46.840961+0000","last_fullsized":"2023-12-01T15:43:46.840961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571989+0000","last_change":"2023-12-01T15:43:45.208256+0000","last_active":"2023-12-01T15:43:45.571989+0000","last_peered":"2023-12-01T15:43:45.571989+0000","last_clean":"2023-12-01T15:43:45.571989+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T15:43:45.571989+0000","last_undegraded":"2023-12-01T15:43:45.571989+0000","last_fullsized":"2023-12-01T15:43:45.571989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841878+0000","last_change":"2023-12-01T15:43:45.575215+0000","last_active":"2023-12-01T15:43:46.841878+0000","last_peered":"2023-12-01T15:43:46.841878+0000","last_clean":"2023-12-01T15:43:46.841878+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:43:46.841878+0000","last_undegraded":"2023-12-01T15:43:46.841878+0000","last_fullsized":"2023-12-01T15:43:46.841878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571407+0000","last_change":"2023-12-01T15:43:45.204599+0000","last_active":"2023-12-01T15:43:45.571407+0000","last_peered":"2023-12-01T15:43:45.571407+0000","last_clean":"2023-12-01T15:43:45.571407+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T15:43:45.571407+0000","last_undegraded":"2023-12-01T15:43:45.571407+0000","last_fullsized":"2023-12-01T15:43:45.571407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":798720,"data_stored":653237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":62307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":176128,"data_stored":60597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":782336,"data_stored":651707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T15:43:53.994 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T15:43:54.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.112+0000 7ff16554d700 1 Processor -- start 2023-12-01T15:43:54.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.112+0000 7ff16554d700 1 -- start start 2023-12-01T15:43:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff16554d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16006e1d0 0x7ff160134710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff16554d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff16006d1a0 0x7ff1600a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff16554d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16006e890 con 0x7ff1600a3ce0 2023-12-01T15:43:54.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff16554d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff160133e10 con 0x7ff16006d1a0 2023-12-01T15:43:54.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff16554d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff160134000 con 0x7ff16006e1d0 2023-12-01T15:43:54.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff164d4c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff1600a3ce0 0x7ff16013e790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41968/0 (socket says 172.21.15.63:41968) 2023-12-01T15:43:54.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff164d4c700 1 -- 172.21.15.63:0/1035137754 learned_addr learned my addr 172.21.15.63:0/1035137754 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:54.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff1577fe700 1 --2- 172.21.15.63:0/1035137754 >> v2:172.21.15.66:3300/0 conn(0x7ff16006d1a0 0x7ff1600a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15ffff700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16006e1d0 0x7ff160134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925776418 0 0) 0x7ff16006e890 con 0x7ff1600a3ce0 2023-12-01T15:43:54.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff14c0035d0 con 0x7ff1600a3ce0 2023-12-01T15:43:54.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1534145153 0 0) 0x7ff14c0035d0 con 0x7ff1600a3ce0 2023-12-01T15:43:54.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16006e1d0 msgr2=0x7ff160134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:54.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16006e1d0 0x7ff160134710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 >> v2:172.21.15.66:3300/0 conn(0x7ff16006d1a0 msgr2=0x7ff1600a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:54.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 --2- 172.21.15.63:0/1035137754 >> v2:172.21.15.66:3300/0 conn(0x7ff16006d1a0 0x7ff1600a37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1601342c0 con 0x7ff1600a3ce0 2023-12-01T15:43:54.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3363315130 0 0) 0x7ff1580019f0 con 0x7ff1600a3ce0 2023-12-01T15:43:54.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff1577fe700 1 --2- 172.21.15.63:0/1035137754 >> v2:172.21.15.66:3300/0 conn(0x7ff16006d1a0 0x7ff1600a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:54.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 >> v1:172.21.15.63:6789/0 conn(0x7ff1600a3ce0 legacy=0x7ff16013e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff14c003a90 0x7ff14c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16006e1d0 0x7ff14c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff14c004db0 0x7ff14c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff160134000 con 0x7ff14c003a90 2023-12-01T15:43:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c00bae0 con 0x7ff14c004db0 2023-12-01T15:43:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15ffff700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff14c003a90 0x7ff14c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c00bc70 con 0x7ff16006e1d0 2023-12-01T15:43:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff164d4c700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff14c004db0 0x7ff14c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff1577fe700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16006e1d0 0x7ff14c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15ffff700 1 -- 172.21.15.63:0/1035137754 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16006e1d0 msgr2=0x7ff14c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:54.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15ffff700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16006e1d0 0x7ff14c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15ffff700 1 -- 172.21.15.63:0/1035137754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff14c004db0 msgr2=0x7ff14c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:54.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15ffff700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff14c004db0 0x7ff14c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15ffff700 1 -- 172.21.15.63:0/1035137754 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0035d0 con 0x7ff14c003a90 2023-12-01T15:43:54.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15ffff700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff14c003a90 0x7ff14c003eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff150010b30 tx=0x7ff14c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2ddf960aadc675 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:54.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150015070 con 0x7ff14c003a90 2023-12-01T15:43:54.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff150009a40 con 0x7ff14c003a90 2023-12-01T15:43:54.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.116+0000 7ff15f7fe700 1 -- 172.21.15.63:0/1035137754 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150009db0 con 0x7ff14c003a90 2023-12-01T15:43:54.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 -- 172.21.15.63:0/1035137754 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff14c003a90 msgr2=0x7ff14c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 --2- 172.21.15.63:0/1035137754 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff14c003a90 0x7ff14c003eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff150010b30 tx=0x7ff14c0058a0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff164d4c700 1 -- 172.21.15.63:0/1035137754 reap_dead start 2023-12-01T15:43:54.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 -- 172.21.15.63:0/1035137754 shutdown_connections 2023-12-01T15:43:54.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 -- 172.21.15.63:0/1035137754 >> 172.21.15.63:0/1035137754 conn(0x7ff1600a5cc0 msgr2=0x7ff1600a60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:54.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 -- 172.21.15.63:0/1035137754 shutdown_connections 2023-12-01T15:43:54.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 -- 172.21.15.63:0/1035137754 wait complete. 2023-12-01T15:43:54.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 Processor -- start 2023-12-01T15:43:54.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 -- start start 2023-12-01T15:43:54.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff14c003a90 0x7ff16012c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16012ce70 0x7ff1601c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1601c7b30 0x7ff1601c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff160071990 con 0x7ff1601c7b30 2023-12-01T15:43:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1601c84f0 con 0x7ff14c003a90 2023-12-01T15:43:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff16554d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff160070e90 con 0x7ff16012ce70 2023-12-01T15:43:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff164d4c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1601c7b30 0x7ff1601c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff164d4c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1601c7b30 0x7ff1601c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46782/0 (socket says 172.21.15.63:46782) 2023-12-01T15:43:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff164d4c700 1 -- 172.21.15.63:0/3887475749 learned_addr learned my addr 172.21.15.63:0/3887475749 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff1577fe700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16012ce70 0x7ff1601c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff15ffff700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff14c003a90 0x7ff16012c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff164d4c700 1 -- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16012ce70 msgr2=0x7ff1601c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff164d4c700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16012ce70 0x7ff1601c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.120+0000 7ff164d4c700 1 -- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff14c003a90 msgr2=0x7ff16012c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff164d4c700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff14c003a90 0x7ff16012c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff164d4c700 1 -- 172.21.15.63:0/3887475749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff160130f90 con 0x7ff1601c7b30 2023-12-01T15:43:54.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff1577fe700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16012ce70 0x7ff1601c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff15ffff700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff14c003a90 0x7ff16012c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff164d4c700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1601c7b30 0x7ff1601c7fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff1600736a0 tx=0x7ff158001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff15d7fa700 1 -- 172.21.15.63:0/3887475749 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158017070 con 0x7ff1601c7b30 2023-12-01T15:43:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff15d7fa700 1 -- 172.21.15.63:0/3887475749 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15800e880 con 0x7ff1601c7b30 2023-12-01T15:43:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff16554d700 1 -- 172.21.15.63:0/3887475749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1600710c0 con 0x7ff1601c7b30 2023-12-01T15:43:54.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff15d7fa700 1 -- 172.21.15.63:0/3887475749 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15800ea30 con 0x7ff1601c7b30 2023-12-01T15:43:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff16554d700 1 -- 172.21.15.63:0/3887475749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff160071360 con 0x7ff1601c7b30 2023-12-01T15:43:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff16554d700 1 -- 172.21.15.63:0/3887475749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff160065fb0 con 0x7ff1601c7b30 2023-12-01T15:43:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff15d7fa700 1 -- 172.21.15.63:0/3887475749 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff15800eb90 con 0x7ff1601c7b30 2023-12-01T15:43:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.124+0000 7ff15d7fa700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff140065b00 0x7ff140067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.128+0000 7ff15d7fa700 1 -- 172.21.15.63:0/3887475749 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7ff158082540 con 0x7ff1601c7b30 2023-12-01T15:43:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.128+0000 7ff15ffff700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff140065b00 0x7ff140067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.128+0000 7ff15ffff700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff140065b00 0x7ff140067fc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff15001c040 tx=0x7ff150008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:54.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.132+0000 7ff15d7fa700 1 -- 172.21.15.63:0/3887475749 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff1580504f0 con 0x7ff1601c7b30 2023-12-01T15:43:54.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.300+0000 7ff16554d700 1 -- 172.21.15.63:0/3887475749 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff16006e5b0 con 0x7ff140065b00 2023-12-01T15:43:54.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.316+0000 7ff15d7fa700 1 -- 172.21.15.63:0/3887475749 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271388 (secure 0 0 0) 0x7ff150004320 con 0x7ff140065b00 2023-12-01T15:43:54.324 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:54.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.320+0000 7ff16554d700 1 -- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff140065b00 msgr2=0x7ff140067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.320+0000 7ff16554d700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff140065b00 0x7ff140067fc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff15001c040 tx=0x7ff150008030 comp rx=0 tx=0).stop 2023-12-01T15:43:54.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.320+0000 7ff16554d700 1 -- 172.21.15.63:0/3887475749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1601c7b30 msgr2=0x7ff1601c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.320+0000 7ff16554d700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1601c7b30 0x7ff1601c7fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff1600736a0 tx=0x7ff158001a40 comp rx=0 tx=0).stop 2023-12-01T15:43:54.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.320+0000 7ff16554d700 1 -- 172.21.15.63:0/3887475749 shutdown_connections 2023-12-01T15:43:54.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.324+0000 7ff16554d700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff140065b00 0x7ff140067fc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.324+0000 7ff16554d700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff16012ce70 0x7ff1601c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.324+0000 7ff16554d700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1601c7b30 0x7ff1601c7fb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.324+0000 7ff16554d700 1 --2- 172.21.15.63:0/3887475749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff14c003a90 0x7ff16012c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.324+0000 7ff16554d700 1 -- 172.21.15.63:0/3887475749 >> 172.21.15.63:0/3887475749 conn(0x7ff1600a5cc0 msgr2=0x7ff16012dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:54.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.324+0000 7ff16554d700 1 -- 172.21.15.63:0/3887475749 shutdown_connections 2023-12-01T15:43:54.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.324+0000 7ff16554d700 1 -- 172.21.15.63:0/3887475749 wait complete. 2023-12-01T15:43:54.328 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T15:43:54.340 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-01T15:43:52.371809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109720,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377640,"statfs":{"total":386547056640,"available":386434703360,"internally_reserved":0,"allocated":1957888,"data_stored":1427848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.191119"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842184+0000","last_change":"2023-12-01T15:43:45.574989+0000","last_active":"2023-12-01T15:43:46.842184+0000","last_peered":"2023-12-01T15:43:46.842184+0000","last_clean":"2023-12-01T15:43:46.842184+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:43:46.842184+0000","last_undegraded":"2023-12-01T15:43:46.842184+0000","last_fullsized":"2023-12-01T15:43:46.842184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843053+0000","last_change":"2023-12-01T15:43:45.575246+0000","last_active":"2023-12-01T15:43:46.843053+0000","last_peered":"2023-12-01T15:43:46.843053+0000","last_clean":"2023-12-01T15:43:46.843053+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T15:43:46.843053+0000","last_undegraded":"2023-12-01T15:43:46.843053+0000","last_fullsized":"2023-12-01T15:43:46.843053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568537+0000","last_change":"2023-12-01T15:43:45.586026+0000","last_active":"2023-12-01T15:43:46.568537+0000","last_peered":"2023-12-01T15:43:46.568537+0000","last_clean":"2023-12-01T15:43:46.568537+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:43:46.568537+0000","last_undegraded":"2023-12-01T15:43:46.568537+0000","last_fullsized":"2023-12-01T15:43:46.568537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:52:46.242732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843058+0000","last_change":"2023-12-01T15:43:45.573330+0000","last_active":"2023-12-01T15:43:46.843058+0000","last_peered":"2023-12-01T15:43:46.843058+0000","last_clean":"2023-12-01T15:43:46.843058+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:43:46.843058+0000","last_undegraded":"2023-12-01T15:43:46.843058+0000","last_fullsized":"2023-12-01T15:43:46.843058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841670+0000","last_change":"2023-12-01T15:43:45.573581+0000","last_active":"2023-12-01T15:43:46.841670+0000","last_peered":"2023-12-01T15:43:46.841670+0000","last_clean":"2023-12-01T15:43:46.841670+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T15:43:46.841670+0000","last_undegraded":"2023-12-01T15:43:46.841670+0000","last_fullsized":"2023-12-01T15:43:46.841670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567773+0000","last_change":"2023-12-01T15:43:45.587387+0000","last_active":"2023-12-01T15:43:46.567773+0000","last_peered":"2023-12-01T15:43:46.567773+0000","last_clean":"2023-12-01T15:43:46.567773+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T15:43:46.567773+0000","last_undegraded":"2023-12-01T15:43:46.567773+0000","last_fullsized":"2023-12-01T15:43:46.567773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567363+0000","last_change":"2023-12-01T15:43:45.586845+0000","last_active":"2023-12-01T15:43:46.567363+0000","last_peered":"2023-12-01T15:43:46.567363+0000","last_clean":"2023-12-01T15:43:46.567363+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T15:43:46.567363+0000","last_undegraded":"2023-12-01T15:43:46.567363+0000","last_fullsized":"2023-12-01T15:43:46.567363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567330+0000","last_change":"2023-12-01T15:43:45.589296+0000","last_active":"2023-12-01T15:43:46.567330+0000","last_peered":"2023-12-01T15:43:46.567330+0000","last_clean":"2023-12-01T15:43:46.567330+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:43:46.567330+0000","last_undegraded":"2023-12-01T15:43:46.567330+0000","last_fullsized":"2023-12-01T15:43:46.567330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:31:59.832465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841569+0000","last_change":"2023-12-01T15:43:45.574868+0000","last_active":"2023-12-01T15:43:46.841569+0000","last_peered":"2023-12-01T15:43:46.841569+0000","last_clean":"2023-12-01T15:43:46.841569+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:43:46.841569+0000","last_undegraded":"2023-12-01T15:43:46.841569+0000","last_fullsized":"2023-12-01T15:43:46.841569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568612+0000","last_change":"2023-12-01T15:43:45.586227+0000","last_active":"2023-12-01T15:43:46.568612+0000","last_peered":"2023-12-01T15:43:46.568612+0000","last_clean":"2023-12-01T15:43:46.568612+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:43:46.568612+0000","last_undegraded":"2023-12-01T15:43:46.568612+0000","last_fullsized":"2023-12-01T15:43:46.568612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:00:15.540017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842485+0000","last_change":"2023-12-01T15:43:45.581083+0000","last_active":"2023-12-01T15:43:46.842485+0000","last_peered":"2023-12-01T15:43:46.842485+0000","last_clean":"2023-12-01T15:43:46.842485+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:43:46.842485+0000","last_undegraded":"2023-12-01T15:43:46.842485+0000","last_fullsized":"2023-12-01T15:43:46.842485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565931+0000","last_change":"2023-12-01T15:43:45.573173+0000","last_active":"2023-12-01T15:43:46.565931+0000","last_peered":"2023-12-01T15:43:46.565931+0000","last_clean":"2023-12-01T15:43:46.565931+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T15:43:46.565931+0000","last_undegraded":"2023-12-01T15:43:46.565931+0000","last_fullsized":"2023-12-01T15:43:46.565931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840739+0000","last_change":"2023-12-01T15:43:45.566533+0000","last_active":"2023-12-01T15:43:46.840739+0000","last_peered":"2023-12-01T15:43:46.840739+0000","last_clean":"2023-12-01T15:43:46.840739+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T15:43:46.840739+0000","last_undegraded":"2023-12-01T15:43:46.840739+0000","last_fullsized":"2023-12-01T15:43:46.840739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841752+0000","last_change":"2023-12-01T15:43:45.574865+0000","last_active":"2023-12-01T15:43:46.841752+0000","last_peered":"2023-12-01T15:43:46.841752+0000","last_clean":"2023-12-01T15:43:46.841752+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T15:43:46.841752+0000","last_undegraded":"2023-12-01T15:43:46.841752+0000","last_fullsized":"2023-12-01T15:43:46.841752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841669+0000","last_change":"2023-12-01T15:43:45.575488+0000","last_active":"2023-12-01T15:43:46.841669+0000","last_peered":"2023-12-01T15:43:46.841669+0000","last_clean":"2023-12-01T15:43:46.841669+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:43:46.841669+0000","last_undegraded":"2023-12-01T15:43:46.841669+0000","last_fullsized":"2023-12-01T15:43:46.841669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567257+0000","last_change":"2023-12-01T15:43:45.586172+0000","last_active":"2023-12-01T15:43:46.567257+0000","last_peered":"2023-12-01T15:43:46.567257+0000","last_clean":"2023-12-01T15:43:46.567257+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T15:43:46.567257+0000","last_undegraded":"2023-12-01T15:43:46.567257+0000","last_fullsized":"2023-12-01T15:43:46.567257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:23.641161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841715+0000","last_change":"2023-12-01T15:43:45.571920+0000","last_active":"2023-12-01T15:43:46.841715+0000","last_peered":"2023-12-01T15:43:46.841715+0000","last_clean":"2023-12-01T15:43:46.841715+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T15:43:46.841715+0000","last_undegraded":"2023-12-01T15:43:46.841715+0000","last_fullsized":"2023-12-01T15:43:46.841715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568738+0000","last_change":"2023-12-01T15:43:45.587983+0000","last_active":"2023-12-01T15:43:46.568738+0000","last_peered":"2023-12-01T15:43:46.568738+0000","last_clean":"2023-12-01T15:43:46.568738+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T15:43:46.568738+0000","last_undegraded":"2023-12-01T15:43:46.568738+0000","last_fullsized":"2023-12-01T15:43:46.568738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:46:31.135544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841641+0000","last_change":"2023-12-01T15:43:45.580927+0000","last_active":"2023-12-01T15:43:46.841641+0000","last_peered":"2023-12-01T15:43:46.841641+0000","last_clean":"2023-12-01T15:43:46.841641+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T15:43:46.841641+0000","last_undegraded":"2023-12-01T15:43:46.841641+0000","last_fullsized":"2023-12-01T15:43:46.841641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568127+0000","last_change":"2023-12-01T15:43:45.585911+0000","last_active":"2023-12-01T15:43:46.568127+0000","last_peered":"2023-12-01T15:43:46.568127+0000","last_clean":"2023-12-01T15:43:46.568127+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:43:46.568127+0000","last_undegraded":"2023-12-01T15:43:46.568127+0000","last_fullsized":"2023-12-01T15:43:46.568127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:50.215328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842133+0000","last_change":"2023-12-01T15:43:45.577853+0000","last_active":"2023-12-01T15:43:46.842133+0000","last_peered":"2023-12-01T15:43:46.842133+0000","last_clean":"2023-12-01T15:43:46.842133+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T15:43:46.842133+0000","last_undegraded":"2023-12-01T15:43:46.842133+0000","last_fullsized":"2023-12-01T15:43:46.842133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840481+0000","last_change":"2023-12-01T15:43:45.571656+0000","last_active":"2023-12-01T15:43:46.840481+0000","last_peered":"2023-12-01T15:43:46.840481+0000","last_clean":"2023-12-01T15:43:46.840481+0000","last_became_active":"2023-12-01T15:43:45.571345+0000","last_became_peered":"2023-12-01T15:43:45.571345+0000","last_unstale":"2023-12-01T15:43:46.840481+0000","last_undegraded":"2023-12-01T15:43:46.840481+0000","last_fullsized":"2023-12-01T15:43:46.840481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565285+0000","last_change":"2023-12-01T15:43:45.571661+0000","last_active":"2023-12-01T15:43:46.565285+0000","last_peered":"2023-12-01T15:43:46.565285+0000","last_clean":"2023-12-01T15:43:46.565285+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T15:43:46.565285+0000","last_undegraded":"2023-12-01T15:43:46.565285+0000","last_fullsized":"2023-12-01T15:43:46.565285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567380+0000","last_change":"2023-12-01T15:43:45.588988+0000","last_active":"2023-12-01T15:43:46.567380+0000","last_peered":"2023-12-01T15:43:46.567380+0000","last_clean":"2023-12-01T15:43:46.567380+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:43:46.567380+0000","last_undegraded":"2023-12-01T15:43:46.567380+0000","last_fullsized":"2023-12-01T15:43:46.567380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:16:11.702379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566677+0000","last_change":"2023-12-01T15:43:45.583230+0000","last_active":"2023-12-01T15:43:46.566677+0000","last_peered":"2023-12-01T15:43:46.566677+0000","last_clean":"2023-12-01T15:43:46.566677+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T15:43:46.566677+0000","last_undegraded":"2023-12-01T15:43:46.566677+0000","last_fullsized":"2023-12-01T15:43:46.566677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566484+0000","last_change":"2023-12-01T15:43:45.571094+0000","last_active":"2023-12-01T15:43:46.566484+0000","last_peered":"2023-12-01T15:43:46.566484+0000","last_clean":"2023-12-01T15:43:46.566484+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T15:43:46.566484+0000","last_undegraded":"2023-12-01T15:43:46.566484+0000","last_fullsized":"2023-12-01T15:43:46.566484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568844+0000","last_change":"2023-12-01T15:43:45.588871+0000","last_active":"2023-12-01T15:43:46.568844+0000","last_peered":"2023-12-01T15:43:46.568844+0000","last_clean":"2023-12-01T15:43:46.568844+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T15:43:46.568844+0000","last_undegraded":"2023-12-01T15:43:46.568844+0000","last_fullsized":"2023-12-01T15:43:46.568844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:34:06.793940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566378+0000","last_change":"2023-12-01T15:43:45.581308+0000","last_active":"2023-12-01T15:43:46.566378+0000","last_peered":"2023-12-01T15:43:46.566378+0000","last_clean":"2023-12-01T15:43:46.566378+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T15:43:46.566378+0000","last_undegraded":"2023-12-01T15:43:46.566378+0000","last_fullsized":"2023-12-01T15:43:46.566378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841105+0000","last_change":"2023-12-01T15:43:45.573417+0000","last_active":"2023-12-01T15:43:46.841105+0000","last_peered":"2023-12-01T15:43:46.841105+0000","last_clean":"2023-12-01T15:43:46.841105+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T15:43:46.841105+0000","last_undegraded":"2023-12-01T15:43:46.841105+0000","last_fullsized":"2023-12-01T15:43:46.841105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567788+0000","last_change":"2023-12-01T15:43:45.587201+0000","last_active":"2023-12-01T15:43:46.567788+0000","last_peered":"2023-12-01T15:43:46.567788+0000","last_clean":"2023-12-01T15:43:46.567788+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:43:46.567788+0000","last_undegraded":"2023-12-01T15:43:46.567788+0000","last_fullsized":"2023-12-01T15:43:46.567788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565272+0000","last_change":"2023-12-01T15:43:45.575004+0000","last_active":"2023-12-01T15:43:46.565272+0000","last_peered":"2023-12-01T15:43:46.565272+0000","last_clean":"2023-12-01T15:43:46.565272+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T15:43:46.565272+0000","last_undegraded":"2023-12-01T15:43:46.565272+0000","last_fullsized":"2023-12-01T15:43:46.565272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842058+0000","last_change":"2023-12-01T15:43:45.572838+0000","last_active":"2023-12-01T15:43:46.842058+0000","last_peered":"2023-12-01T15:43:46.842058+0000","last_clean":"2023-12-01T15:43:46.842058+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T15:43:46.842058+0000","last_undegraded":"2023-12-01T15:43:46.842058+0000","last_fullsized":"2023-12-01T15:43:46.842058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566010+0000","last_change":"2023-12-01T15:43:45.581131+0000","last_active":"2023-12-01T15:43:46.566010+0000","last_peered":"2023-12-01T15:43:46.566010+0000","last_clean":"2023-12-01T15:43:46.566010+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:43:46.566010+0000","last_undegraded":"2023-12-01T15:43:46.566010+0000","last_fullsized":"2023-12-01T15:43:46.566010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.591056+0000","last_change":"2023-12-01T15:43:45.205685+0000","last_active":"2023-12-01T15:43:45.591056+0000","last_peered":"2023-12-01T15:43:45.591056+0000","last_clean":"2023-12-01T15:43:45.591056+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T15:43:45.591056+0000","last_undegraded":"2023-12-01T15:43:45.591056+0000","last_fullsized":"2023-12-01T15:43:45.591056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568613+0000","last_change":"2023-12-01T15:43:45.587537+0000","last_active":"2023-12-01T15:43:46.568613+0000","last_peered":"2023-12-01T15:43:46.568613+0000","last_clean":"2023-12-01T15:43:46.568613+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:43:46.568613+0000","last_undegraded":"2023-12-01T15:43:46.568613+0000","last_fullsized":"2023-12-01T15:43:46.568613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:53:22.216155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.553424+0000","last_change":"2023-12-01T15:43:45.203521+0000","last_active":"2023-12-01T15:43:45.553424+0000","last_peered":"2023-12-01T15:43:45.553424+0000","last_clean":"2023-12-01T15:43:45.553424+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T15:43:45.553424+0000","last_undegraded":"2023-12-01T15:43:45.553424+0000","last_fullsized":"2023-12-01T15:43:45.553424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842265+0000","last_change":"2023-12-01T15:43:45.566866+0000","last_active":"2023-12-01T15:43:46.842265+0000","last_peered":"2023-12-01T15:43:46.842265+0000","last_clean":"2023-12-01T15:43:46.842265+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:43:46.842265+0000","last_undegraded":"2023-12-01T15:43:46.842265+0000","last_fullsized":"2023-12-01T15:43:46.842265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.572883+0000","last_change":"2023-12-01T15:43:45.205291+0000","last_active":"2023-12-01T15:43:45.572883+0000","last_peered":"2023-12-01T15:43:45.572883+0000","last_clean":"2023-12-01T15:43:45.572883+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T15:43:45.572883+0000","last_undegraded":"2023-12-01T15:43:45.572883+0000","last_fullsized":"2023-12-01T15:43:45.572883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841968+0000","last_change":"2023-12-01T15:43:45.580597+0000","last_active":"2023-12-01T15:43:46.841968+0000","last_peered":"2023-12-01T15:43:46.841968+0000","last_clean":"2023-12-01T15:43:46.841968+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:43:46.841968+0000","last_undegraded":"2023-12-01T15:43:46.841968+0000","last_fullsized":"2023-12-01T15:43:46.841968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.593904+0000","last_change":"2023-12-01T15:43:45.207762+0000","last_active":"2023-12-01T15:43:45.593904+0000","last_peered":"2023-12-01T15:43:45.593904+0000","last_clean":"2023-12-01T15:43:45.593904+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T15:43:45.593904+0000","last_undegraded":"2023-12-01T15:43:45.593904+0000","last_fullsized":"2023-12-01T15:43:45.593904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571832+0000","last_change":"2023-12-01T15:43:45.203999+0000","last_active":"2023-12-01T15:43:45.571832+0000","last_peered":"2023-12-01T15:43:45.571832+0000","last_clean":"2023-12-01T15:43:45.571832+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T15:43:45.571832+0000","last_undegraded":"2023-12-01T15:43:45.571832+0000","last_fullsized":"2023-12-01T15:43:45.571832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567659+0000","last_change":"2023-12-01T15:43:45.589689+0000","last_active":"2023-12-01T15:43:46.567659+0000","last_peered":"2023-12-01T15:43:46.567659+0000","last_clean":"2023-12-01T15:43:46.567659+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:43:46.567659+0000","last_undegraded":"2023-12-01T15:43:46.567659+0000","last_fullsized":"2023-12-01T15:43:46.567659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:40:12.233063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.574715+0000","last_change":"2023-12-01T15:43:45.201303+0000","last_active":"2023-12-01T15:43:45.574715+0000","last_peered":"2023-12-01T15:43:45.574715+0000","last_clean":"2023-12-01T15:43:45.574715+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T15:43:45.574715+0000","last_undegraded":"2023-12-01T15:43:45.574715+0000","last_fullsized":"2023-12-01T15:43:45.574715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842340+0000","last_change":"2023-12-01T15:43:45.573607+0000","last_active":"2023-12-01T15:43:46.842340+0000","last_peered":"2023-12-01T15:43:46.842340+0000","last_clean":"2023-12-01T15:43:46.842340+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:43:46.842340+0000","last_undegraded":"2023-12-01T15:43:46.842340+0000","last_fullsized":"2023-12-01T15:43:46.842340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.587428+0000","last_change":"2023-12-01T15:43:45.207098+0000","last_active":"2023-12-01T15:43:45.587428+0000","last_peered":"2023-12-01T15:43:45.587428+0000","last_clean":"2023-12-01T15:43:45.587428+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T15:43:45.587428+0000","last_undegraded":"2023-12-01T15:43:45.587428+0000","last_fullsized":"2023-12-01T15:43:45.587428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842099+0000","last_change":"2023-12-01T15:43:45.582490+0000","last_active":"2023-12-01T15:43:46.842099+0000","last_peered":"2023-12-01T15:43:46.842099+0000","last_clean":"2023-12-01T15:43:46.842099+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:43:46.842099+0000","last_undegraded":"2023-12-01T15:43:46.842099+0000","last_fullsized":"2023-12-01T15:43:46.842099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:32:00.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.575523+0000","last_change":"2023-12-01T15:43:45.206777+0000","last_active":"2023-12-01T15:43:45.575523+0000","last_peered":"2023-12-01T15:43:45.575523+0000","last_clean":"2023-12-01T15:43:45.575523+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T15:43:45.575523+0000","last_undegraded":"2023-12-01T15:43:45.575523+0000","last_fullsized":"2023-12-01T15:43:45.575523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841297+0000","last_change":"2023-12-01T15:43:45.573244+0000","last_active":"2023-12-01T15:43:46.841297+0000","last_peered":"2023-12-01T15:43:46.841297+0000","last_clean":"2023-12-01T15:43:46.841297+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:43:46.841297+0000","last_undegraded":"2023-12-01T15:43:46.841297+0000","last_fullsized":"2023-12-01T15:43:46.841297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.581110+0000","last_change":"2023-12-01T15:43:45.204182+0000","last_active":"2023-12-01T15:43:45.581110+0000","last_peered":"2023-12-01T15:43:45.581110+0000","last_clean":"2023-12-01T15:43:45.581110+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T15:43:45.581110+0000","last_undegraded":"2023-12-01T15:43:45.581110+0000","last_fullsized":"2023-12-01T15:43:45.581110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568216+0000","last_change":"2023-12-01T15:43:45.587544+0000","last_active":"2023-12-01T15:43:46.568216+0000","last_peered":"2023-12-01T15:43:46.568216+0000","last_clean":"2023-12-01T15:43:46.568216+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T15:43:46.568216+0000","last_undegraded":"2023-12-01T15:43:46.568216+0000","last_fullsized":"2023-12-01T15:43:46.568216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573616+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:43:45.573616+0000","last_peered":"2023-12-01T15:43:45.573616+0000","last_clean":"2023-12-01T15:43:45.573616+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:43:45.573616+0000","last_undegraded":"2023-12-01T15:43:45.573616+0000","last_fullsized":"2023-12-01T15:43:45.573616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568613+0000","last_change":"2023-12-01T15:43:45.587006+0000","last_active":"2023-12-01T15:43:46.568613+0000","last_peered":"2023-12-01T15:43:46.568613+0000","last_clean":"2023-12-01T15:43:46.568613+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:43:46.568613+0000","last_undegraded":"2023-12-01T15:43:46.568613+0000","last_fullsized":"2023-12-01T15:43:46.568613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:51.219271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573182+0000","last_change":"2023-12-01T15:43:45.206261+0000","last_active":"2023-12-01T15:43:45.573182+0000","last_peered":"2023-12-01T15:43:45.573182+0000","last_clean":"2023-12-01T15:43:45.573182+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T15:43:45.573182+0000","last_undegraded":"2023-12-01T15:43:45.573182+0000","last_fullsized":"2023-12-01T15:43:45.573182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843197+0000","last_change":"2023-12-01T15:43:45.575553+0000","last_active":"2023-12-01T15:43:46.843197+0000","last_peered":"2023-12-01T15:43:46.843197+0000","last_clean":"2023-12-01T15:43:46.843197+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T15:43:46.843197+0000","last_undegraded":"2023-12-01T15:43:46.843197+0000","last_fullsized":"2023-12-01T15:43:46.843197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565758+0000","last_change":"2023-12-01T15:43:45.200481+0000","last_active":"2023-12-01T15:43:45.565758+0000","last_peered":"2023-12-01T15:43:45.565758+0000","last_clean":"2023-12-01T15:43:45.565758+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T15:43:45.565758+0000","last_undegraded":"2023-12-01T15:43:45.565758+0000","last_fullsized":"2023-12-01T15:43:45.565758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566765+0000","last_change":"2023-12-01T15:43:45.583342+0000","last_active":"2023-12-01T15:43:46.566765+0000","last_peered":"2023-12-01T15:43:46.566765+0000","last_clean":"2023-12-01T15:43:46.566765+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:43:46.566765+0000","last_undegraded":"2023-12-01T15:43:46.566765+0000","last_fullsized":"2023-12-01T15:43:46.566765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":167,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.576181+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:43:45.576181+0000","last_peered":"2023-12-01T15:43:45.576181+0000","last_clean":"2023-12-01T15:43:45.576181+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:43:45.576181+0000","last_undegraded":"2023-12-01T15:43:45.576181+0000","last_fullsized":"2023-12-01T15:43:45.576181+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:09:18.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573475+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:43:45.573475+0000","last_peered":"2023-12-01T15:43:45.573475+0000","last_clean":"2023-12-01T15:43:45.573475+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:43:45.573475+0000","last_undegraded":"2023-12-01T15:43:45.573475+0000","last_fullsized":"2023-12-01T15:43:45.573475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:10:37.881379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566049+0000","last_change":"2023-12-01T15:43:45.201766+0000","last_active":"2023-12-01T15:43:45.566049+0000","last_peered":"2023-12-01T15:43:45.566049+0000","last_clean":"2023-12-01T15:43:45.566049+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T15:43:45.566049+0000","last_undegraded":"2023-12-01T15:43:45.566049+0000","last_fullsized":"2023-12-01T15:43:45.566049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568848+0000","last_change":"2023-12-01T15:43:45.590436+0000","last_active":"2023-12-01T15:43:46.568848+0000","last_peered":"2023-12-01T15:43:46.568848+0000","last_clean":"2023-12-01T15:43:46.568848+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:43:46.568848+0000","last_undegraded":"2023-12-01T15:43:46.568848+0000","last_fullsized":"2023-12-01T15:43:46.568848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.576059+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:43:45.576059+0000","last_peered":"2023-12-01T15:43:45.576059+0000","last_clean":"2023-12-01T15:43:45.576059+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:43:45.576059+0000","last_undegraded":"2023-12-01T15:43:45.576059+0000","last_fullsized":"2023-12-01T15:43:45.576059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.553541+0000","last_change":"2023-12-01T15:43:45.209138+0000","last_active":"2023-12-01T15:43:45.553541+0000","last_peered":"2023-12-01T15:43:45.553541+0000","last_clean":"2023-12-01T15:43:45.553541+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T15:43:45.553541+0000","last_undegraded":"2023-12-01T15:43:45.553541+0000","last_fullsized":"2023-12-01T15:43:45.553541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842011+0000","last_change":"2023-12-01T15:43:45.571537+0000","last_active":"2023-12-01T15:43:46.842011+0000","last_peered":"2023-12-01T15:43:46.842011+0000","last_clean":"2023-12-01T15:43:46.842011+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T15:43:46.842011+0000","last_undegraded":"2023-12-01T15:43:46.842011+0000","last_fullsized":"2023-12-01T15:43:46.842011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566045+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:43:45.566045+0000","last_peered":"2023-12-01T15:43:45.566045+0000","last_clean":"2023-12-01T15:43:45.566045+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:43:45.566045+0000","last_undegraded":"2023-12-01T15:43:45.566045+0000","last_fullsized":"2023-12-01T15:43:45.566045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:05:36.049760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565894+0000","last_change":"2023-12-01T15:43:45.204466+0000","last_active":"2023-12-01T15:43:45.565894+0000","last_peered":"2023-12-01T15:43:45.565894+0000","last_clean":"2023-12-01T15:43:45.565894+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T15:43:45.565894+0000","last_undegraded":"2023-12-01T15:43:45.565894+0000","last_fullsized":"2023-12-01T15:43:45.565894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566877+0000","last_change":"2023-12-01T15:43:45.583120+0000","last_active":"2023-12-01T15:43:46.566877+0000","last_peered":"2023-12-01T15:43:46.566877+0000","last_clean":"2023-12-01T15:43:46.566877+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:43:46.566877+0000","last_undegraded":"2023-12-01T15:43:46.566877+0000","last_fullsized":"2023-12-01T15:43:46.566877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573724+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:43:45.573724+0000","last_peered":"2023-12-01T15:43:45.573724+0000","last_clean":"2023-12-01T15:43:45.573724+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:43:45.573724+0000","last_undegraded":"2023-12-01T15:43:45.573724+0000","last_fullsized":"2023-12-01T15:43:45.573724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:11:42.240939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.560516+0000","last_change":"2023-12-01T15:43:45.207506+0000","last_active":"2023-12-01T15:43:45.560516+0000","last_peered":"2023-12-01T15:43:45.560516+0000","last_clean":"2023-12-01T15:43:45.560516+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T15:43:45.560516+0000","last_undegraded":"2023-12-01T15:43:45.560516+0000","last_fullsized":"2023-12-01T15:43:45.560516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566104+0000","last_change":"2023-12-01T15:43:45.574596+0000","last_active":"2023-12-01T15:43:46.566104+0000","last_peered":"2023-12-01T15:43:46.566104+0000","last_clean":"2023-12-01T15:43:46.566104+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:43:46.566104+0000","last_undegraded":"2023-12-01T15:43:46.566104+0000","last_fullsized":"2023-12-01T15:43:46.566104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.559471+0000","last_change":"2023-12-01T15:43:45.210575+0000","last_active":"2023-12-01T15:43:45.559471+0000","last_peered":"2023-12-01T15:43:45.559471+0000","last_clean":"2023-12-01T15:43:45.559471+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T15:43:45.559471+0000","last_undegraded":"2023-12-01T15:43:45.559471+0000","last_fullsized":"2023-12-01T15:43:45.559471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566296+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:43:45.566296+0000","last_peered":"2023-12-01T15:43:45.566296+0000","last_clean":"2023-12-01T15:43:45.566296+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:43:45.566296+0000","last_undegraded":"2023-12-01T15:43:45.566296+0000","last_fullsized":"2023-12-01T15:43:45.566296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565752+0000","last_change":"2023-12-01T15:43:45.582851+0000","last_active":"2023-12-01T15:43:46.565752+0000","last_peered":"2023-12-01T15:43:46.565752+0000","last_clean":"2023-12-01T15:43:46.565752+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:43:46.565752+0000","last_undegraded":"2023-12-01T15:43:46.565752+0000","last_fullsized":"2023-12-01T15:43:46.565752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566272+0000","last_change":"2023-12-01T15:43:45.200408+0000","last_active":"2023-12-01T15:43:45.566272+0000","last_peered":"2023-12-01T15:43:45.566272+0000","last_clean":"2023-12-01T15:43:45.566272+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T15:43:45.566272+0000","last_undegraded":"2023-12-01T15:43:45.566272+0000","last_fullsized":"2023-12-01T15:43:45.566272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.578703+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:43:45.578703+0000","last_peered":"2023-12-01T15:43:45.578703+0000","last_clean":"2023-12-01T15:43:45.578703+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:43:45.578703+0000","last_undegraded":"2023-12-01T15:43:45.578703+0000","last_fullsized":"2023-12-01T15:43:45.578703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:50:39.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841404+0000","last_change":"2023-12-01T15:43:45.575493+0000","last_active":"2023-12-01T15:43:46.841404+0000","last_peered":"2023-12-01T15:43:46.841404+0000","last_clean":"2023-12-01T15:43:46.841404+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T15:43:46.841404+0000","last_undegraded":"2023-12-01T15:43:46.841404+0000","last_fullsized":"2023-12-01T15:43:46.841404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:19.706992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.580835+0000","last_change":"2023-12-01T15:43:45.203186+0000","last_active":"2023-12-01T15:43:45.580835+0000","last_peered":"2023-12-01T15:43:45.580835+0000","last_clean":"2023-12-01T15:43:45.580835+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T15:43:45.580835+0000","last_undegraded":"2023-12-01T15:43:45.580835+0000","last_fullsized":"2023-12-01T15:43:45.580835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566535+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:43:45.566535+0000","last_peered":"2023-12-01T15:43:45.566535+0000","last_clean":"2023-12-01T15:43:45.566535+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:43:45.566535+0000","last_undegraded":"2023-12-01T15:43:45.566535+0000","last_fullsized":"2023-12-01T15:43:45.566535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:40:03.704778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840408+0000","last_change":"2023-12-01T15:43:45.566432+0000","last_active":"2023-12-01T15:43:46.840408+0000","last_peered":"2023-12-01T15:43:46.840408+0000","last_clean":"2023-12-01T15:43:46.840408+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:43:46.840408+0000","last_undegraded":"2023-12-01T15:43:46.840408+0000","last_fullsized":"2023-12-01T15:43:46.840408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.556977+0000","last_change":"2023-12-01T15:43:45.205286+0000","last_active":"2023-12-01T15:43:45.556977+0000","last_peered":"2023-12-01T15:43:45.556977+0000","last_clean":"2023-12-01T15:43:45.556977+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T15:43:45.556977+0000","last_undegraded":"2023-12-01T15:43:45.556977+0000","last_fullsized":"2023-12-01T15:43:45.556977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.577882+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:43:45.577882+0000","last_peered":"2023-12-01T15:43:45.577882+0000","last_clean":"2023-12-01T15:43:45.577882+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:43:45.577882+0000","last_undegraded":"2023-12-01T15:43:45.577882+0000","last_fullsized":"2023-12-01T15:43:45.577882+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:55:21.181781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841996+0000","last_change":"2023-12-01T15:43:45.581071+0000","last_active":"2023-12-01T15:43:46.841996+0000","last_peered":"2023-12-01T15:43:46.841996+0000","last_clean":"2023-12-01T15:43:46.841996+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T15:43:46.841996+0000","last_undegraded":"2023-12-01T15:43:46.841996+0000","last_fullsized":"2023-12-01T15:43:46.841996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842819+0000","last_change":"2023-12-01T15:43:45.576345+0000","last_active":"2023-12-01T15:43:46.842819+0000","last_peered":"2023-12-01T15:43:46.842819+0000","last_clean":"2023-12-01T15:43:46.842819+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:43:46.842819+0000","last_undegraded":"2023-12-01T15:43:46.842819+0000","last_fullsized":"2023-12-01T15:43:46.842819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:21:55.500677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.593872+0000","last_change":"2023-12-01T15:43:45.208015+0000","last_active":"2023-12-01T15:43:45.593872+0000","last_peered":"2023-12-01T15:43:45.593872+0000","last_clean":"2023-12-01T15:43:45.593872+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T15:43:45.593872+0000","last_undegraded":"2023-12-01T15:43:45.593872+0000","last_fullsized":"2023-12-01T15:43:45.593872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565594+0000","last_change":"2023-12-01T15:43:45.582830+0000","last_active":"2023-12-01T15:43:46.565594+0000","last_peered":"2023-12-01T15:43:46.565594+0000","last_clean":"2023-12-01T15:43:46.565594+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T15:43:46.565594+0000","last_undegraded":"2023-12-01T15:43:46.565594+0000","last_fullsized":"2023-12-01T15:43:46.565594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573539+0000","last_change":"2023-12-01T15:43:45.210538+0000","last_active":"2023-12-01T15:43:45.573539+0000","last_peered":"2023-12-01T15:43:45.573539+0000","last_clean":"2023-12-01T15:43:45.573539+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T15:43:45.573539+0000","last_undegraded":"2023-12-01T15:43:45.573539+0000","last_fullsized":"2023-12-01T15:43:45.573539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.562469+0000","last_change":"2023-12-01T15:43:45.204325+0000","last_active":"2023-12-01T15:43:45.562469+0000","last_peered":"2023-12-01T15:43:45.562469+0000","last_clean":"2023-12-01T15:43:45.562469+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T15:43:45.562469+0000","last_undegraded":"2023-12-01T15:43:45.562469+0000","last_fullsized":"2023-12-01T15:43:45.562469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840881+0000","last_change":"2023-12-01T15:43:45.583931+0000","last_active":"2023-12-01T15:43:46.840881+0000","last_peered":"2023-12-01T15:43:46.840881+0000","last_clean":"2023-12-01T15:43:46.840881+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T15:43:46.840881+0000","last_undegraded":"2023-12-01T15:43:46.840881+0000","last_fullsized":"2023-12-01T15:43:46.840881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:36.724287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.556940+0000","last_change":"2023-12-01T15:43:45.203624+0000","last_active":"2023-12-01T15:43:45.556940+0000","last_peered":"2023-12-01T15:43:45.556940+0000","last_clean":"2023-12-01T15:43:45.556940+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T15:43:45.556940+0000","last_undegraded":"2023-12-01T15:43:45.556940+0000","last_fullsized":"2023-12-01T15:43:45.556940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565039+0000","last_change":"2023-12-01T15:43:45.572933+0000","last_active":"2023-12-01T15:43:46.565039+0000","last_peered":"2023-12-01T15:43:46.565039+0000","last_clean":"2023-12-01T15:43:46.565039+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:43:46.565039+0000","last_undegraded":"2023-12-01T15:43:46.565039+0000","last_fullsized":"2023-12-01T15:43:46.565039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568640+0000","last_change":"2023-12-01T15:43:45.587913+0000","last_active":"2023-12-01T15:43:46.568640+0000","last_peered":"2023-12-01T15:43:46.568640+0000","last_clean":"2023-12-01T15:43:46.568640+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:43:46.568640+0000","last_undegraded":"2023-12-01T15:43:46.568640+0000","last_fullsized":"2023-12-01T15:43:46.568640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:20.675396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565673+0000","last_change":"2023-12-01T15:43:45.205650+0000","last_active":"2023-12-01T15:43:45.565673+0000","last_peered":"2023-12-01T15:43:45.565673+0000","last_clean":"2023-12-01T15:43:45.565673+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:43:45.565673+0000","last_undegraded":"2023-12-01T15:43:45.565673+0000","last_fullsized":"2023-12-01T15:43:45.565673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841953+0000","last_change":"2023-12-01T15:43:45.574378+0000","last_active":"2023-12-01T15:43:46.841953+0000","last_peered":"2023-12-01T15:43:46.841953+0000","last_clean":"2023-12-01T15:43:46.841953+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T15:43:46.841953+0000","last_undegraded":"2023-12-01T15:43:46.841953+0000","last_fullsized":"2023-12-01T15:43:46.841953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565955+0000","last_change":"2023-12-01T15:43:45.200400+0000","last_active":"2023-12-01T15:43:45.565955+0000","last_peered":"2023-12-01T15:43:45.565955+0000","last_clean":"2023-12-01T15:43:45.565955+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:43:45.565955+0000","last_undegraded":"2023-12-01T15:43:45.565955+0000","last_fullsized":"2023-12-01T15:43:45.565955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841820+0000","last_change":"2023-12-01T15:43:45.570253+0000","last_active":"2023-12-01T15:43:46.841820+0000","last_peered":"2023-12-01T15:43:46.841820+0000","last_clean":"2023-12-01T15:43:46.841820+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:43:46.841820+0000","last_undegraded":"2023-12-01T15:43:46.841820+0000","last_fullsized":"2023-12-01T15:43:46.841820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.574389+0000","last_change":"2023-12-01T15:43:45.200975+0000","last_active":"2023-12-01T15:43:45.574389+0000","last_peered":"2023-12-01T15:43:45.574389+0000","last_clean":"2023-12-01T15:43:45.574389+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:43:45.574389+0000","last_undegraded":"2023-12-01T15:43:45.574389+0000","last_fullsized":"2023-12-01T15:43:45.574389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566128+0000","last_change":"2023-12-01T15:43:45.575004+0000","last_active":"2023-12-01T15:43:46.566128+0000","last_peered":"2023-12-01T15:43:46.566128+0000","last_clean":"2023-12-01T15:43:46.566128+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T15:43:46.566128+0000","last_undegraded":"2023-12-01T15:43:46.566128+0000","last_fullsized":"2023-12-01T15:43:46.566128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.569598+0000","last_change":"2023-12-01T15:43:45.208899+0000","last_active":"2023-12-01T15:43:45.569598+0000","last_peered":"2023-12-01T15:43:45.569598+0000","last_clean":"2023-12-01T15:43:45.569598+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T15:43:45.569598+0000","last_undegraded":"2023-12-01T15:43:45.569598+0000","last_fullsized":"2023-12-01T15:43:45.569598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842631+0000","last_change":"2023-12-01T15:43:45.578059+0000","last_active":"2023-12-01T15:43:46.842631+0000","last_peered":"2023-12-01T15:43:46.842631+0000","last_clean":"2023-12-01T15:43:46.842631+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T15:43:46.842631+0000","last_undegraded":"2023-12-01T15:43:46.842631+0000","last_fullsized":"2023-12-01T15:43:46.842631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.570848+0000","last_change":"2023-12-01T15:43:45.203471+0000","last_active":"2023-12-01T15:43:45.570848+0000","last_peered":"2023-12-01T15:43:45.570848+0000","last_clean":"2023-12-01T15:43:45.570848+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T15:43:45.570848+0000","last_undegraded":"2023-12-01T15:43:45.570848+0000","last_fullsized":"2023-12-01T15:43:45.570848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841785+0000","last_change":"2023-12-01T15:43:45.573522+0000","last_active":"2023-12-01T15:43:46.841785+0000","last_peered":"2023-12-01T15:43:46.841785+0000","last_clean":"2023-12-01T15:43:46.841785+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:43:46.841785+0000","last_undegraded":"2023-12-01T15:43:46.841785+0000","last_fullsized":"2023-12-01T15:43:46.841785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.591060+0000","last_change":"2023-12-01T15:43:45.208222+0000","last_active":"2023-12-01T15:43:45.591060+0000","last_peered":"2023-12-01T15:43:45.591060+0000","last_clean":"2023-12-01T15:43:45.591060+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:43:45.591060+0000","last_undegraded":"2023-12-01T15:43:45.591060+0000","last_fullsized":"2023-12-01T15:43:45.591060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840961+0000","last_change":"2023-12-01T15:43:45.571469+0000","last_active":"2023-12-01T15:43:46.840961+0000","last_peered":"2023-12-01T15:43:46.840961+0000","last_clean":"2023-12-01T15:43:46.840961+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:43:46.840961+0000","last_undegraded":"2023-12-01T15:43:46.840961+0000","last_fullsized":"2023-12-01T15:43:46.840961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571989+0000","last_change":"2023-12-01T15:43:45.208256+0000","last_active":"2023-12-01T15:43:45.571989+0000","last_peered":"2023-12-01T15:43:45.571989+0000","last_clean":"2023-12-01T15:43:45.571989+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T15:43:45.571989+0000","last_undegraded":"2023-12-01T15:43:45.571989+0000","last_fullsized":"2023-12-01T15:43:45.571989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841878+0000","last_change":"2023-12-01T15:43:45.575215+0000","last_active":"2023-12-01T15:43:46.841878+0000","last_peered":"2023-12-01T15:43:46.841878+0000","last_clean":"2023-12-01T15:43:46.841878+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:43:46.841878+0000","last_undegraded":"2023-12-01T15:43:46.841878+0000","last_fullsized":"2023-12-01T15:43:46.841878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571407+0000","last_change":"2023-12-01T15:43:45.204599+0000","last_active":"2023-12-01T15:43:45.571407+0000","last_peered":"2023-12-01T15:43:45.571407+0000","last_clean":"2023-12-01T15:43:45.571407+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T15:43:45.571407+0000","last_undegraded":"2023-12-01T15:43:45.571407+0000","last_fullsized":"2023-12-01T15:43:45.571407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":798720,"data_stored":653237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":62307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":176128,"data_stored":60597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":782336,"data_stored":651707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T15:43:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-01T15:43:54.345 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-01T15:43:54.345 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-01T15:43:54.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-01T15:43:54.345 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-01T15:43:54.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.452+0000 7fa1e162c700 1 Processor -- start 2023-12-01T15:43:54.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.452+0000 7fa1e162c700 1 -- start start 2023-12-01T15:43:54.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa1dc1376e0 0x7fa1dc137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06ba50 0x7fa1dc06bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1dc09c240 con 0x7fa1dc06c3e0 2023-12-01T15:43:54.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc138000 con 0x7fa1dc1376e0 2023-12-01T15:43:54.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc06c870 con 0x7fa1dc06ba50 2023-12-01T15:43:54.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e0e2b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa1dc06c3e0 0x7fa1dc1418b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41972/0 (socket says 172.21.15.63:41972) 2023-12-01T15:43:54.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e0e2b700 1 -- 172.21.15.63:0/1582485246 learned_addr learned my addr 172.21.15.63:0/1582485246 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:54.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1dbfff700 1 --2- 172.21.15.63:0/1582485246 >> v2:172.21.15.66:3300/0 conn(0x7fa1dc1376e0 0x7fa1dc137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1db7fe700 1 --2- 172.21.15.63:0/1582485246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06ba50 0x7fa1dc06bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1dbfff700 1 -- 172.21.15.63:0/1582485246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06ba50 msgr2=0x7fa1dc06bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:54.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1dbfff700 1 --2- 172.21.15.63:0/1582485246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06ba50 0x7fa1dc06bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1dbfff700 1 -- 172.21.15.63:0/1582485246 >> v1:172.21.15.63:6789/0 conn(0x7fa1dc06c3e0 legacy=0x7fa1dc1418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1daffd700 1 -- 172.21.15.63:0/1582485246 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632252401 0 0) 0x7fa1dc09c240 con 0x7fa1dc06c3e0 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1dbfff700 1 -- 172.21.15.63:0/1582485246 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc09bc90 con 0x7fa1dc1376e0 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1db7fe700 1 --2- 172.21.15.63:0/1582485246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06ba50 0x7fa1dc06bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1dbfff700 1 --2- 172.21.15.63:0/1582485246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1dc1376e0 0x7fa1dc137ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009850 tx=0x7fa1c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7896bee9ff46b194 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1daffd700 1 -- 172.21.15.63:0/1582485246 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4011830 con 0x7fa1dc1376e0 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1daffd700 1 -- 172.21.15.63:0/1582485246 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c4011990 con 0x7fa1dc1376e0 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1daffd700 1 -- 172.21.15.63:0/1582485246 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4011d40 con 0x7fa1dc1376e0 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 -- 172.21.15.63:0/1582485246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1dc1376e0 msgr2=0x7fa1dc137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 --2- 172.21.15.63:0/1582485246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1dc1376e0 0x7fa1dc137ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009850 tx=0x7fa1c4009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 -- 172.21.15.63:0/1582485246 shutdown_connections 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 --2- 172.21.15.63:0/1582485246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06ba50 0x7fa1dc06bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 --2- 172.21.15.63:0/1582485246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1dc1376e0 0x7fa1dc137ac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 -- 172.21.15.63:0/1582485246 >> 172.21.15.63:0/1582485246 conn(0x7fa1dc0737a0 msgr2=0x7fa1dc0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:54.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 -- 172.21.15.63:0/1582485246 shutdown_connections 2023-12-01T15:43:54.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.456+0000 7fa1e162c700 1 -- 172.21.15.63:0/1582485246 wait complete. 2023-12-01T15:43:54.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e162c700 1 Processor -- start 2023-12-01T15:43:54.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e162c700 1 -- start start 2023-12-01T15:43:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e162c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1dc06ba50 0x7fa1dc1cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e162c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06c3e0 0x7fa1dc1cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e162c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1dc1376e0 0x7fa1dc1cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e162c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0a6db0 con 0x7fa1dc06ba50 2023-12-01T15:43:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e162c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0a5950 con 0x7fa1dc1376e0 2023-12-01T15:43:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e162c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0a87c0 con 0x7fa1dc06c3e0 2023-12-01T15:43:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1dbfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1dc06ba50 0x7fa1dc1cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1dbfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1dc06ba50 0x7fa1dc1cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46792/0 (socket says 172.21.15.63:46792) 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1dbfff700 1 -- 172.21.15.63:0/1420572842 learned_addr learned my addr 172.21.15.63:0/1420572842 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1db7fe700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06c3e0 0x7fa1dc1cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1dbfff700 1 -- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06c3e0 msgr2=0x7fa1dc1cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1dbfff700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06c3e0 0x7fa1dc1cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e0e2b700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1dc1376e0 0x7fa1dc1cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1dbfff700 1 -- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1dc1376e0 msgr2=0x7fa1dc1cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1dbfff700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1dc1376e0 0x7fa1dc1cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1dbfff700 1 -- 172.21.15.63:0/1420572842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc009a70 con 0x7fa1dc06ba50 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1db7fe700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06c3e0 0x7fa1dc1cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e0e2b700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1dc1376e0 0x7fa1dc1cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1dbfff700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1dc06ba50 0x7fa1dc1cf290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4000c00 tx=0x7fa1c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:54.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1d8ff9700 1 -- 172.21.15.63:0/1420572842 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c401aac0 con 0x7fa1dc06ba50 2023-12-01T15:43:54.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e162c700 1 -- 172.21.15.63:0/1420572842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c40094b0 con 0x7fa1dc06ba50 2023-12-01T15:43:54.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1d8ff9700 1 -- 172.21.15.63:0/1420572842 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c401f070 con 0x7fa1dc06ba50 2023-12-01T15:43:54.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1d8ff9700 1 -- 172.21.15.63:0/1420572842 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c401ae60 con 0x7fa1dc06ba50 2023-12-01T15:43:54.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.460+0000 7fa1e162c700 1 -- 172.21.15.63:0/1420572842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc0a7750 con 0x7fa1dc06ba50 2023-12-01T15:43:54.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.464+0000 7fa1e162c700 1 -- 172.21.15.63:0/1420572842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc09b7e0 con 0x7fa1dc06ba50 2023-12-01T15:43:54.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.464+0000 7fa1d8ff9700 1 -- 172.21.15.63:0/1420572842 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa1c401b430 con 0x7fa1dc06ba50 2023-12-01T15:43:54.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.464+0000 7fa1d8ff9700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa1c0065ad0 0x7fa1c0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.464+0000 7fa1d8ff9700 1 -- 172.21.15.63:0/1420572842 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fa1c40845d0 con 0x7fa1dc06ba50 2023-12-01T15:43:54.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.464+0000 7fa1db7fe700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa1c0065ad0 0x7fa1c0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.468+0000 7fa1db7fe700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa1c0065ad0 0x7fa1c0067f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009fd0 tx=0x7fa1cc00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.468+0000 7fa1d8ff9700 1 -- 172.21.15.63:0/1420572842 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa1c40524e0 con 0x7fa1dc06ba50 2023-12-01T15:43:54.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.672+0000 7fa1e162c700 1 -- 172.21.15.63:0/1420572842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa1dc065fb0 con 0x7fa1dc06ba50 2023-12-01T15:43:54.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.676+0000 7fa1d8ff9700 1 -- 172.21.15.63:0/1420572842 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+163363 (secure 0 0 0) 0x7fa1c4015090 con 0x7fa1dc06ba50 2023-12-01T15:43:54.683 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:54.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 -- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa1c0065ad0 msgr2=0x7fa1c0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa1c0065ad0 0x7fa1c0067f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009fd0 tx=0x7fa1cc00b040 comp rx=0 tx=0).stop 2023-12-01T15:43:54.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 -- 172.21.15.63:0/1420572842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1dc06ba50 msgr2=0x7fa1dc1cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1dc06ba50 0x7fa1dc1cf290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4000c00 tx=0x7fa1c4004770 comp rx=0 tx=0).stop 2023-12-01T15:43:54.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 -- 172.21.15.63:0/1420572842 shutdown_connections 2023-12-01T15:43:54.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa1c0065ad0 0x7fa1c0067f90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1dc06c3e0 0x7fa1dc1cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1dc1376e0 0x7fa1dc1cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 --2- 172.21.15.63:0/1420572842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1dc06ba50 0x7fa1dc1cf290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 -- 172.21.15.63:0/1420572842 >> 172.21.15.63:0/1420572842 conn(0x7fa1dc0737a0 msgr2=0x7fa1dc0ab060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:54.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 -- 172.21.15.63:0/1420572842 shutdown_connections 2023-12-01T15:43:54.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.680+0000 7fa1e162c700 1 -- 172.21.15.63:0/1420572842 wait complete. 2023-12-01T15:43:54.698 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":6,"active_gid":4102,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":29681},{"type":"v1","addr":"172.21.15.66:6817","nonce":29681}]},"active_addr":"172.21.15.66:6817/29681","active_change":"2023-12-01T15:43:28.353840+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":3453258518}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":3831950470}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":3937148380}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":2321175371}]}]} 2023-12-01T15:43:54.702 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-01T15:43:54.702 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-01T15:43:54.702 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:54.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce63fff700 1 Processor -- start 2023-12-01T15:43:54.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce63fff700 1 -- start start 2023-12-01T15:43:54.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce63fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce64131770 0x7fce6406e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce63fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fce6413d6e0 0x7fce6413fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce63fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce640705e0 con 0x7fce64131390 2023-12-01T15:43:54.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce63fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce64131bd0 con 0x7fce6413d6e0 2023-12-01T15:43:54.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce63fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6406f150 con 0x7fce64131770 2023-12-01T15:43:54.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce62ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fce64131390 0x7fce6406dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41986/0 (socket says 172.21.15.63:41986) 2023-12-01T15:43:54.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce62ffd700 1 -- 172.21.15.63:0/1551037582 learned_addr learned my addr 172.21.15.63:0/1551037582 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:54.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce637fe700 1 --2- 172.21.15.63:0/1551037582 >> v2:172.21.15.66:3300/0 conn(0x7fce6413d6e0 0x7fce6413fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce627fc700 1 --2- 172.21.15.63:0/1551037582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce64131770 0x7fce6406e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce61ffb700 1 -- 172.21.15.63:0/1551037582 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280141390 0 0) 0x7fce640705e0 con 0x7fce64131390 2023-12-01T15:43:54.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce61ffb700 1 -- 172.21.15.63:0/1551037582 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce500035d0 con 0x7fce64131390 2023-12-01T15:43:54.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce627fc700 1 -- 172.21.15.63:0/1551037582 >> v2:172.21.15.66:3300/0 conn(0x7fce6413d6e0 msgr2=0x7fce6413fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:54.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce627fc700 1 --2- 172.21.15.63:0/1551037582 >> v2:172.21.15.66:3300/0 conn(0x7fce6413d6e0 0x7fce6413fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce627fc700 1 -- 172.21.15.63:0/1551037582 >> v1:172.21.15.63:6789/0 conn(0x7fce64131390 legacy=0x7fce6406dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce61ffb700 1 -- 172.21.15.63:0/1551037582 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4155134707 0 0) 0x7fce500035d0 con 0x7fce64131390 2023-12-01T15:43:54.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce627fc700 1 -- 172.21.15.63:0/1551037582 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64071d90 con 0x7fce64131770 2023-12-01T15:43:54.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.808+0000 7fce637fe700 1 --2- 172.21.15.63:0/1551037582 >> v2:172.21.15.66:3300/0 conn(0x7fce6413d6e0 0x7fce6413fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:54.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce627fc700 1 --2- 172.21.15.63:0/1551037582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce64131770 0x7fce6406e300 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009850 tx=0x7fce4c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=679f5b6f7fdc2f44 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:54.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce61ffb700 1 -- 172.21.15.63:0/1551037582 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54001670 con 0x7fce64131770 2023-12-01T15:43:54.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce61ffb700 1 -- 172.21.15.63:0/1551037582 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c004030 con 0x7fce64131770 2023-12-01T15:43:54.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce61ffb700 1 -- 172.21.15.63:0/1551037582 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0043a0 con 0x7fce64131770 2023-12-01T15:43:54.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce63fff700 1 -- 172.21.15.63:0/1551037582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce64131770 msgr2=0x7fce6406e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce63fff700 1 --2- 172.21.15.63:0/1551037582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce64131770 0x7fce6406e300 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009850 tx=0x7fce4c009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:54.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce63fff700 1 -- 172.21.15.63:0/1551037582 shutdown_connections 2023-12-01T15:43:54.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce63fff700 1 --2- 172.21.15.63:0/1551037582 >> v2:172.21.15.66:3300/0 conn(0x7fce6413d6e0 0x7fce6413fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce63fff700 1 --2- 172.21.15.63:0/1551037582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce64131770 0x7fce6406e300 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce63fff700 1 -- 172.21.15.63:0/1551037582 >> 172.21.15.63:0/1551037582 conn(0x7fce640a8bd0 msgr2=0x7fce64098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:54.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce63fff700 1 -- 172.21.15.63:0/1551037582 shutdown_connections 2023-12-01T15:43:54.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce63fff700 1 -- 172.21.15.63:0/1551037582 wait complete. 2023-12-01T15:43:54.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce63fff700 1 Processor -- start 2023-12-01T15:43:54.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.812+0000 7fce63fff700 1 -- start start 2023-12-01T15:43:54.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce63fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce64131390 0x7fce64139440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce63fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce64131770 0x7fce64132d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce63fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce6413d6e0 0x7fce64133270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce63fff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce641c8990 con 0x7fce64131770 2023-12-01T15:43:54.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce63fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64139980 con 0x7fce64131390 2023-12-01T15:43:54.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce63fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce641c7d10 con 0x7fce6413d6e0 2023-12-01T15:43:54.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce627fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce64131770 0x7fce64132d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce627fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce64131770 0x7fce64132d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46800/0 (socket says 172.21.15.63:46800) 2023-12-01T15:43:54.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce627fc700 1 -- 172.21.15.63:0/2802983191 learned_addr learned my addr 172.21.15.63:0/2802983191 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:54.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce637fe700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce6413d6e0 0x7fce64133270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce62ffd700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce64131390 0x7fce64139440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce627fc700 1 -- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce6413d6e0 msgr2=0x7fce64133270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce627fc700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce6413d6e0 0x7fce64133270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce627fc700 1 -- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce64131390 msgr2=0x7fce64139440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:54.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce627fc700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce64131390 0x7fce64139440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:54.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce627fc700 1 -- 172.21.15.63:0/2802983191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c009a70 con 0x7fce64131770 2023-12-01T15:43:54.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce627fc700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce64131770 0x7fce64132d30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0090b0 tx=0x7fce4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:54.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce5b7fe700 1 -- 172.21.15.63:0/2802983191 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c003b70 con 0x7fce64131770 2023-12-01T15:43:54.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce5b7fe700 1 -- 172.21.15.63:0/2802983191 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c01f070 con 0x7fce64131770 2023-12-01T15:43:54.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce63fff700 1 -- 172.21.15.63:0/2802983191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c0094b0 con 0x7fce64131770 2023-12-01T15:43:54.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce5b7fe700 1 -- 172.21.15.63:0/2802983191 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c011630 con 0x7fce64131770 2023-12-01T15:43:54.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce63fff700 1 -- 172.21.15.63:0/2802983191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce64138cd0 con 0x7fce64131770 2023-12-01T15:43:54.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.816+0000 7fce63fff700 1 -- 172.21.15.63:0/2802983191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce64065fb0 con 0x7fce64131770 2023-12-01T15:43:54.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.820+0000 7fce5b7fe700 1 -- 172.21.15.63:0/2802983191 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fce4c021030 con 0x7fce64131770 2023-12-01T15:43:54.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.820+0000 7fce5b7fe700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fce44065ad0 0x7fce44067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:54.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.820+0000 7fce5b7fe700 1 -- 172.21.15.63:0/2802983191 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fce4c083d40 con 0x7fce64131770 2023-12-01T15:43:54.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.820+0000 7fce62ffd700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fce44065ad0 0x7fce44067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:54.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.820+0000 7fce62ffd700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fce44065ad0 0x7fce44067f90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce540011e0 tx=0x7fce54001da0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:54.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.824+0000 7fce5b7fe700 1 -- 172.21.15.63:0/2802983191 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fce4c051e10 con 0x7fce64131770 2023-12-01T15:43:54.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.992+0000 7fce63fff700 1 -- 172.21.15.63:0/2802983191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce64065fb0 con 0x7fce64131770 2023-12-01T15:43:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce5b7fe700 1 -- 172.21.15.63:0/2802983191 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7fce4c055430 con 0x7fce64131770 2023-12-01T15:43:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:54.999 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:46.548806+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 -- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fce44065ad0 msgr2=0x7fce44067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fce44065ad0 0x7fce44067f90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce540011e0 tx=0x7fce54001da0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 -- 172.21.15.63:0/2802983191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce64131770 msgr2=0x7fce64132d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce64131770 0x7fce64132d30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0090b0 tx=0x7fce4c004770 comp rx=0 tx=0).stop 2023-12-01T15:43:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 -- 172.21.15.63:0/2802983191 shutdown_connections 2023-12-01T15:43:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fce44065ad0 0x7fce44067f90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce6413d6e0 0x7fce64133270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce64131770 0x7fce64132d30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 --2- 172.21.15.63:0/2802983191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce64131390 0x7fce64139440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 -- 172.21.15.63:0/2802983191 >> 172.21.15.63:0/2802983191 conn(0x7fce640a8bd0 msgr2=0x7fce64130440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 -- 172.21.15.63:0/2802983191 shutdown_connections 2023-12-01T15:43:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:54.996+0000 7fce63fff700 1 -- 172.21.15.63:0/2802983191 wait complete. 2023-12-01T15:43:55.014 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-01T15:43:55.014 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff922e6b700 1 Processor -- start 2023-12-01T15:43:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff922e6b700 1 -- start start 2023-12-01T15:43:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff922e6b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff91c141970 0x7ff91c143d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff922e6b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91c0a4b20 con 0x7ff91c13af50 2023-12-01T15:43:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff922e6b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91c0a3540 con 0x7ff91c13b330 2023-12-01T15:43:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff922e6b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91c0a3880 con 0x7ff91c141970 2023-12-01T15:43:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff921e69700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff91c13af50 0x7ff91c137080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42000/0 (socket says 172.21.15.63:42000) 2023-12-01T15:43:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff921e69700 1 -- 172.21.15.63:0/4277674560 learned_addr learned my addr 172.21.15.63:0/4277674560 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff92266a700 1 --2- 172.21.15.63:0/4277674560 >> v2:172.21.15.66:3300/0 conn(0x7ff91c141970 0x7ff91c143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff920e67700 1 -- 172.21.15.63:0/4277674560 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120868335 0 0) 0x7ff90c001110 con 0x7ff91c13af50 2023-12-01T15:43:55.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff920e67700 1 -- 172.21.15.63:0/4277674560 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9080035d0 con 0x7ff91c13af50 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff920e67700 1 -- 172.21.15.63:0/4277674560 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146169528 0 0) 0x7ff91c0a3540 con 0x7ff91c13b330 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff920e67700 1 -- 172.21.15.63:0/4277674560 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff90c001110 con 0x7ff91c13b330 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff92266a700 1 -- 172.21.15.63:0/4277674560 >> v1:172.21.15.66:6789/0 conn(0x7ff91c13b330 legacy=0x7ff91c137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff92266a700 1 -- 172.21.15.63:0/4277674560 >> v1:172.21.15.63:6789/0 conn(0x7ff91c13af50 legacy=0x7ff91c137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff92266a700 1 -- 172.21.15.63:0/4277674560 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c0a3270 con 0x7ff91c141970 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff92266a700 1 --2- 172.21.15.63:0/4277674560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff91c141970 0x7ff91c143d60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff914009880 tx=0x7ff914009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375dcb910048c701 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff920e67700 1 -- 172.21.15.63:0/4277674560 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914011830 con 0x7ff91c141970 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff920e67700 1 -- 172.21.15.63:0/4277674560 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff914011990 con 0x7ff91c141970 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.124+0000 7ff920e67700 1 -- 172.21.15.63:0/4277674560 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914011d20 con 0x7ff91c141970 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 -- 172.21.15.63:0/4277674560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff91c141970 msgr2=0x7ff91c143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 --2- 172.21.15.63:0/4277674560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff91c141970 0x7ff91c143d60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff914009880 tx=0x7ff914009b90 comp rx=0 tx=0).stop 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 -- 172.21.15.63:0/4277674560 shutdown_connections 2023-12-01T15:43:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 --2- 172.21.15.63:0/4277674560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff91c141970 0x7ff91c143d60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 -- 172.21.15.63:0/4277674560 >> 172.21.15.63:0/4277674560 conn(0x7ff91c0a8bd0 msgr2=0x7ff91c098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 -- 172.21.15.63:0/4277674560 shutdown_connections 2023-12-01T15:43:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 -- 172.21.15.63:0/4277674560 wait complete. 2023-12-01T15:43:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 Processor -- start 2023-12-01T15:43:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 -- start start 2023-12-01T15:43:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c13af50 0x7ff91c139a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff91c141970 0x7ff91c12e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff91c12e670 0x7ff91c132480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c133520 con 0x7ff91c13af50 2023-12-01T15:43:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c06c920 con 0x7ff91c141970 2023-12-01T15:43:55.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c134910 con 0x7ff91c12e670 2023-12-01T15:43:55.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff921e69700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c13af50 0x7ff91c139a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff921e69700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c13af50 0x7ff91c139a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46802/0 (socket says 172.21.15.63:46802) 2023-12-01T15:43:55.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff921e69700 1 -- 172.21.15.63:0/1607278901 learned_addr learned my addr 172.21.15.63:0/1607278901 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:55.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff921668700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff91c141970 0x7ff91c12e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff92266a700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff91c12e670 0x7ff91c132480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff921e69700 1 -- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff91c12e670 msgr2=0x7ff91c132480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff921e69700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff91c12e670 0x7ff91c132480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff921e69700 1 -- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff91c141970 msgr2=0x7ff91c12e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff921e69700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff91c141970 0x7ff91c12e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff921e69700 1 -- 172.21.15.63:0/1607278901 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9140094b0 con 0x7ff91c13af50 2023-12-01T15:43:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff921e69700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c13af50 0x7ff91c139a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00c700 tx=0x7ff90c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff9127fc700 1 -- 172.21.15.63:0/1607278901 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c005d90 con 0x7ff91c13af50 2023-12-01T15:43:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff9127fc700 1 -- 172.21.15.63:0/1607278901 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c0070d0 con 0x7ff91c13af50 2023-12-01T15:43:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff9127fc700 1 -- 172.21.15.63:0/1607278901 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c007480 con 0x7ff91c13af50 2023-12-01T15:43:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 -- 172.21.15.63:0/1607278901 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91c12eaf0 con 0x7ff91c13af50 2023-12-01T15:43:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.128+0000 7ff922e6b700 1 -- 172.21.15.63:0/1607278901 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91c134520 con 0x7ff91c13af50 2023-12-01T15:43:55.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.132+0000 7ff922e6b700 1 -- 172.21.15.63:0/1607278901 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91c065fb0 con 0x7ff91c13af50 2023-12-01T15:43:55.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.132+0000 7ff9127fc700 1 -- 172.21.15.63:0/1607278901 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff90c0075e0 con 0x7ff91c13af50 2023-12-01T15:43:55.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.132+0000 7ff9127fc700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff900065ad0 0x7ff900067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.132+0000 7ff9127fc700 1 -- 172.21.15.63:0/1607278901 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7ff90c081fa0 con 0x7ff91c13af50 2023-12-01T15:43:55.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.132+0000 7ff921668700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff900065ad0 0x7ff900067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.132+0000 7ff921668700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff900065ad0 0x7ff900067f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff91c13a2d0 tx=0x7ff918009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.140+0000 7ff9127fc700 1 -- 172.21.15.63:0/1607278901 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff90c0b3070 con 0x7ff91c13af50 2023-12-01T15:43:55.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.304+0000 7ff922e6b700 1 -- 172.21.15.63:0/1607278901 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff91c0a4b20 con 0x7ff91c13af50 2023-12-01T15:43:55.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.304+0000 7ff9127fc700 1 -- 172.21.15.63:0/1607278901 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7ff91c0a4b20 con 0x7ff91c13af50 2023-12-01T15:43:55.309 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:55.310 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:46.548806+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:55.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 -- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff900065ad0 msgr2=0x7ff900067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff900065ad0 0x7ff900067f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff91c13a2d0 tx=0x7ff918009040 comp rx=0 tx=0).stop 2023-12-01T15:43:55.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 -- 172.21.15.63:0/1607278901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c13af50 msgr2=0x7ff91c139a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c13af50 0x7ff91c139a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00c700 tx=0x7ff90c00ca10 comp rx=0 tx=0).stop 2023-12-01T15:43:55.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 -- 172.21.15.63:0/1607278901 shutdown_connections 2023-12-01T15:43:55.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff900065ad0 0x7ff900067f90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff91c12e670 0x7ff91c132480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff91c141970 0x7ff91c12e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 --2- 172.21.15.63:0/1607278901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff91c13af50 0x7ff91c139a50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 -- 172.21.15.63:0/1607278901 >> 172.21.15.63:0/1607278901 conn(0x7ff91c0a8bd0 msgr2=0x7ff91c098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 -- 172.21.15.63:0/1607278901 shutdown_connections 2023-12-01T15:43:55.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.308+0000 7ff922e6b700 1 -- 172.21.15.63:0/1607278901 wait complete. 2023-12-01T15:43:55.325 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-01T15:43:55.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-01T15:43:55.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-01T15:43:55.327 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-01T15:43:55.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423bfff700 1 Processor -- start 2023-12-01T15:43:55.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423bfff700 1 -- start start 2023-12-01T15:43:55.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423bfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f423c1342a0 0x7f423c134680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f423c13a700 0x7f423c13ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f423c13b060 0x7f423c141a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c06c6d0 con 0x7f423c13b060 2023-12-01T15:43:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423bfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c06d7b0 con 0x7f423c1342a0 2023-12-01T15:43:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c06d590 con 0x7f423c13a700 2023-12-01T15:43:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f423c13b060 0x7f423c141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f423c13b060 0x7f423c141a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46806/0 (socket says 172.21.15.63:46806) 2023-12-01T15:43:55.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423b7fe700 1 -- 172.21.15.63:0/2851036873 learned_addr learned my addr 172.21.15.63:0/2851036873 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:55.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf51d9f700 1 Processor -- start 2023-12-01T15:43:55.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423affd700 1 --2- 172.21.15.63:0/2851036873 >> v2:172.21.15.66:3300/0 conn(0x7f423c1342a0 0x7f423c134680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423a7fc700 1 --2- 172.21.15.63:0/2851036873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f423c13a700 0x7f423c13ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf51d9f700 1 -- start start 2023-12-01T15:43:55.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423b7fe700 1 -- 172.21.15.63:0/2851036873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f423c13a700 msgr2=0x7f423c13ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:55.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423b7fe700 1 --2- 172.21.15.63:0/2851036873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f423c13a700 0x7f423c13ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423b7fe700 1 -- 172.21.15.63:0/2851036873 >> v2:172.21.15.66:3300/0 conn(0x7f423c1342a0 msgr2=0x7f423c134680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:55.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423b7fe700 1 --2- 172.21.15.63:0/2851036873 >> v2:172.21.15.66:3300/0 conn(0x7f423c1342a0 0x7f423c134680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423b7fe700 1 -- 172.21.15.63:0/2851036873 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c06c410 con 0x7f423c13b060 2023-12-01T15:43:55.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423b7fe700 1 --2- 172.21.15.63:0/2851036873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f423c13b060 0x7f423c141a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f423c0a7060 tx=0x7f4230009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d1e165290533a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f4239ffb700 1 -- 172.21.15.63:0/2851036873 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230011830 con 0x7f423c13b060 2023-12-01T15:43:55.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f4239ffb700 1 -- 172.21.15.63:0/2851036873 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4230011990 con 0x7f423c13b060 2023-12-01T15:43:55.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f4239ffb700 1 -- 172.21.15.63:0/2851036873 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230011d40 con 0x7f423c13b060 2023-12-01T15:43:55.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf51d9f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdf4c1371b0 0x7fdf4c13cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf51d9f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdf4c1375f0 0x7fdf4c072e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf51d9f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4c0a55c0 con 0x7fdf4c133ee0 2023-12-01T15:43:55.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf51d9f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4c0a4e40 con 0x7fdf4c1375f0 2023-12-01T15:43:55.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf51d9f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c099fc0 con 0x7fdf4c1371b0 2023-12-01T15:43:55.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf50d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdf4c133ee0 0x7fdf4c136aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42010/0 (socket says 172.21.15.63:42010) 2023-12-01T15:43:55.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf50d9d700 1 -- 172.21.15.63:0/759904641 learned_addr learned my addr 172.21.15.63:0/759904641 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:55.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf5159e700 1 --2- 172.21.15.63:0/759904641 >> v2:172.21.15.63:3300/0 conn(0x7fdf4c1375f0 0x7fdf4c072e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf4bfff700 1 --2- 172.21.15.63:0/759904641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdf4c1371b0 0x7fdf4c13cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423bfff700 1 -- 172.21.15.63:0/2851036873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f423c13b060 msgr2=0x7f423c141a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7f423bfff700 1 --2- 172.21.15.63:0/2851036873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f423c13b060 0x7f423c141a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f423c0a7060 tx=0x7f4230009c20 comp rx=0 tx=0).stop 2023-12-01T15:43:55.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf5159e700 1 -- 172.21.15.63:0/759904641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdf4c1371b0 msgr2=0x7fdf4c13cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:55.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf5159e700 1 --2- 172.21.15.63:0/759904641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdf4c1371b0 0x7fdf4c13cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf5159e700 1 -- 172.21.15.63:0/759904641 >> v1:172.21.15.63:6789/0 conn(0x7fdf4c133ee0 legacy=0x7fdf4c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.424+0000 7fdf5159e700 1 -- 172.21.15.63:0/759904641 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c06cbf0 con 0x7fdf4c1375f0 2023-12-01T15:43:55.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 -- 172.21.15.63:0/2851036873 shutdown_connections 2023-12-01T15:43:55.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 --2- 172.21.15.63:0/2851036873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f423c13a700 0x7f423c13ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 --2- 172.21.15.63:0/2851036873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f423c13b060 0x7f423c141a30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 --2- 172.21.15.63:0/2851036873 >> v2:172.21.15.66:3300/0 conn(0x7f423c1342a0 0x7f423c134680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 -- 172.21.15.63:0/2851036873 >> 172.21.15.63:0/2851036873 conn(0x7f423c0a7730 msgr2=0x7f423c0aa600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 -- 172.21.15.63:0/2851036873 shutdown_connections 2023-12-01T15:43:55.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf5159e700 1 --2- 172.21.15.63:0/759904641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf4c1375f0 0x7fdf4c072e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009850 tx=0x7fdf44009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed23a874cb865634 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 -- 172.21.15.63:0/2851036873 wait complete. 2023-12-01T15:43:55.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf4b7fe700 1 -- 172.21.15.63:0/759904641 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44011830 con 0x7fdf4c1375f0 2023-12-01T15:43:55.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf4b7fe700 1 -- 172.21.15.63:0/759904641 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf44011990 con 0x7fdf4c1375f0 2023-12-01T15:43:55.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf4b7fe700 1 -- 172.21.15.63:0/759904641 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44011d40 con 0x7fdf4c1375f0 2023-12-01T15:43:55.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf51d9f700 1 -- 172.21.15.63:0/759904641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf4c1375f0 msgr2=0x7fdf4c072e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf51d9f700 1 --2- 172.21.15.63:0/759904641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf4c1375f0 0x7fdf4c072e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009850 tx=0x7fdf44009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:55.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf51d9f700 1 -- 172.21.15.63:0/759904641 shutdown_connections 2023-12-01T15:43:55.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf51d9f700 1 --2- 172.21.15.63:0/759904641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf4c1375f0 0x7fdf4c072e60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf51d9f700 1 --2- 172.21.15.63:0/759904641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdf4c1371b0 0x7fdf4c13cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf51d9f700 1 -- 172.21.15.63:0/759904641 >> 172.21.15.63:0/759904641 conn(0x7fdf4c0a58a0 msgr2=0x7fdf4c0a5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 Processor -- start 2023-12-01T15:43:55.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf51d9f700 1 -- 172.21.15.63:0/759904641 shutdown_connections 2023-12-01T15:43:55.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 -- start start 2023-12-01T15:43:55.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf51d9f700 1 -- 172.21.15.63:0/759904641 wait complete. 2023-12-01T15:43:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f423c1342a0 0x7f423c1cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f423c13a700 0x7f423c1cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f423c13b060 0x7f423c1cf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1ccb90 con 0x7f423c13b060 2023-12-01T15:43:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c09ce70 con 0x7f423c1342a0 2023-12-01T15:43:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c09c8d0 con 0x7f423c13a700 2023-12-01T15:43:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f423c13b060 0x7f423c1cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f423c13b060 0x7f423c1cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46830/0 (socket says 172.21.15.63:46830) 2023-12-01T15:43:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423b7fe700 1 -- 172.21.15.63:0/1602600612 learned_addr learned my addr 172.21.15.63:0/1602600612 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423affd700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f423c1342a0 0x7f423c1cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423a7fc700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f423c13a700 0x7f423c1cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423b7fe700 1 -- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f423c13a700 msgr2=0x7f423c1cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423b7fe700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f423c13a700 0x7f423c1cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423b7fe700 1 -- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f423c1342a0 msgr2=0x7f423c1cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423b7fe700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f423c1342a0 0x7f423c1cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423b7fe700 1 -- 172.21.15.63:0/1602600612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4230009570 con 0x7f423c13b060 2023-12-01T15:43:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423affd700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f423c1342a0 0x7f423c1cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:55.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf51d9f700 1 Processor -- start 2023-12-01T15:43:55.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7fdf51d9f700 1 -- start start 2023-12-01T15:43:55.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423b7fe700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f423c13b060 0x7f423c1cf110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f423c0aaf40 tx=0x7f4230004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f42237fe700 1 -- 172.21.15.63:0/1602600612 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230004590 con 0x7f423c13b060 2023-12-01T15:43:55.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 -- 172.21.15.63:0/1602600612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c09c650 con 0x7f423c13b060 2023-12-01T15:43:55.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f42237fe700 1 -- 172.21.15.63:0/1602600612 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423001e070 con 0x7f423c13b060 2023-12-01T15:43:55.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f423bfff700 1 -- 172.21.15.63:0/1602600612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c138080 con 0x7f423c13b060 2023-12-01T15:43:55.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.428+0000 7f42237fe700 1 -- 172.21.15.63:0/1602600612 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230003900 con 0x7f423c13b060 2023-12-01T15:43:55.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf51d9f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdf4c133ee0 0x7fdf4c135ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf51d9f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf4c1371b0 0x7fdf4c136020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf51d9f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf4c1375f0 0x7fdf4c136560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf51d9f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c136fb0 con 0x7fdf4c1375f0 2023-12-01T15:43:55.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf51d9f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c06f810 con 0x7fdf4c1371b0 2023-12-01T15:43:55.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf51d9f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c12a970 con 0x7fdf4c133ee0 2023-12-01T15:43:55.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf5159e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf4c1375f0 0x7fdf4c136560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf5159e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf4c1375f0 0x7fdf4c136560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46834/0 (socket says 172.21.15.63:46834) 2023-12-01T15:43:55.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf5159e700 1 -- 172.21.15.63:0/3364407062 learned_addr learned my addr 172.21.15.63:0/3364407062 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:55.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf50d9d700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdf4c133ee0 0x7fdf4c135ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf4bfff700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf4c1371b0 0x7fdf4c136020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf50d9d700 1 -- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf4c1371b0 msgr2=0x7fdf4c136020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf50d9d700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf4c1371b0 0x7fdf4c136020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf50d9d700 1 -- 172.21.15.63:0/3364407062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf4c1375f0 msgr2=0x7fdf4c136560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf50d9d700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf4c1375f0 0x7fdf4c136560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf50d9d700 1 -- 172.21.15.63:0/3364407062 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf440094b0 con 0x7fdf4c133ee0 2023-12-01T15:43:55.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7f423bfff700 1 -- 172.21.15.63:0/1602600612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f421c000f10 con 0x7f423c13b060 2023-12-01T15:43:55.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf50d9d700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdf4c133ee0 0x7fdf4c135ae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00cae0 tx=0x7fdf3c00cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7f42237fe700 1 -- 172.21.15.63:0/1602600612 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4230003a60 con 0x7f423c13b060 2023-12-01T15:43:55.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf497fa700 1 -- 172.21.15.63:0/3364407062 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c007480 con 0x7fdf4c133ee0 2023-12-01T15:43:55.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf51d9f700 1 -- 172.21.15.63:0/3364407062 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4c124b40 con 0x7fdf4c133ee0 2023-12-01T15:43:55.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf51d9f700 1 -- 172.21.15.63:0/3364407062 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4c0a4180 con 0x7fdf4c133ee0 2023-12-01T15:43:55.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7f42237fe700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4228065b00 0x7f4228067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7f42237fe700 1 -- 172.21.15.63:0/1602600612 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f4230020070 con 0x7f423c13b060 2023-12-01T15:43:55.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7f42237fe700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] conn(0x7f422806d670 0x7f422806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7f423affd700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4228065b00 0x7f4228067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7f42237fe700 1 -- 172.21.15.63:0/1602600612 --> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4228070180 con 0x7f422806d670 2023-12-01T15:43:55.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7f42237fe700 1 -- 172.21.15.63:0/1602600612 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4230086490 con 0x7f423c13b060 2023-12-01T15:43:55.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf497fa700 1 -- 172.21.15.63:0/3364407062 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c0075e0 con 0x7fdf4c133ee0 2023-12-01T15:43:55.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf497fa700 1 -- 172.21.15.63:0/3364407062 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c007950 con 0x7fdf4c133ee0 2023-12-01T15:43:55.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7fdf51d9f700 1 -- 172.21.15.63:0/3364407062 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf4c0a4a60 con 0x7fdf4c133ee0 2023-12-01T15:43:55.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7f423a7fc700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] conn(0x7f422806d670 0x7f422806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7f423affd700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4228065b00 0x7f4228067fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f42340074c0 tx=0x7f423400d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.432+0000 7f423a7fc700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] conn(0x7f422806d670 0x7f422806fab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fdf497fa700 1 -- 172.21.15.63:0/3364407062 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdf3c01b3b0 con 0x7fdf4c133ee0 2023-12-01T15:43:55.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8ecdba700 1 Processor -- start 2023-12-01T15:43:55.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8ecdba700 1 -- start start 2023-12-01T15:43:55.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7f42237fe700 1 -- 172.21.15.63:0/1602600612 <== osd.2 v2:172.21.15.66:6808/29906 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4228070180 con 0x7f422806d670 2023-12-01T15:43:55.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fdf497fa700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdf38065c20 0x7fdf380680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fdf497fa700 1 -- 172.21.15.63:0/3364407062 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fdf3c082c30 con 0x7fdf4c133ee0 2023-12-01T15:43:55.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8ecdba700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e81386f0 0x7fc8e8138ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fdf4bfff700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdf38065c20 0x7fdf380680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fdf497fa700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] conn(0x7fdf3806d790 0x7fdf3806fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fdf497fa700 1 -- 172.21.15.63:0/3364407062 --> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf380702a0 con 0x7fdf3806d790 2023-12-01T15:43:55.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8ecdba700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8e8132550 0x7fc8e8140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8ecdba700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e80a3710 con 0x7fc8e8139010 2023-12-01T15:43:55.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8ecdba700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e80a39b0 con 0x7fc8e8132550 2023-12-01T15:43:55.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8ecdba700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80a3ee0 con 0x7fc8e81386f0 2023-12-01T15:43:55.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8e659c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e81386f0 0x7fc8e8138ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fdf5159e700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] conn(0x7fdf3806d790 0x7fdf3806fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8e5d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc8e8139010 0x7fc8e8131e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42026/0 (socket says 172.21.15.63:42026) 2023-12-01T15:43:55.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8e5d9b700 1 -- 172.21.15.63:0/1075893104 learned_addr learned my addr 172.21.15.63:0/1075893104 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:55.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fdf497fa700 1 -- 172.21.15.63:0/3364407062 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf3c083080 con 0x7fdf4c133ee0 2023-12-01T15:43:55.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8e6d9d700 1 --2- 172.21.15.63:0/1075893104 >> v2:172.21.15.63:3300/0 conn(0x7fc8e8132550 0x7fc8e8140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8e659c700 1 -- 172.21.15.63:0/1075893104 >> v2:172.21.15.63:3300/0 conn(0x7fc8e8132550 msgr2=0x7fc8e8140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:55.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8e659c700 1 --2- 172.21.15.63:0/1075893104 >> v2:172.21.15.63:3300/0 conn(0x7fc8e8132550 0x7fc8e8140cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8e659c700 1 -- 172.21.15.63:0/1075893104 >> v1:172.21.15.63:6789/0 conn(0x7fc8e8139010 legacy=0x7fc8e8131e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8e659c700 1 -- 172.21.15.63:0/1075893104 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80a3470 con 0x7fc8e81386f0 2023-12-01T15:43:55.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fdf5159e700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] conn(0x7fdf3806d790 0x7fdf3806fbd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8e6d9d700 1 --2- 172.21.15.63:0/1075893104 >> v2:172.21.15.63:3300/0 conn(0x7fc8e8132550 0x7fc8e8140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:55.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.436+0000 7fc8e659c700 1 --2- 172.21.15.63:0/1075893104 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e81386f0 0x7fc8e8138ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009850 tx=0x7fc8d8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84a17e86fa6ffb9d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e559a700 1 -- 172.21.15.63:0/1075893104 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8011830 con 0x7fc8e81386f0 2023-12-01T15:43:55.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fdf4bfff700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdf38065c20 0x7fdf380680e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0a8660 tx=0x7fdf34009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e559a700 1 -- 172.21.15.63:0/1075893104 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d8011990 con 0x7fc8e81386f0 2023-12-01T15:43:55.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e559a700 1 -- 172.21.15.63:0/1075893104 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8011d40 con 0x7fc8e81386f0 2023-12-01T15:43:55.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fdf497fa700 1 -- 172.21.15.63:0/3364407062 <== osd.1 v2:172.21.15.63:6800/29723 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdf380702a0 con 0x7fdf3806d790 2023-12-01T15:43:55.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 -- 172.21.15.63:0/1075893104 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e81386f0 msgr2=0x7fc8e8138ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 --2- 172.21.15.63:0/1075893104 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e81386f0 0x7fc8e8138ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009850 tx=0x7fc8d8009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:55.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 -- 172.21.15.63:0/1075893104 shutdown_connections 2023-12-01T15:43:55.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 --2- 172.21.15.63:0/1075893104 >> v2:172.21.15.63:3300/0 conn(0x7fc8e8132550 0x7fc8e8140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 --2- 172.21.15.63:0/1075893104 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e81386f0 0x7fc8e8138ad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 -- 172.21.15.63:0/1075893104 >> 172.21.15.63:0/1075893104 conn(0x7fc8e8073490 msgr2=0x7fc8e80a8660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 -- 172.21.15.63:0/1075893104 shutdown_connections 2023-12-01T15:43:55.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 -- 172.21.15.63:0/1075893104 wait complete. 2023-12-01T15:43:55.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 Processor -- start 2023-12-01T15:43:55.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 -- start start 2023-12-01T15:43:55.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e8132550 0x7fc8e8128db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e81386f0 0x7fc8e81292f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e8139010 0x7fc8e8129830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e809dcd0 con 0x7fc8e8132550 2023-12-01T15:43:55.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8072170 con 0x7fc8e8139010 2023-12-01T15:43:55.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8ecdba700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8071d30 con 0x7fc8e81386f0 2023-12-01T15:43:55.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e8132550 0x7fc8e8128db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e8132550 0x7fc8e8128db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46838/0 (socket says 172.21.15.63:46838) 2023-12-01T15:43:55.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e659c700 1 -- 172.21.15.63:0/4164574612 learned_addr learned my addr 172.21.15.63:0/4164574612 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:55.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e6d9d700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e8139010 0x7fc8e8129830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e5d9b700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e81386f0 0x7fc8e81292f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e659c700 1 -- 172.21.15.63:0/4164574612 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e81386f0 msgr2=0x7fc8e81292f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e659c700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e81386f0 0x7fc8e81292f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e659c700 1 -- 172.21.15.63:0/4164574612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e8139010 msgr2=0x7fc8e8129830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e659c700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e8139010 0x7fc8e8129830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e659c700 1 -- 172.21.15.63:0/4164574612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e0009a70 con 0x7fc8e8132550 2023-12-01T15:43:55.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.440+0000 7fc8e659c700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e8132550 0x7fc8e8128db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80090b0 tx=0x7fc8d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.444+0000 7fc8d6ffd700 1 -- 172.21.15.63:0/4164574612 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8004570 con 0x7fc8e8132550 2023-12-01T15:43:55.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.444+0000 7fc8d6ffd700 1 -- 172.21.15.63:0/4164574612 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d801f070 con 0x7fc8e8132550 2023-12-01T15:43:55.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.444+0000 7fc8ecdba700 1 -- 172.21.15.63:0/4164574612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d80094b0 con 0x7fc8e8132550 2023-12-01T15:43:55.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.444+0000 7fc8d6ffd700 1 -- 172.21.15.63:0/4164574612 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8003900 con 0x7fc8e8132550 2023-12-01T15:43:55.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.444+0000 7fc8ecdba700 1 -- 172.21.15.63:0/4164574612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e806d3f0 con 0x7fc8e8132550 2023-12-01T15:43:55.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.444+0000 7fc8d6ffd700 1 -- 172.21.15.63:0/4164574612 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc8d8021030 con 0x7fc8e8132550 2023-12-01T15:43:55.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.444+0000 7fc8d6ffd700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc8d0065c60 0x7fc8d0068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.444+0000 7fc8d6ffd700 1 -- 172.21.15.63:0/4164574612 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fc8d8083e00 con 0x7fc8e8132550 2023-12-01T15:43:55.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.444+0000 7fc8e5d9b700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc8d0065c60 0x7fc8d0068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7fc8e5d9b700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc8d0065c60 0x7fc8d0068120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc8e809ef60 tx=0x7fc8dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 Processor -- start 2023-12-01T15:43:55.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 -- start start 2023-12-01T15:43:55.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f322806d120 0x7f322806d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3228099c50 0x7f3228137100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322806cc60 con 0x7f322806f9c0 2023-12-01T15:43:55.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322806da40 con 0x7f322806d120 2023-12-01T15:43:55.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322806cf00 con 0x7f3228099c50 2023-12-01T15:43:55.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f3225d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f322806f9c0 0x7f32281369f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42030/0 (socket says 172.21.15.63:42030) 2023-12-01T15:43:55.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f3225d9b700 1 -- 172.21.15.63:0/3264349397 learned_addr learned my addr 172.21.15.63:0/3264349397 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:55.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322659c700 1 --2- 172.21.15.63:0/3264349397 >> v2:172.21.15.63:3300/0 conn(0x7f322806d120 0x7f322806d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f3226d9d700 1 --2- 172.21.15.63:0/3264349397 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3228099c50 0x7f3228137100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322559a700 1 -- 172.21.15.63:0/3264349397 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526410085 0 0) 0x7f322806cc60 con 0x7f322806f9c0 2023-12-01T15:43:55.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322559a700 1 -- 172.21.15.63:0/3264349397 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32100035d0 con 0x7f322806f9c0 2023-12-01T15:43:55.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322659c700 1 -- 172.21.15.63:0/3264349397 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3228099c50 msgr2=0x7f3228137100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:55.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322659c700 1 --2- 172.21.15.63:0/3264349397 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3228099c50 0x7f3228137100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322659c700 1 -- 172.21.15.63:0/3264349397 >> v1:172.21.15.63:6789/0 conn(0x7f322806f9c0 legacy=0x7f32281369f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322659c700 1 -- 172.21.15.63:0/3264349397 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228070290 con 0x7f322806d120 2023-12-01T15:43:55.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f3226d9d700 1 --2- 172.21.15.63:0/3264349397 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3228099c50 0x7f3228137100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:55.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322659c700 1 --2- 172.21.15.63:0/3264349397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f322806d120 0x7f322806d500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3218009850 tx=0x7f3218009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfbec8734dc267d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322559a700 1 -- 172.21.15.63:0/3264349397 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218004230 con 0x7f322806d120 2023-12-01T15:43:55.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322559a700 1 -- 172.21.15.63:0/3264349397 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3218004390 con 0x7f322806d120 2023-12-01T15:43:55.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322559a700 1 -- 172.21.15.63:0/3264349397 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32180036c0 con 0x7f322806d120 2023-12-01T15:43:55.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 -- 172.21.15.63:0/3264349397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f322806d120 msgr2=0x7f322806d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 --2- 172.21.15.63:0/3264349397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f322806d120 0x7f322806d500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3218009850 tx=0x7f3218009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:55.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 -- 172.21.15.63:0/3264349397 shutdown_connections 2023-12-01T15:43:55.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 --2- 172.21.15.63:0/3264349397 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3228099c50 0x7f3228137100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 --2- 172.21.15.63:0/3264349397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f322806d120 0x7f322806d500 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 -- 172.21.15.63:0/3264349397 >> 172.21.15.63:0/3264349397 conn(0x7f32280a85a0 msgr2=0x7f32280a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 -- 172.21.15.63:0/3264349397 shutdown_connections 2023-12-01T15:43:55.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.448+0000 7f322759e700 1 -- 172.21.15.63:0/3264349397 wait complete. 2023-12-01T15:43:55.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7fc8ecdba700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] conn(0x7fc8e8060ba0 0x7fc8e8060f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7fc8ecdba700 1 -- 172.21.15.63:0/4164574612 --> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8e809a0c0 con 0x7fc8e8060ba0 2023-12-01T15:43:55.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f322759e700 1 Processor -- start 2023-12-01T15:43:55.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7fc8e6d9d700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] conn(0x7fc8e8060ba0 0x7fc8e8060f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f322759e700 1 -- start start 2023-12-01T15:43:55.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7fc8e6d9d700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] conn(0x7fc8e8060ba0 0x7fc8e8060f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f322759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f322806d120 0x7f3228140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f322759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f322806f9c0 0x7f3228140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f322759e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3228099c50 0x7f32281413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f322759e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322812f000 con 0x7f3228099c50 2023-12-01T15:43:55.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f322759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322806d500 con 0x7f322806f9c0 2023-12-01T15:43:55.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f322759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3228130740 con 0x7f322806d120 2023-12-01T15:43:55.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3226d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3228099c50 0x7f32281413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3226d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3228099c50 0x7f32281413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46860/0 (socket says 172.21.15.63:46860) 2023-12-01T15:43:55.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3226d9d700 1 -- 172.21.15.63:0/3458589991 learned_addr learned my addr 172.21.15.63:0/3458589991 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:55.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f322659c700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f322806d120 0x7f3228140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3225d9b700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f322806f9c0 0x7f3228140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3226d9d700 1 -- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f322806d120 msgr2=0x7f3228140600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3226d9d700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f322806d120 0x7f3228140600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3226d9d700 1 -- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f322806f9c0 msgr2=0x7f3228140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3226d9d700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f322806f9c0 0x7f3228140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3226d9d700 1 -- 172.21.15.63:0/3458589991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32180094b0 con 0x7f3228099c50 2023-12-01T15:43:55.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3225d9b700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f322806f9c0 0x7f3228140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:55.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7fc8d6ffd700 1 -- 172.21.15.63:0/4164574612 <== osd.0 v2:172.21.15.63:6808/29724 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc8e000f040 con 0x7fc8e8060ba0 2023-12-01T15:43:55.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3226d9d700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3228099c50 0x7f32281413d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3220007df0 tx=0x7f322000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3216ffd700 1 -- 172.21.15.63:0/3458589991 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322000ddd0 con 0x7f3228099c50 2023-12-01T15:43:55.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3216ffd700 1 -- 172.21.15.63:0/3458589991 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322000f040 con 0x7f3228099c50 2023-12-01T15:43:55.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f322759e700 1 -- 172.21.15.63:0/3458589991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322812ed40 con 0x7f3228099c50 2023-12-01T15:43:55.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f3216ffd700 1 -- 172.21.15.63:0/3458589991 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220003c80 con 0x7f3228099c50 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.452+0000 7f322759e700 1 -- 172.21.15.63:0/3458589991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3228130300 con 0x7f3228099c50 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.456+0000 7f322759e700 1 -- 172.21.15.63:0/3458589991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3228070570 con 0x7f3228099c50 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.456+0000 7f3216ffd700 1 -- 172.21.15.63:0/3458589991 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3220004030 con 0x7f3228099c50 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.456+0000 7f3216ffd700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3208065ad0 0x7f3208067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.456+0000 7f3216ffd700 1 -- 172.21.15.63:0/3458589991 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f3220082c30 con 0x7f3228099c50 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.456+0000 7f3216ffd700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] conn(0x7f320806d640 0x7f320806fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.456+0000 7f3216ffd700 1 -- 172.21.15.63:0/3458589991 --> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3208070150 con 0x7f320806d640 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.456+0000 7f3216ffd700 1 -- 172.21.15.63:0/3458589991 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3220085270 con 0x7f3228099c50 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.456+0000 7f322659c700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3208065ad0 0x7f3208067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.456+0000 7f3225d9b700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] conn(0x7f320806d640 0x7f320806fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.456+0000 7f322659c700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3208065ad0 0x7f3208067f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3218009850 tx=0x7f3218008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.456+0000 7f3225d9b700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] conn(0x7f320806d640 0x7f320806fa80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.460+0000 7f3216ffd700 1 -- 172.21.15.63:0/3458589991 <== osd.3 v2:172.21.15.66:6800/29907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3208070150 con 0x7f320806d640 2023-12-01T15:43:55.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.464+0000 7f423bfff700 1 -- 172.21.15.63:0/1602600612 --> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f421c002c00 con 0x7f422806d670 2023-12-01T15:43:55.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f42237fe700 1 -- 172.21.15.63:0/1602600612 <== osd.2 v2:172.21.15.66:6808/29906 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f421c002c00 con 0x7f422806d670 2023-12-01T15:43:55.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f423bfff700 1 -- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] conn(0x7f422806d670 msgr2=0x7f422806fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f423bfff700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] conn(0x7f422806d670 0x7f422806fab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf51d9f700 1 -- 172.21.15.63:0/3364407062 --> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf4c133a80 con 0x7fdf3806d790 2023-12-01T15:43:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f423bfff700 1 -- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4228065b00 msgr2=0x7f4228067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f423bfff700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4228065b00 0x7f4228067fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f42340074c0 tx=0x7f423400d040 comp rx=0 tx=0).stop 2023-12-01T15:43:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f423bfff700 1 -- 172.21.15.63:0/1602600612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f423c13b060 msgr2=0x7f423c1cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f423bfff700 1 --2- 172.21.15.63:0/1602600612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f423c13b060 0x7f423c1cf110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f423c0aaf40 tx=0x7f4230004770 comp rx=0 tx=0).stop 2023-12-01T15:43:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f423b7fe700 1 -- 172.21.15.63:0/1602600612 reap_dead start 2023-12-01T15:43:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f423bfff700 1 -- 172.21.15.63:0/1602600612 shutdown_connections 2023-12-01T15:43:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f423bfff700 1 -- 172.21.15.63:0/1602600612 >> 172.21.15.63:0/1602600612 conn(0x7f423c0a7730 msgr2=0x7f423c0a4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f423bfff700 1 -- 172.21.15.63:0/1602600612 shutdown_connections 2023-12-01T15:43:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7f423bfff700 1 -- 172.21.15.63:0/1602600612 wait complete. 2023-12-01T15:43:55.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf497fa700 1 -- 172.21.15.63:0/3364407062 <== osd.1 v2:172.21.15.63:6800/29723 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf44021040 con 0x7fdf3806d790 2023-12-01T15:43:55.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fc8ecdba700 1 -- 172.21.15.63:0/4164574612 --> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc8e80a3c00 con 0x7fc8e8060ba0 2023-12-01T15:43:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf51d9f700 1 -- 172.21.15.63:0/3364407062 >> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] conn(0x7fdf3806d790 msgr2=0x7fdf3806fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf51d9f700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] conn(0x7fdf3806d790 0x7fdf3806fbd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf51d9f700 1 -- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdf38065c20 msgr2=0x7fdf380680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf51d9f700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdf38065c20 0x7fdf380680e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0a8660 tx=0x7fdf34009240 comp rx=0 tx=0).stop 2023-12-01T15:43:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf51d9f700 1 -- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdf4c133ee0 msgr2=0x7fdf4c135ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf51d9f700 1 --2- 172.21.15.63:0/3364407062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdf4c133ee0 0x7fdf4c135ae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00cae0 tx=0x7fdf3c00cb10 comp rx=0 tx=0).stop 2023-12-01T15:43:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf5159e700 1 -- 172.21.15.63:0/3364407062 reap_dead start 2023-12-01T15:43:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf51d9f700 1 -- 172.21.15.63:0/3364407062 shutdown_connections 2023-12-01T15:43:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf51d9f700 1 -- 172.21.15.63:0/3364407062 >> 172.21.15.63:0/3364407062 conn(0x7fdf4c0a58a0 msgr2=0x7fdf4c12abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf51d9f700 1 -- 172.21.15.63:0/3364407062 shutdown_connections 2023-12-01T15:43:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fdf51d9f700 1 -- 172.21.15.63:0/3364407062 wait complete. 2023-12-01T15:43:55.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fc8d6ffd700 1 -- 172.21.15.63:0/4164574612 <== osd.0 v2:172.21.15.63:6808/29724 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc8e00075f0 con 0x7fc8e8060ba0 2023-12-01T15:43:55.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fc8ecdba700 1 -- 172.21.15.63:0/4164574612 >> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] conn(0x7fc8e8060ba0 msgr2=0x7fc8e8060f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fc8ecdba700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] conn(0x7fc8e8060ba0 0x7fc8e8060f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fc8ecdba700 1 -- 172.21.15.63:0/4164574612 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc8d0065c60 msgr2=0x7fc8d0068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fc8ecdba700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc8d0065c60 0x7fc8d0068120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc8e809ef60 tx=0x7fc8dc009040 comp rx=0 tx=0).stop 2023-12-01T15:43:55.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fc8ecdba700 1 -- 172.21.15.63:0/4164574612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e8132550 msgr2=0x7fc8e8128db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.468+0000 7fc8ecdba700 1 --2- 172.21.15.63:0/4164574612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e8132550 0x7fc8e8128db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80090b0 tx=0x7fc8d8004770 comp rx=0 tx=0).stop 2023-12-01T15:43:55.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.472+0000 7fc8e6d9d700 1 -- 172.21.15.63:0/4164574612 reap_dead start 2023-12-01T15:43:55.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.476+0000 7fc8ecdba700 1 -- 172.21.15.63:0/4164574612 shutdown_connections 2023-12-01T15:43:55.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.476+0000 7fc8ecdba700 1 -- 172.21.15.63:0/4164574612 >> 172.21.15.63:0/4164574612 conn(0x7fc8e8073490 msgr2=0x7fc8e8129e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.476+0000 7fc8ecdba700 1 -- 172.21.15.63:0/4164574612 shutdown_connections 2023-12-01T15:43:55.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.476+0000 7fc8ecdba700 1 -- 172.21.15.63:0/4164574612 wait complete. 2023-12-01T15:43:55.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f322759e700 1 -- 172.21.15.63:0/3458589991 --> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f322812f240 con 0x7f320806d640 2023-12-01T15:43:55.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f3216ffd700 1 -- 172.21.15.63:0/3458589991 <== osd.3 v2:172.21.15.66:6800/29907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f321c004890 con 0x7f320806d640 2023-12-01T15:43:55.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f322759e700 1 -- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] conn(0x7f320806d640 msgr2=0x7f320806fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f322759e700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] conn(0x7f320806d640 0x7f320806fa80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f322759e700 1 -- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3208065ad0 msgr2=0x7f3208067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f322759e700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3208065ad0 0x7f3208067f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3218009850 tx=0x7f3218008030 comp rx=0 tx=0).stop 2023-12-01T15:43:55.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f322759e700 1 -- 172.21.15.63:0/3458589991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3228099c50 msgr2=0x7f32281413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f322759e700 1 --2- 172.21.15.63:0/3458589991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3228099c50 0x7f32281413d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3220007df0 tx=0x7f322000d3b0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f3226d9d700 1 -- 172.21.15.63:0/3458589991 reap_dead start 2023-12-01T15:43:55.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f322759e700 1 -- 172.21.15.63:0/3458589991 shutdown_connections 2023-12-01T15:43:55.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f322759e700 1 -- 172.21.15.63:0/3458589991 >> 172.21.15.63:0/3458589991 conn(0x7f32280a85a0 msgr2=0x7f3228136800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f322759e700 1 -- 172.21.15.63:0/3458589991 shutdown_connections 2023-12-01T15:43:55.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.480+0000 7f322759e700 1 -- 172.21.15.63:0/3458589991 wait complete. 2023-12-01T15:43:55.492 INFO:teuthology.orchestra.run.smithi063.stdout:38654705672 2023-12-01T15:43:55.492 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-01T15:43:55.493 INFO:teuthology.orchestra.run.smithi063.stdout:38654705673 2023-12-01T15:43:55.493 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-01T15:43:55.494 INFO:teuthology.orchestra.run.smithi063.stdout:38654705672 2023-12-01T15:43:55.495 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-01T15:43:55.500 INFO:teuthology.orchestra.run.smithi063.stdout:38654705672 2023-12-01T15:43:55.500 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-01T15:43:55.590 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.584+0000 7fc8e972d700 1 Processor -- start 2023-12-01T15:43:55.590 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.584+0000 7fc8e972d700 1 -- start start 2023-12-01T15:43:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc8e4135760 0x7fc8e413d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8e4135bf0 0x7fc8e413fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e40a08e0 con 0x7fc8e4136a10 2023-12-01T15:43:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e40a14b0 con 0x7fc8e4135bf0 2023-12-01T15:43:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e40a11f0 con 0x7fc8e4135760 2023-12-01T15:43:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e8f2c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8e4135bf0 0x7fc8e413fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e8f2c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8e4135bf0 0x7fc8e413fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46870/0 (socket says 172.21.15.63:46870) 2023-12-01T15:43:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e8f2c700 1 -- 172.21.15.63:0/1385602587 learned_addr learned my addr 172.21.15.63:0/1385602587 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8db7fe700 1 --2- 172.21.15.63:0/1385602587 >> v2:172.21.15.66:3300/0 conn(0x7fc8e4135760 0x7fc8e413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e8f2c700 1 -- 172.21.15.63:0/1385602587 >> v2:172.21.15.66:3300/0 conn(0x7fc8e4135760 msgr2=0x7fc8e413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e8f2c700 1 --2- 172.21.15.63:0/1385602587 >> v2:172.21.15.66:3300/0 conn(0x7fc8e4135760 0x7fc8e413d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e8f2c700 1 -- 172.21.15.63:0/1385602587 >> v1:172.21.15.66:6789/0 conn(0x7fc8e4136a10 legacy=0x7fc8e4135050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e8f2c700 1 -- 172.21.15.63:0/1385602587 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4136170 con 0x7fc8e4135bf0 2023-12-01T15:43:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e8f2c700 1 --2- 172.21.15.63:0/1385602587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e4135bf0 0x7fc8e413fa60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40a6bd0 tx=0x7fc8dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45afcd351b067e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e37fe700 1 -- 172.21.15.63:0/1385602587 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc00e070 con 0x7fc8e4135bf0 2023-12-01T15:43:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e37fe700 1 -- 172.21.15.63:0/1385602587 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc00b9c0 con 0x7fc8e4135bf0 2023-12-01T15:43:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e37fe700 1 -- 172.21.15.63:0/1385602587 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc00bd70 con 0x7fc8e4135bf0 2023-12-01T15:43:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 -- 172.21.15.63:0/1385602587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e4135bf0 msgr2=0x7fc8e413fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 --2- 172.21.15.63:0/1385602587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e4135bf0 0x7fc8e413fa60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40a6bd0 tx=0x7fc8dc00b330 comp rx=0 tx=0).stop 2023-12-01T15:43:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 -- 172.21.15.63:0/1385602587 shutdown_connections 2023-12-01T15:43:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 --2- 172.21.15.63:0/1385602587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e4135bf0 0x7fc8e413fa60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 --2- 172.21.15.63:0/1385602587 >> v2:172.21.15.66:3300/0 conn(0x7fc8e4135760 0x7fc8e413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 -- 172.21.15.63:0/1385602587 >> 172.21.15.63:0/1385602587 conn(0x7fc8e40a9a90 msgr2=0x7fc8e40a5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 -- 172.21.15.63:0/1385602587 shutdown_connections 2023-12-01T15:43:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 -- 172.21.15.63:0/1385602587 wait complete. 2023-12-01T15:43:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 Processor -- start 2023-12-01T15:43:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.588+0000 7fc8e972d700 1 -- start start 2023-12-01T15:43:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e972d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e4135760 0x7fc8e409daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e972d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e4135bf0 0x7fc8e41cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e972d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e4136a10 0x7fc8e41cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e972d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e4134b80 con 0x7fc8e4135bf0 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e972d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e40a0c50 con 0x7fc8e4136a10 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e972d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e409edd0 con 0x7fc8e4135760 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8db7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e4135bf0 0x7fc8e41cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8db7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e4135bf0 0x7fc8e41cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46882/0 (socket says 172.21.15.63:46882) 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8db7fe700 1 -- 172.21.15.63:0/4021695750 learned_addr learned my addr 172.21.15.63:0/4021695750 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e3fff700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e4135760 0x7fc8e409daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e8f2c700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e4136a10 0x7fc8e41cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8db7fe700 1 -- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e4135760 msgr2=0x7fc8e409daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8db7fe700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e4135760 0x7fc8e409daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8db7fe700 1 -- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e4136a10 msgr2=0x7fc8e41cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8db7fe700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e4136a10 0x7fc8e41cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8db7fe700 1 -- 172.21.15.63:0/4021695750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc009b30 con 0x7fc8e4135bf0 2023-12-01T15:43:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e8f2c700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e4136a10 0x7fc8e41cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8db7fe700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e4135bf0 0x7fc8e41cf4b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400e810 tx=0x7fc8d400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e17fa700 1 -- 172.21.15.63:0/4021695750 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4005c40 con 0x7fc8e4135bf0 2023-12-01T15:43:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e17fa700 1 -- 172.21.15.63:0/4021695750 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d4005da0 con 0x7fc8e4135bf0 2023-12-01T15:43:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e972d700 1 -- 172.21.15.63:0/4021695750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e4134d40 con 0x7fc8e4135bf0 2023-12-01T15:43:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e17fa700 1 -- 172.21.15.63:0/4021695750 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4006260 con 0x7fc8e4135bf0 2023-12-01T15:43:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e972d700 1 -- 172.21.15.63:0/4021695750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e406efa0 con 0x7fc8e4135bf0 2023-12-01T15:43:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e17fa700 1 -- 172.21.15.63:0/4021695750 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc8d40063c0 con 0x7fc8e4135bf0 2023-12-01T15:43:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.592+0000 7fc8e972d700 1 -- 172.21.15.63:0/4021695750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e4065fb0 con 0x7fc8e4135bf0 2023-12-01T15:43:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7fc8e17fa700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc8c4065b00 0x7fc8c4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7fc8e17fa700 1 -- 172.21.15.63:0/4021695750 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fc8d4082790 con 0x7fc8e4135bf0 2023-12-01T15:43:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ee14b700 1 Processor -- start 2023-12-01T15:43:55.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7fc8e3fff700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc8c4065b00 0x7fc8c4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ee14b700 1 -- start start 2023-12-01T15:43:55.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7fc8e3fff700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc8c4065b00 0x7fc8c4067fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc000f60 tx=0x7fc8cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ee14b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f84e8131300 0x7f84e81316e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ee14b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f84e806e300 0x7f84e813f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ee14b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e8070e50 con 0x7f84e8071aa0 2023-12-01T15:43:55.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ee14b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e80702a0 con 0x7f84e806e300 2023-12-01T15:43:55.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ee14b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e80708b0 con 0x7f84e8131300 2023-12-01T15:43:55.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ed94a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f84e806e300 0x7f84e813f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ec948700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f84e8071aa0 0x7f84e806dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42036/0 (socket says 172.21.15.63:42036) 2023-12-01T15:43:55.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ed94a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f84e806e300 0x7f84e813f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46898/0 (socket says 172.21.15.63:46898) 2023-12-01T15:43:55.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ec948700 1 -- 172.21.15.63:0/635550690 learned_addr learned my addr 172.21.15.63:0/635550690 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:55.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ed149700 1 --2- 172.21.15.63:0/635550690 >> v2:172.21.15.66:3300/0 conn(0x7f84e8131300 0x7f84e81316e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ed94a700 1 -- 172.21.15.63:0/635550690 >> v2:172.21.15.66:3300/0 conn(0x7f84e8131300 msgr2=0x7f84e81316e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:55.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ed94a700 1 --2- 172.21.15.63:0/635550690 >> v2:172.21.15.66:3300/0 conn(0x7f84e8131300 0x7f84e81316e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ed94a700 1 -- 172.21.15.63:0/635550690 >> v1:172.21.15.63:6789/0 conn(0x7f84e8071aa0 legacy=0x7f84e806dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ed94a700 1 -- 172.21.15.63:0/635550690 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80704c0 con 0x7f84e806e300 2023-12-01T15:43:55.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.596+0000 7f84ed94a700 1 --2- 172.21.15.63:0/635550690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84e806e300 0x7f84e813f6f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f84e806f050 tx=0x7f84d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44a4ed323d3881d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7f84dffff700 1 -- 172.21.15.63:0/635550690 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8011830 con 0x7f84e806e300 2023-12-01T15:43:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7f84dffff700 1 -- 172.21.15.63:0/635550690 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d8011990 con 0x7f84e806e300 2023-12-01T15:43:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7f84dffff700 1 -- 172.21.15.63:0/635550690 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8011d20 con 0x7f84e806e300 2023-12-01T15:43:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7fc8e17fa700 1 -- 172.21.15.63:0/4021695750 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc8d4050740 con 0x7fc8e4135bf0 2023-12-01T15:43:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7f84ee14b700 1 -- 172.21.15.63:0/635550690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84e806e300 msgr2=0x7f84e813f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7f84ee14b700 1 --2- 172.21.15.63:0/635550690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84e806e300 0x7f84e813f6f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f84e806f050 tx=0x7f84d8009b30 comp rx=0 tx=0).stop 2023-12-01T15:43:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7f84ee14b700 1 -- 172.21.15.63:0/635550690 shutdown_connections 2023-12-01T15:43:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7f84ee14b700 1 --2- 172.21.15.63:0/635550690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84e806e300 0x7f84e813f6f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7f84ee14b700 1 --2- 172.21.15.63:0/635550690 >> v2:172.21.15.66:3300/0 conn(0x7f84e8131300 0x7f84e81316e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7f84ee14b700 1 -- 172.21.15.63:0/635550690 >> 172.21.15.63:0/635550690 conn(0x7f84e80a85a0 msgr2=0x7f84e80a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7f84ee14b700 1 -- 172.21.15.63:0/635550690 shutdown_connections 2023-12-01T15:43:55.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.600+0000 7f84ee14b700 1 -- 172.21.15.63:0/635550690 wait complete. 2023-12-01T15:43:55.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ee14b700 1 Processor -- start 2023-12-01T15:43:55.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ee14b700 1 -- start start 2023-12-01T15:43:55.607 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ee14b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84e806e300 0x7f84e80a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ee14b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84e8071aa0 0x7f84e80a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ee14b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84e8131300 0x7f84e80a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ee14b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80a3f70 con 0x7f84e8131300 2023-12-01T15:43:55.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ee14b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80a5d10 con 0x7f84e806e300 2023-12-01T15:43:55.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ee14b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80a2d60 con 0x7f84e8071aa0 2023-12-01T15:43:55.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ed94a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84e8131300 0x7f84e80a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ed94a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84e8131300 0x7f84e80a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46906/0 (socket says 172.21.15.63:46906) 2023-12-01T15:43:55.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ed94a700 1 -- 172.21.15.63:0/2288909400 learned_addr learned my addr 172.21.15.63:0/2288909400 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:55.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ed149700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84e806e300 0x7f84e80a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ec948700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84e8071aa0 0x7f84e80a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ed94a700 1 -- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84e8071aa0 msgr2=0x7f84e80a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ed94a700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84e8071aa0 0x7f84e80a11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ed94a700 1 -- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84e806e300 msgr2=0x7f84e80a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ed94a700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84e806e300 0x7f84e80a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ed94a700 1 -- 172.21.15.63:0/2288909400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d80094b0 con 0x7f84e8131300 2023-12-01T15:43:55.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.604+0000 7f84ed94a700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84e8131300 0x7f84e80a1700 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009b70 tx=0x7f84d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.608+0000 7f84ddffb700 1 -- 172.21.15.63:0/2288909400 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d80044d0 con 0x7f84e8131300 2023-12-01T15:43:55.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.608+0000 7f84ddffb700 1 -- 172.21.15.63:0/2288909400 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d801e070 con 0x7f84e8131300 2023-12-01T15:43:55.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.608+0000 7f84ddffb700 1 -- 172.21.15.63:0/2288909400 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8003900 con 0x7f84e8131300 2023-12-01T15:43:55.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.608+0000 7f84ee14b700 1 -- 172.21.15.63:0/2288909400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e80a4ab0 con 0x7f84e8131300 2023-12-01T15:43:55.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.608+0000 7f84ee14b700 1 -- 172.21.15.63:0/2288909400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e80a5050 con 0x7f84e8131300 2023-12-01T15:43:55.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.608+0000 7f84ee14b700 1 -- 172.21.15.63:0/2288909400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c8005100 con 0x7f84e8131300 2023-12-01T15:43:55.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.608+0000 7f84ddffb700 1 -- 172.21.15.63:0/2288909400 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f84d8003a60 con 0x7f84e8131300 2023-12-01T15:43:55.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.608+0000 7f84ddffb700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f84d4065c60 0x7f84d4068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.608+0000 7f84ddffb700 1 -- 172.21.15.63:0/2288909400 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f84d8083800 con 0x7f84e8131300 2023-12-01T15:43:55.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.608+0000 7f84ed149700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f84d4065c60 0x7f84d4068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.612+0000 7f84ed149700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f84d4065c60 0x7f84d4068120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f84e0014350 tx=0x7f84e00096c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.612+0000 7f2084861700 1 Processor -- start 2023-12-01T15:43:55.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.612+0000 7f2084861700 1 -- start start 2023-12-01T15:43:55.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f2084861700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f20801384d0 0x7f2080138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f2084861700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2080135ab0 0x7f2080140810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f2084861700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2080071470 con 0x7f2080134f60 2023-12-01T15:43:55.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f2084861700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2080071d10 con 0x7f20801384d0 2023-12-01T15:43:55.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f2084861700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2080070ca0 con 0x7f2080135ab0 2023-12-01T15:43:55.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f20801384d0 0x7f2080138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2080134f60 0x7f20801353a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42048/0 (socket says 172.21.15.63:42048) 2023-12-01T15:43:55.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207f7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f20801384d0 0x7f2080138d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46912/0 (socket says 172.21.15.63:46912) 2023-12-01T15:43:55.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207effd700 1 -- 172.21.15.63:0/4283439665 learned_addr learned my addr 172.21.15.63:0/4283439665 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:55.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207ffff700 1 --2- 172.21.15.63:0/4283439665 >> v2:172.21.15.66:3300/0 conn(0x7f2080135ab0 0x7f2080140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207f7fe700 1 -- 172.21.15.63:0/4283439665 >> v2:172.21.15.66:3300/0 conn(0x7f2080135ab0 msgr2=0x7f2080140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:55.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207f7fe700 1 --2- 172.21.15.63:0/4283439665 >> v2:172.21.15.66:3300/0 conn(0x7f2080135ab0 0x7f2080140810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207f7fe700 1 -- 172.21.15.63:0/4283439665 >> v1:172.21.15.63:6789/0 conn(0x7f2080134f60 legacy=0x7f20801353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207f7fe700 1 -- 172.21.15.63:0/4283439665 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20800719e0 con 0x7f20801384d0 2023-12-01T15:43:55.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207f7fe700 1 --2- 172.21.15.63:0/4283439665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20801384d0 0x7f2080138d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2080070c30 tx=0x7f2070009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb26b8b7e9bb60f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207e7fc700 1 -- 172.21.15.63:0/4283439665 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070011830 con 0x7f20801384d0 2023-12-01T15:43:55.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207e7fc700 1 -- 172.21.15.63:0/4283439665 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2070011990 con 0x7f20801384d0 2023-12-01T15:43:55.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f207e7fc700 1 -- 172.21.15.63:0/4283439665 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070011d20 con 0x7f20801384d0 2023-12-01T15:43:55.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.616+0000 7f84ddffb700 1 -- 172.21.15.63:0/2288909400 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f84d8051890 con 0x7f84e8131300 2023-12-01T15:43:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 -- 172.21.15.63:0/4283439665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20801384d0 msgr2=0x7f2080138d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 --2- 172.21.15.63:0/4283439665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20801384d0 0x7f2080138d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2080070c30 tx=0x7f2070009b30 comp rx=0 tx=0).stop 2023-12-01T15:43:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 -- 172.21.15.63:0/4283439665 shutdown_connections 2023-12-01T15:43:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 --2- 172.21.15.63:0/4283439665 >> v2:172.21.15.66:3300/0 conn(0x7f2080135ab0 0x7f2080140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 --2- 172.21.15.63:0/4283439665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20801384d0 0x7f2080138d20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 -- 172.21.15.63:0/4283439665 >> 172.21.15.63:0/4283439665 conn(0x7f20800a8bd0 msgr2=0x7f2080098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 -- 172.21.15.63:0/4283439665 shutdown_connections 2023-12-01T15:43:55.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 -- 172.21.15.63:0/4283439665 wait complete. 2023-12-01T15:43:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 Processor -- start 2023-12-01T15:43:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 -- start start 2023-12-01T15:43:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2080134f60 0x7f20801ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2080135ab0 0x7f20801cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20801384d0 0x7f20801cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2080136170 con 0x7f2080134f60 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20800a1d30 con 0x7f2080135ab0 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20800a04f0 con 0x7f20801384d0 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2080134f60 0x7f20801ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2080134f60 0x7f20801ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46920/0 (socket says 172.21.15.63:46920) 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207f7fe700 1 -- 172.21.15.63:0/1950976502 learned_addr learned my addr 172.21.15.63:0/1950976502 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207ffff700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20801384d0 0x7f20801cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207effd700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2080135ab0 0x7f20801cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207f7fe700 1 -- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20801384d0 msgr2=0x7f20801cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207f7fe700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20801384d0 0x7f20801cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207f7fe700 1 -- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2080135ab0 msgr2=0x7f20801cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207f7fe700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2080135ab0 0x7f20801cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207f7fe700 1 -- 172.21.15.63:0/1950976502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20700094b0 con 0x7f2080134f60 2023-12-01T15:43:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207effd700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2080135ab0 0x7f20801cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T15:43:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207ffff700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20801384d0 0x7f20801cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T15:43:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f207f7fe700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2080134f60 0x7f20801ccea0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2070009b70 tx=0x7f2070004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2067fff700 1 -- 172.21.15.63:0/1950976502 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20700036c0 con 0x7f2080134f60 2023-12-01T15:43:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2067fff700 1 -- 172.21.15.63:0/1950976502 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2070003820 con 0x7f2080134f60 2023-12-01T15:43:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2067fff700 1 -- 172.21.15.63:0/1950976502 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070003b90 con 0x7f2080134f60 2023-12-01T15:43:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 -- 172.21.15.63:0/1950976502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20800a1f60 con 0x7f2080134f60 2023-12-01T15:43:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.620+0000 7f2084861700 1 -- 172.21.15.63:0/1950976502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20800a4dc0 con 0x7f2080134f60 2023-12-01T15:43:55.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.624+0000 7f2067fff700 1 -- 172.21.15.63:0/1950976502 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2070021070 con 0x7f2080134f60 2023-12-01T15:43:55.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.624+0000 7f2067fff700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f206c065b00 0x7f206c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.624+0000 7f2067fff700 1 -- 172.21.15.63:0/1950976502 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f20700840d0 con 0x7f2080134f60 2023-12-01T15:43:55.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.624+0000 7f207effd700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f206c065b00 0x7f206c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.624+0000 7f207effd700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f206c065b00 0x7f206c067fc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20800a54a0 tx=0x7f2074009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.632+0000 7f2084861700 1 -- 172.21.15.63:0/1950976502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2080065fb0 con 0x7f2080134f60 2023-12-01T15:43:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.636+0000 7f2067fff700 1 -- 172.21.15.63:0/1950976502 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f2070052080 con 0x7f2080134f60 2023-12-01T15:43:55.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.676+0000 7f6d08d20700 1 Processor -- start 2023-12-01T15:43:55.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.676+0000 7f6d08d20700 1 -- start start 2023-12-01T15:43:55.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d04135560 0x7f6d04135940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6d04098a60 0x7f6d04098e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.683 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d04070800 con 0x7f6d040993a0 2023-12-01T15:43:55.683 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d040724c0 con 0x7f6d04135560 2023-12-01T15:43:55.683 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d040726b0 con 0x7f6d04098a60 2023-12-01T15:43:55.683 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d03fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6d040993a0 0x7f6d0413f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42064/0 (socket says 172.21.15.63:42064) 2023-12-01T15:43:55.683 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d03fff700 1 -- 172.21.15.63:0/1657220783 learned_addr learned my addr 172.21.15.63:0/1657220783 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:55.683 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d037fe700 1 --2- 172.21.15.63:0/1657220783 >> v2:172.21.15.63:3300/0 conn(0x7f6d04135560 0x7f6d04135940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.683 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d02ffd700 1 --2- 172.21.15.63:0/1657220783 >> v2:172.21.15.66:3300/0 conn(0x7f6d04098a60 0x7f6d04098e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d027fc700 1 -- 172.21.15.63:0/1657220783 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370559507 0 0) 0x7f6d04070800 con 0x7f6d040993a0 2023-12-01T15:43:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d027fc700 1 -- 172.21.15.63:0/1657220783 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cec0035d0 con 0x7f6d040993a0 2023-12-01T15:43:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d037fe700 1 -- 172.21.15.63:0/1657220783 >> v2:172.21.15.66:3300/0 conn(0x7f6d04098a60 msgr2=0x7f6d04098e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d037fe700 1 --2- 172.21.15.63:0/1657220783 >> v2:172.21.15.66:3300/0 conn(0x7f6d04098a60 0x7f6d04098e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d037fe700 1 -- 172.21.15.63:0/1657220783 >> v1:172.21.15.63:6789/0 conn(0x7f6d040993a0 legacy=0x7f6d0413f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d037fe700 1 -- 172.21.15.63:0/1657220783 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d04071980 con 0x7f6d04135560 2023-12-01T15:43:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d037fe700 1 --2- 172.21.15.63:0/1657220783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d04135560 0x7f6d04135940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d0406afa0 tx=0x7f6cf4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c11cebef9f24120 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d027fc700 1 -- 172.21.15.63:0/1657220783 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4011830 con 0x7f6d04135560 2023-12-01T15:43:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d027fc700 1 -- 172.21.15.63:0/1657220783 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf4011990 con 0x7f6d04135560 2023-12-01T15:43:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d027fc700 1 -- 172.21.15.63:0/1657220783 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4011d00 con 0x7f6d04135560 2023-12-01T15:43:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 -- 172.21.15.63:0/1657220783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d04135560 msgr2=0x7f6d04135940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 --2- 172.21.15.63:0/1657220783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d04135560 0x7f6d04135940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d0406afa0 tx=0x7f6cf4009b30 comp rx=0 tx=0).stop 2023-12-01T15:43:55.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 -- 172.21.15.63:0/1657220783 shutdown_connections 2023-12-01T15:43:55.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 --2- 172.21.15.63:0/1657220783 >> v2:172.21.15.66:3300/0 conn(0x7f6d04098a60 0x7f6d04098e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 --2- 172.21.15.63:0/1657220783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d04135560 0x7f6d04135940 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 -- 172.21.15.63:0/1657220783 >> 172.21.15.63:0/1657220783 conn(0x7f6d040a96b0 msgr2=0x7f6d040a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 -- 172.21.15.63:0/1657220783 shutdown_connections 2023-12-01T15:43:55.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 -- 172.21.15.63:0/1657220783 wait complete. 2023-12-01T15:43:55.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 Processor -- start 2023-12-01T15:43:55.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.680+0000 7f6d08d20700 1 -- start start 2023-12-01T15:43:55.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d08d20700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d04098a60 0x7f6d040a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d08d20700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d040993a0 0x7f6d040a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d08d20700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d04135560 0x7f6d040a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d08d20700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040a5dd0 con 0x7f6d04135560 2023-12-01T15:43:55.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d08d20700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040a5a10 con 0x7f6d040993a0 2023-12-01T15:43:55.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d08d20700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d041207c0 con 0x7f6d04098a60 2023-12-01T15:43:55.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d03fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d04135560 0x7f6d040a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d03fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d04135560 0x7f6d040a4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46936/0 (socket says 172.21.15.63:46936) 2023-12-01T15:43:55.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d03fff700 1 -- 172.21.15.63:0/2525031897 learned_addr learned my addr 172.21.15.63:0/2525031897 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:55.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d037fe700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d04098a60 0x7f6d040a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d02ffd700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d040993a0 0x7f6d040a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d03fff700 1 -- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d04098a60 msgr2=0x7f6d040a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d03fff700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d04098a60 0x7f6d040a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d03fff700 1 -- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d040993a0 msgr2=0x7f6d040a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d03fff700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d040993a0 0x7f6d040a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d03fff700 1 -- 172.21.15.63:0/2525031897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40094b0 con 0x7f6d04135560 2023-12-01T15:43:55.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d02ffd700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d040993a0 0x7f6d040a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T15:43:55.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d03fff700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d04135560 0x7f6d040a4800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00cb40 tx=0x7f6cfc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6cebfff700 1 -- 172.21.15.63:0/2525031897 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc00a7b0 con 0x7f6d04135560 2023-12-01T15:43:55.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d08d20700 1 -- 172.21.15.63:0/2525031897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d04121940 con 0x7f6d04135560 2023-12-01T15:43:55.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6cebfff700 1 -- 172.21.15.63:0/2525031897 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc00a910 con 0x7f6d04135560 2023-12-01T15:43:55.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d08d20700 1 -- 172.21.15.63:0/2525031897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d04120470 con 0x7f6d04135560 2023-12-01T15:43:55.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6cebfff700 1 -- 172.21.15.63:0/2525031897 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc00ac80 con 0x7f6d04135560 2023-12-01T15:43:55.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.684+0000 7f6d08d20700 1 -- 172.21.15.63:0/2525031897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d04065f70 con 0x7f6d04135560 2023-12-01T15:43:55.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.688+0000 7f6cebfff700 1 -- 172.21.15.63:0/2525031897 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6cfc01b3b0 con 0x7f6d04135560 2023-12-01T15:43:55.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.688+0000 7f6cebfff700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6cec065f30 0x7f6cec0683f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:55.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.688+0000 7f6cebfff700 1 -- 172.21.15.63:0/2525031897 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f6cfc0829b0 con 0x7f6d04135560 2023-12-01T15:43:55.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.688+0000 7f6d037fe700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6cec065f30 0x7f6cec0683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:55.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.688+0000 7f6d037fe700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6cec065f30 0x7f6cec0683f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000c00 tx=0x7f6cf4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:55.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.692+0000 7f6cebfff700 1 -- 172.21.15.63:0/2525031897 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6cfc050a10 con 0x7f6d04135560 2023-12-01T15:43:55.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.804+0000 7f84ee14b700 1 -- 172.21.15.63:0/2288909400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f84c8005680 con 0x7f84e8131300 2023-12-01T15:43:55.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.804+0000 7f84ddffb700 1 -- 172.21.15.63:0/2288909400 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84d8015020 con 0x7f84e8131300 2023-12-01T15:43:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:38654705671 2023-12-01T15:43:55.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 -- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f84d4065c60 msgr2=0x7f84d4068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f84d4065c60 0x7f84d4068120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f84e0014350 tx=0x7f84e00096c0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 -- 172.21.15.63:0/2288909400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84e8131300 msgr2=0x7f84e80a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84e8131300 0x7f84e80a1700 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009b70 tx=0x7f84d8004770 comp rx=0 tx=0).stop 2023-12-01T15:43:55.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 -- 172.21.15.63:0/2288909400 shutdown_connections 2023-12-01T15:43:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f84d4065c60 0x7f84d4068120 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84e8071aa0 0x7f84e80a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84e8131300 0x7f84e80a1700 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 --2- 172.21.15.63:0/2288909400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84e806e300 0x7f84e80a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 -- 172.21.15.63:0/2288909400 >> 172.21.15.63:0/2288909400 conn(0x7f84e80a85a0 msgr2=0x7f84e809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 -- 172.21.15.63:0/2288909400 shutdown_connections 2023-12-01T15:43:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.808+0000 7f84ee14b700 1 -- 172.21.15.63:0/2288909400 wait complete. 2023-12-01T15:43:55.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705671 for osd.2 2023-12-01T15:43:55.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.860+0000 7f6d08d20700 1 -- 172.21.15.63:0/2525031897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6d04061d90 con 0x7f6d04135560 2023-12-01T15:43:55.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.860+0000 7f6cebfff700 1 -- 172.21.15.63:0/2525031897 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6cfc021090 con 0x7f6d04135560 2023-12-01T15:43:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:38654705670 2023-12-01T15:43:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 -- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6cec065f30 msgr2=0x7f6cec0683f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6cec065f30 0x7f6cec0683f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000c00 tx=0x7f6cf4008030 comp rx=0 tx=0).stop 2023-12-01T15:43:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 -- 172.21.15.63:0/2525031897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d04135560 msgr2=0x7f6d040a4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d04135560 0x7f6d040a4800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00cb40 tx=0x7f6cfc00cb70 comp rx=0 tx=0).stop 2023-12-01T15:43:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 -- 172.21.15.63:0/2525031897 shutdown_connections 2023-12-01T15:43:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6cec065f30 0x7f6cec0683f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d04135560 0x7f6d040a4800 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d040993a0 0x7f6d040a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 --2- 172.21.15.63:0/2525031897 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d04098a60 0x7f6d040a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 -- 172.21.15.63:0/2525031897 >> 172.21.15.63:0/2525031897 conn(0x7f6d040a96b0 msgr2=0x7f6d0409ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 -- 172.21.15.63:0/2525031897 shutdown_connections 2023-12-01T15:43:55.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.864+0000 7f6d08d20700 1 -- 172.21.15.63:0/2525031897 wait complete. 2023-12-01T15:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.3 2023-12-01T15:43:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e972d700 1 -- 172.21.15.63:0/4021695750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc8e409f2d0 con 0x7fc8e4135bf0 2023-12-01T15:43:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e17fa700 1 -- 172.21.15.63:0/4021695750 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8d4020020 con 0x7fc8e4135bf0 2023-12-01T15:43:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:38654705670 2023-12-01T15:43:55.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e972d700 1 -- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc8c4065b00 msgr2=0x7fc8c4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e972d700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc8c4065b00 0x7fc8c4067fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc000f60 tx=0x7fc8cc009040 comp rx=0 tx=0).stop 2023-12-01T15:43:55.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e972d700 1 -- 172.21.15.63:0/4021695750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e4135bf0 msgr2=0x7fc8e41cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e972d700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e4135bf0 0x7fc8e41cf4b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400e810 tx=0x7fc8d400eb20 comp rx=0 tx=0).stop 2023-12-01T15:43:55.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e972d700 1 -- 172.21.15.63:0/4021695750 shutdown_connections 2023-12-01T15:43:55.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e972d700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc8c4065b00 0x7fc8c4067fc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e972d700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e4136a10 0x7fc8e41cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e972d700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8e4135bf0 0x7fc8e41cf4b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e972d700 1 --2- 172.21.15.63:0/4021695750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e4135760 0x7fc8e409daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.876+0000 7fc8e972d700 1 -- 172.21.15.63:0/4021695750 >> 172.21.15.63:0/4021695750 conn(0x7fc8e40a9a90 msgr2=0x7fc8e4071560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.880+0000 7fc8e972d700 1 -- 172.21.15.63:0/4021695750 shutdown_connections 2023-12-01T15:43:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.880+0000 7fc8e972d700 1 -- 172.21.15.63:0/4021695750 wait complete. 2023-12-01T15:43:55.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.0 2023-12-01T15:43:55.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 -- 172.21.15.63:0/1950976502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f20800a2400 con 0x7f2080134f60 2023-12-01T15:43:55.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2067fff700 1 -- 172.21.15.63:0/1950976502 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2070015030 con 0x7f2080134f60 2023-12-01T15:43:55.903 INFO:teuthology.orchestra.run.smithi063.stdout:38654705670 2023-12-01T15:43:55.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 -- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f206c065b00 msgr2=0x7f206c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f206c065b00 0x7f206c067fc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20800a54a0 tx=0x7f2074009040 comp rx=0 tx=0).stop 2023-12-01T15:43:55.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 -- 172.21.15.63:0/1950976502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2080134f60 msgr2=0x7f20801ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:55.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2080134f60 0x7f20801ccea0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2070009b70 tx=0x7f2070004770 comp rx=0 tx=0).stop 2023-12-01T15:43:55.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 -- 172.21.15.63:0/1950976502 shutdown_connections 2023-12-01T15:43:55.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f206c065b00 0x7f206c067fc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20801384d0 0x7f20801cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2080135ab0 0x7f20801cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 --2- 172.21.15.63:0/1950976502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2080134f60 0x7f20801ccea0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:55.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 -- 172.21.15.63:0/1950976502 >> 172.21.15.63:0/1950976502 conn(0x7f20800a8bd0 msgr2=0x7f20801c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:55.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 -- 172.21.15.63:0/1950976502 shutdown_connections 2023-12-01T15:43:55.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:55.900+0000 7f2084861700 1 -- 172.21.15.63:0/1950976502 wait complete. 2023-12-01T15:43:55.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.1 2023-12-01T15:43:56.828 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-01T15:43:56.879 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-01T15:43:56.895 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-01T15:43:56.917 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-01T15:43:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.948+0000 7f74b9265700 1 Processor -- start 2023-12-01T15:43:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.948+0000 7f74b9265700 1 -- start start 2023-12-01T15:43:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b9265700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f74b413e090 0x7f74b4140480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:56.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b9265700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b40a19c0 con 0x7f74b4134070 2023-12-01T15:43:56.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b9265700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b40a5150 con 0x7f74b4134450 2023-12-01T15:43:56.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b9265700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b40a09e0 con 0x7f74b413e090 2023-12-01T15:43:56.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b2ffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f74b4134070 0x7f74b4136d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48406/0 (socket says 172.21.15.63:48406) 2023-12-01T15:43:56.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b2ffd700 1 -- 172.21.15.63:0/3285581619 learned_addr learned my addr 172.21.15.63:0/3285581619 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b37fe700 1 --2- 172.21.15.63:0/3285581619 >> v2:172.21.15.66:3300/0 conn(0x7f74b413e090 0x7f74b4140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260946610 0 0) 0x7f74a8001110 con 0x7f74b4134070 2023-12-01T15:43:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f749c0046e0 con 0x7f74b4134070 2023-12-01T15:43:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2654371983 0 0) 0x7f749c0046e0 con 0x7f74b4134070 2023-12-01T15:43:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 >> v2:172.21.15.66:3300/0 conn(0x7f74b413e090 msgr2=0x7f74b4140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 --2- 172.21.15.63:0/3285581619 >> v2:172.21.15.66:3300/0 conn(0x7f74b413e090 0x7f74b4140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 >> v1:172.21.15.66:6789/0 conn(0x7f74b4134450 legacy=0x7f74b4137460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b4137b70 con 0x7f74b4134070 2023-12-01T15:43:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3363315130 0 0) 0x7f74a8001800 con 0x7f74b4134070 2023-12-01T15:43:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 >> v1:172.21.15.63:6789/0 conn(0x7f74b4134070 legacy=0x7f74b4136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 --2- 172.21.15.63:0/3285581619 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f749c004ba0 0x7f749c004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 --2- 172.21.15.63:0/3285581619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f749c005980 0x7f749c005e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 --2- 172.21.15.63:0/3285581619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 0x7f749c00cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c00d240 con 0x7f749c006340 2023-12-01T15:43:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c00d3b0 con 0x7f749c005980 2023-12-01T15:43:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c003570 con 0x7f749c004ba0 2023-12-01T15:43:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b37fe700 1 --2- 172.21.15.63:0/3285581619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 0x7f749c00cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b27fc700 1 --2- 172.21.15.63:0/3285581619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f749c005980 0x7f749c005e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b2ffd700 1 --2- 172.21.15.63:0/3285581619 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f749c004ba0 0x7f749c004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b37fe700 1 -- 172.21.15.63:0/3285581619 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f749c004ba0 msgr2=0x7f749c004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b37fe700 1 --2- 172.21.15.63:0/3285581619 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f749c004ba0 0x7f749c004f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b37fe700 1 -- 172.21.15.63:0/3285581619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f749c005980 msgr2=0x7f749c005e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b37fe700 1 --2- 172.21.15.63:0/3285581619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f749c005980 0x7f749c005e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b37fe700 1 -- 172.21.15.63:0/3285581619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c0046e0 con 0x7f749c006340 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b37fe700 1 -- 172.21.15.63:0/3285581619 reap_dead start 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b37fe700 1 --2- 172.21.15.63:0/3285581619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 0x7f749c00cb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009b40 tx=0x7f749c0069b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a0223049c969b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac004020 con 0x7f749c006340 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac004180 con 0x7f749c006340 2023-12-01T15:43:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b1ffb700 1 -- 172.21.15.63:0/3285581619 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0044f0 con 0x7f749c006340 2023-12-01T15:43:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b9265700 1 -- 172.21.15.63:0/3285581619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 msgr2=0x7f749c00cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b9265700 1 --2- 172.21.15.63:0/3285581619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 0x7f749c00cb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009b40 tx=0x7f749c0069b0 comp rx=0 tx=0).stop 2023-12-01T15:43:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b9265700 1 -- 172.21.15.63:0/3285581619 shutdown_connections 2023-12-01T15:43:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b9265700 1 --2- 172.21.15.63:0/3285581619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 0x7f749c00cb40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b9265700 1 -- 172.21.15.63:0/3285581619 >> 172.21.15.63:0/3285581619 conn(0x7f74b40a5a10 msgr2=0x7f74b40a5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b9265700 1 -- 172.21.15.63:0/3285581619 shutdown_connections 2023-12-01T15:43:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.952+0000 7f74b9265700 1 -- 172.21.15.63:0/3285581619 wait complete. 2023-12-01T15:43:56.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b9265700 1 Processor -- start 2023-12-01T15:43:56.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b9265700 1 -- start start 2023-12-01T15:43:56.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b9265700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 0x7f74b406ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b9265700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74b406f220 0x7f74b406f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b9265700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f74b41306b0 0x7f74b4130b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b9265700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4071930 con 0x7f749c006340 2023-12-01T15:43:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b9265700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b409bd20 con 0x7f74b406f220 2023-12-01T15:43:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b9265700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b40716a0 con 0x7f74b41306b0 2023-12-01T15:43:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 0x7f74b406ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 0x7f74b406ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36008/0 (socket says 172.21.15.63:36008) 2023-12-01T15:43:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b2ffd700 1 -- 172.21.15.63:0/620498169 learned_addr learned my addr 172.21.15.63:0/620498169 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b27fc700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74b406f220 0x7f74b406f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b37fe700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f74b41306b0 0x7f74b4130b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b2ffd700 1 -- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f74b41306b0 msgr2=0x7f74b4130b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b2ffd700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f74b41306b0 0x7f74b4130b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b2ffd700 1 -- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74b406f220 msgr2=0x7f74b406f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b2ffd700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74b406f220 0x7f74b406f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b2ffd700 1 -- 172.21.15.63:0/620498169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b4070d30 con 0x7f749c006340 2023-12-01T15:43:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b2ffd700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 0x7f74b406ece0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f74a8001930 tx=0x7f74a800da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f749b7fe700 1 -- 172.21.15.63:0/620498169 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8004ca0 con 0x7f749c006340 2023-12-01T15:43:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f749b7fe700 1 -- 172.21.15.63:0/620498169 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8004e00 con 0x7f749c006340 2023-12-01T15:43:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b9265700 1 -- 172.21.15.63:0/620498169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b409b7d0 con 0x7f749c006340 2023-12-01T15:43:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f749b7fe700 1 -- 172.21.15.63:0/620498169 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a80072d0 con 0x7f749c006340 2023-12-01T15:43:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.956+0000 7f74b9265700 1 -- 172.21.15.63:0/620498169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b409bf50 con 0x7f749c006340 2023-12-01T15:43:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.960+0000 7f74b9265700 1 -- 172.21.15.63:0/620498169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b4065fb0 con 0x7f749c006340 2023-12-01T15:43:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.960+0000 7f749b7fe700 1 -- 172.21.15.63:0/620498169 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f74a8007430 con 0x7f749c006340 2023-12-01T15:43:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.960+0000 7f749b7fe700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f749c06bc60 0x7f749c06e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.960+0000 7f749b7fe700 1 -- 172.21.15.63:0/620498169 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f74a8082390 con 0x7f749c006340 2023-12-01T15:43:56.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.960+0000 7f74b27fc700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f749c06bc60 0x7f749c06e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:56.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.960+0000 7f74b27fc700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f749c06bc60 0x7f749c06e120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74a4002230 tx=0x7f74a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:56.968+0000 7f749b7fe700 1 -- 172.21.15.63:0/620498169 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f74a8050340 con 0x7f749c006340 2023-12-01T15:43:57.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b2792700 1 Processor -- start 2023-12-01T15:43:57.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b2792700 1 -- start start 2023-12-01T15:43:57.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b2792700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92ac0a4b40 0x7f92ac099170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b2792700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ac134ff0 con 0x7f92ac13e720 2023-12-01T15:43:57.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b2792700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ac0a5150 con 0x7f92ac135870 2023-12-01T15:43:57.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b2792700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac134e00 con 0x7f92ac0a4b40 2023-12-01T15:43:57.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b0f8f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92ac0a4b40 0x7f92ac099170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b0f8f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92ac0a4b40 0x7f92ac099170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36022/0 (socket says 172.21.15.63:36022) 2023-12-01T15:43:57.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b0f8f700 1 -- 172.21.15.63:0/279549213 learned_addr learned my addr 172.21.15.63:0/279549213 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:57.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b0f8f700 1 -- 172.21.15.63:0/279549213 >> v1:172.21.15.66:6789/0 conn(0x7f92ac135870 legacy=0x7f92ac098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b0f8f700 1 -- 172.21.15.63:0/279549213 >> v1:172.21.15.63:6789/0 conn(0x7f92ac13e720 legacy=0x7f92ac140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b0f8f700 1 -- 172.21.15.63:0/279549213 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac135290 con 0x7f92ac0a4b40 2023-12-01T15:43:57.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92b0f8f700 1 --2- 172.21.15.63:0/279549213 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92ac0a4b40 0x7f92ac099170 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f92a8009910 tx=0x7f92a8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302d703bad91986a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fbcb151d700 1 Processor -- start 2023-12-01T15:43:57.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fbcb151d700 1 -- start start 2023-12-01T15:43:57.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92a3fff700 1 -- 172.21.15.63:0/279549213 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800ba60 con 0x7f92ac0a4b40 2023-12-01T15:43:57.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92a3fff700 1 -- 172.21.15.63:0/279549213 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a800bbc0 con 0x7f92ac0a4b40 2023-12-01T15:43:57.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7f92a3fff700 1 -- 172.21.15.63:0/279549213 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8009e60 con 0x7f92ac0a4b40 2023-12-01T15:43:57.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fbcb151d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac0a15c0 0x7fbcac0a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fbcb151d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbcac137b80 0x7fbcac1428e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fbcb151d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac13b4f0 con 0x7fbcac136ff0 2023-12-01T15:43:57.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fbcb151d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac0a3e30 con 0x7fbcac137b80 2023-12-01T15:43:57.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fbcb151d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac13abf0 con 0x7fbcac0a15c0 2023-12-01T15:43:57.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fece09a9700 1 Processor -- start 2023-12-01T15:43:57.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fece09a9700 1 -- start start 2023-12-01T15:43:57.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fbcab7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbcac136ff0 0x7fbcac137470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48418/0 (socket says 172.21.15.63:48418) 2023-12-01T15:43:57.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fbcab7fe700 1 -- 172.21.15.63:0/283486350 learned_addr learned my addr 172.21.15.63:0/283486350 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:57.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.028+0000 7fbcabfff700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac0a15c0 0x7fbcac0a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcb0d1c700 1 --2- 172.21.15.63:0/283486350 >> v2:172.21.15.66:3300/0 conn(0x7fbcac137b80 0x7fbcac1428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467691251 0 0) 0x7fbca0001110 con 0x7fbcac136ff0 2023-12-01T15:43:57.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc940035d0 con 0x7fbcac136ff0 2023-12-01T15:43:57.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 -- 172.21.15.63:0/279549213 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92ac0a4b40 msgr2=0x7f92ac099170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 --2- 172.21.15.63:0/279549213 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92ac0a4b40 0x7f92ac099170 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f92a8009910 tx=0x7f92a8009c20 comp rx=0 tx=0).stop 2023-12-01T15:43:57.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 -- 172.21.15.63:0/279549213 shutdown_connections 2023-12-01T15:43:57.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 --2- 172.21.15.63:0/279549213 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92ac0a4b40 0x7f92ac099170 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 -- 172.21.15.63:0/279549213 >> 172.21.15.63:0/279549213 conn(0x7f92ac0a58a0 msgr2=0x7f92ac0a5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:57.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1606149817 0 0) 0x7fbc940035d0 con 0x7fbcac136ff0 2023-12-01T15:43:57.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 -- 172.21.15.63:0/279549213 shutdown_connections 2023-12-01T15:43:57.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac0a15c0 msgr2=0x7fbcac0a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac0a15c0 0x7fbcac0a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 >> v2:172.21.15.66:3300/0 conn(0x7fbcac137b80 msgr2=0x7fbcac1428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 --2- 172.21.15.63:0/283486350 >> v2:172.21.15.66:3300/0 conn(0x7fbcac137b80 0x7fbcac1428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0a3b50 con 0x7fbcac136ff0 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3363315130 0 0) 0x7fbca0001800 con 0x7fbcac136ff0 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 >> v1:172.21.15.63:6789/0 conn(0x7fbcac136ff0 legacy=0x7fbcac137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc94003a90 0x7fbc94003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc94004870 0x7fbc94004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac0a15c0 0x7fbc94005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0a3e30 con 0x7fbc94003a90 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac13abf0 con 0x7fbc94004870 2023-12-01T15:43:57.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9400bb30 con 0x7fbcac0a15c0 2023-12-01T15:43:57.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 -- 172.21.15.63:0/279549213 wait complete. 2023-12-01T15:43:57.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcabfff700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc94003a90 0x7fbc94003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fece09a9700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fecdc135c70 0x7fecdc099170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fece09a9700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc1351e0 con 0x7fecdc13e910 2023-12-01T15:43:57.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fece09a9700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc0a4340 con 0x7fecdc135890 2023-12-01T15:43:57.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fece09a9700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecdc134ff0 con 0x7fecdc135c70 2023-12-01T15:43:57.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecdad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fecdc13e910 0x7fecdc140d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48420/0 (socket says 172.21.15.63:48420) 2023-12-01T15:43:57.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecdad9d700 1 -- 172.21.15.63:0/2290182643 learned_addr learned my addr 172.21.15.63:0/2290182643 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:57.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecd9d9b700 1 --2- 172.21.15.63:0/2290182643 >> v2:172.21.15.63:3300/0 conn(0x7fecdc135c70 0x7fecdc099170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcab7fe700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc94004870 0x7fbc94004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcb0d1c700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac0a15c0 0x7fbc94005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcabfff700 1 -- 172.21.15.63:0/283486350 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac0a15c0 msgr2=0x7fbc94005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:57.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcabfff700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac0a15c0 0x7fbc94005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcabfff700 1 -- 172.21.15.63:0/283486350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc94004870 msgr2=0x7fbc94004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:57.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcabfff700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc94004870 0x7fbc94004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcabfff700 1 -- 172.21.15.63:0/283486350 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc940035d0 con 0x7fbc94003a90 2023-12-01T15:43:57.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecd959a700 1 -- 172.21.15.63:0/2290182643 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166287363 0 0) 0x7fecdc1351e0 con 0x7fecdc13e910 2023-12-01T15:43:57.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecd959a700 1 -- 172.21.15.63:0/2290182643 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc40035d0 con 0x7fecdc13e910 2023-12-01T15:43:57.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecd9d9b700 1 -- 172.21.15.63:0/2290182643 >> v1:172.21.15.66:6789/0 conn(0x7fecdc135890 legacy=0x7fecdc098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecd9d9b700 1 -- 172.21.15.63:0/2290182643 >> v1:172.21.15.63:6789/0 conn(0x7fecdc13e910 legacy=0x7fecdc140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecd959a700 1 -- 172.21.15.63:0/2290182643 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1039926035 0 0) 0x7fecc40035d0 con 0x7fecdc13e910 2023-12-01T15:43:57.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcabfff700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc94003a90 0x7fbc94003eb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009b40 tx=0x7fbc940058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09571ee8482bcc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecd9d9b700 1 -- 172.21.15.63:0/2290182643 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc0a2800 con 0x7fecdc135c70 2023-12-01T15:43:57.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c00e6c0 con 0x7fbc94003a90 2023-12-01T15:43:57.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecd9d9b700 1 --2- 172.21.15.63:0/2290182643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecdc135c70 0x7fecdc099170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009850 tx=0x7fecd0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ca41f20a394467 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c00e820 con 0x7fbc94003a90 2023-12-01T15:43:57.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcaaffd700 1 -- 172.21.15.63:0/283486350 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c00eb90 con 0x7fbc94003a90 2023-12-01T15:43:57.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecd959a700 1 -- 172.21.15.63:0/2290182643 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc001670 con 0x7fecdc135c70 2023-12-01T15:43:57.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecd959a700 1 -- 172.21.15.63:0/2290182643 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd0004030 con 0x7fecdc135c70 2023-12-01T15:43:57.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fecd959a700 1 -- 172.21.15.63:0/2290182643 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd00043c0 con 0x7fecdc135c70 2023-12-01T15:43:57.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 Processor -- start 2023-12-01T15:43:57.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 -- start start 2023-12-01T15:43:57.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcb151d700 1 -- 172.21.15.63:0/283486350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc94003a90 msgr2=0x7fbc94003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcb151d700 1 --2- 172.21.15.63:0/283486350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc94003a90 0x7fbc94003eb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009b40 tx=0x7fbc940058a0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92ac0a4b40 0x7f92ac1ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92ac135870 0x7f92ac1ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92ac13e720 0x7f92ac06f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac13e190 con 0x7f92ac13e720 2023-12-01T15:43:57.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac130100 con 0x7f92ac135870 2023-12-01T15:43:57.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b2792700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac1cada0 con 0x7f92ac0a4b40 2023-12-01T15:43:57.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b1f91700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92ac13e720 0x7f92ac06f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b1f91700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92ac13e720 0x7f92ac06f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36050/0 (socket says 172.21.15.63:36050) 2023-12-01T15:43:57.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b1f91700 1 -- 172.21.15.63:0/3917339037 learned_addr learned my addr 172.21.15.63:0/3917339037 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:57.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcb0d1c700 1 -- 172.21.15.63:0/283486350 reap_dead start 2023-12-01T15:43:57.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b0f8f700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92ac135870 0x7f92ac1ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b1790700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92ac0a4b40 0x7f92ac1ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fece09a9700 1 -- 172.21.15.63:0/2290182643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecdc135c70 msgr2=0x7fecdc099170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fece09a9700 1 --2- 172.21.15.63:0/2290182643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecdc135c70 0x7fecdc099170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009850 tx=0x7fecd0009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:57.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcb151d700 1 -- 172.21.15.63:0/283486350 shutdown_connections 2023-12-01T15:43:57.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b1f91700 1 -- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92ac0a4b40 msgr2=0x7f92ac1ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b1f91700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92ac0a4b40 0x7f92ac1ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcb151d700 1 -- 172.21.15.63:0/283486350 >> 172.21.15.63:0/283486350 conn(0x7fbcac0a85a0 msgr2=0x7fbcac0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:57.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b1f91700 1 -- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92ac135870 msgr2=0x7f92ac1ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b1f91700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92ac135870 0x7f92ac1ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b1f91700 1 -- 172.21.15.63:0/3917339037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a8009570 con 0x7f92ac13e720 2023-12-01T15:43:57.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcb151d700 1 -- 172.21.15.63:0/283486350 shutdown_connections 2023-12-01T15:43:57.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b0f8f700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92ac135870 0x7f92ac1ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:57.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7fbcb151d700 1 -- 172.21.15.63:0/283486350 wait complete. 2023-12-01T15:43:57.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.032+0000 7f92b1f91700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92ac13e720 0x7f92ac06f9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f92a400cb50 tx=0x7f92a400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 -- 172.21.15.63:0/2290182643 shutdown_connections 2023-12-01T15:43:57.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 --2- 172.21.15.63:0/2290182643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecdc135c70 0x7fecdc099170 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 -- 172.21.15.63:0/2290182643 >> 172.21.15.63:0/2290182643 conn(0x7fecdc0a5a10 msgr2=0x7fecdc0a5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 -- 172.21.15.63:0/2290182643 shutdown_connections 2023-12-01T15:43:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 -- 172.21.15.63:0/2290182643 wait complete. 2023-12-01T15:43:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7f92a1ffb700 1 -- 172.21.15.63:0/3917339037 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4003c20 con 0x7f92ac13e720 2023-12-01T15:43:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7f92a1ffb700 1 -- 172.21.15.63:0/3917339037 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a4003d80 con 0x7f92ac13e720 2023-12-01T15:43:57.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7f92b2792700 1 -- 172.21.15.63:0/3917339037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ac1c9df0 con 0x7f92ac13e720 2023-12-01T15:43:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7f92a1ffb700 1 -- 172.21.15.63:0/3917339037 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a400ab70 con 0x7f92ac13e720 2023-12-01T15:43:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7f92b2792700 1 -- 172.21.15.63:0/3917339037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac130780 con 0x7f92ac13e720 2023-12-01T15:43:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb151d700 1 Processor -- start 2023-12-01T15:43:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb151d700 1 -- start start 2023-12-01T15:43:57.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 Processor -- start 2023-12-01T15:43:57.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 -- start start 2023-12-01T15:43:57.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb151d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac1226f0 0x7fbcac1cf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb151d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcac1369a0 0x7fbcac1cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb151d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcac1d0290 0x7fbcac135290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7f92b2792700 1 -- 172.21.15.63:0/3917339037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac065fb0 con 0x7f92ac13e720 2023-12-01T15:43:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb151d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac1d06e0 con 0x7fbcac1d0290 2023-12-01T15:43:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb151d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac120fc0 con 0x7fbcac1369a0 2023-12-01T15:43:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb151d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac071690 con 0x7fbcac1226f0 2023-12-01T15:43:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb0d1c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcac1d0290 0x7fbcac135290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb0d1c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcac1d0290 0x7fbcac135290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36054/0 (socket says 172.21.15.63:36054) 2023-12-01T15:43:57.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb0d1c700 1 -- 172.21.15.63:0/2162032367 learned_addr learned my addr 172.21.15.63:0/2162032367 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:57.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcabfff700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac1226f0 0x7fbcac1cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecdc135890 0x7fecdc131890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecdc135c70 0x7fecdc131dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fecdc13e910 0x7fecdc132310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc071310 con 0x7fecdc135890 2023-12-01T15:43:57.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0a3da0 con 0x7fecdc135c70 2023-12-01T15:43:57.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc09fea0 con 0x7fecdc13e910 2023-12-01T15:43:57.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb0d1c700 1 -- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac1226f0 msgr2=0x7fbcac1cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb0d1c700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac1226f0 0x7fbcac1cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb0d1c700 1 -- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcac1369a0 msgr2=0x7fbcac1cfd50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-01T15:43:57.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb0d1c700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcac1369a0 0x7fbcac1cfd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb0d1c700 1 -- 172.21.15.63:0/2162032367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac071930 con 0x7fbcac1d0290 2023-12-01T15:43:57.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fecd9d9b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecdc135c70 0x7fecdc131dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fecdad9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fecdc13e910 0x7fecdc132310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fecd9d9b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecdc135c70 0x7fecdc131dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:43368/0 (socket says 172.21.15.63:43368) 2023-12-01T15:43:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fecd9d9b700 1 -- 172.21.15.63:0/726444571 learned_addr learned my addr 172.21.15.63:0/726444571 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fbcb0d1c700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcac1d0290 0x7fbcac135290 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbcac137f60 tx=0x7fbca40111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fecdad9d700 1 -- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecdc135c70 msgr2=0x7fecdc131dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fecdad9d700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecdc135c70 0x7fecdc131dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fecdad9d700 1 -- 172.21.15.63:0/726444571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecdc135890 msgr2=0x7fecdc131890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-01T15:43:57.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fecdad9d700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecdc135890 0x7fecdc131890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fecdad9d700 1 -- 172.21.15.63:0/726444571 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00094b0 con 0x7fecdc13e910 2023-12-01T15:43:57.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7f92a1ffb700 1 -- 172.21.15.63:0/3917339037 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f92a400acd0 con 0x7f92ac13e720 2023-12-01T15:43:57.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fecdad9d700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fecdc13e910 0x7fecdc132310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c3e0 tx=0x7feccc00c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7f92a1ffb700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9290065ad0 0x7f9290067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7feccaffd700 1 -- 172.21.15.63:0/726444571 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc004aa0 con 0x7fecdc13e910 2023-12-01T15:43:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7f92a1ffb700 1 -- 172.21.15.63:0/3917339037 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f92a40835c0 con 0x7f92ac13e720 2023-12-01T15:43:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.036+0000 7fece09a9700 1 -- 172.21.15.63:0/726444571 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc09fa70 con 0x7fecdc13e910 2023-12-01T15:43:57.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7feccaffd700 1 -- 172.21.15.63:0/726444571 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc004c20 con 0x7fecdc13e910 2023-12-01T15:43:57.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7feccaffd700 1 -- 172.21.15.63:0/726444571 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0070d0 con 0x7fecdc13e910 2023-12-01T15:43:57.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7f92b1790700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9290065ad0 0x7f9290067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7f92b1790700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9290065ad0 0x7f9290067f90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92ac070b10 tx=0x7f929c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7fece09a9700 1 -- 172.21.15.63:0/726444571 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc09b0c0 con 0x7fecdc13e910 2023-12-01T15:43:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7feccaffd700 1 -- 172.21.15.63:0/726444571 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feccc007230 con 0x7fecdc13e910 2023-12-01T15:43:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7feccaffd700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fecc4065d50 0x7fecc4068210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7feccaffd700 1 -- 172.21.15.63:0/726444571 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7feccc0827c0 con 0x7fecdc13e910 2023-12-01T15:43:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7fbca8ff9700 1 -- 172.21.15.63:0/2162032367 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca400e030 con 0x7fbcac1d0290 2023-12-01T15:43:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7fbca8ff9700 1 -- 172.21.15.63:0/2162032367 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca4011a60 con 0x7fbcac1d0290 2023-12-01T15:43:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7fbcb151d700 1 -- 172.21.15.63:0/2162032367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac121c30 con 0x7fbcac1d0290 2023-12-01T15:43:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.040+0000 7fbca8ff9700 1 -- 172.21.15.63:0/2162032367 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4011e10 con 0x7fbcac1d0290 2023-12-01T15:43:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.044+0000 7f92a1ffb700 1 -- 172.21.15.63:0/3917339037 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f92a4051650 con 0x7f92ac13e720 2023-12-01T15:43:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.044+0000 7fece09a9700 1 -- 172.21.15.63:0/726444571 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc0730d0 con 0x7fecdc13e910 2023-12-01T15:43:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.044+0000 7fecda59c700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fecc4065d50 0x7fecc4068210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.044+0000 7fbcb151d700 1 -- 172.21.15.63:0/2162032367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac136550 con 0x7fbcac1d0290 2023-12-01T15:43:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.044+0000 7fecda59c700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fecc4065d50 0x7fecc4068210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fecd40012e0 tx=0x7fecd4001710 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.044+0000 7fbcb151d700 1 -- 172.21.15.63:0/2162032367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac065fb0 con 0x7fbcac1d0290 2023-12-01T15:43:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.044+0000 7fbca8ff9700 1 -- 172.21.15.63:0/2162032367 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbca4016470 con 0x7fbcac1d0290 2023-12-01T15:43:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.044+0000 7fbca8ff9700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbc98065ad0 0x7fbc98067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.044+0000 7fbca8ff9700 1 -- 172.21.15.63:0/2162032367 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fbca400f070 con 0x7fbcac1d0290 2023-12-01T15:43:57.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.044+0000 7fbcabfff700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbc98065ad0 0x7fbc98067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.048+0000 7fbcabfff700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbc98065ad0 0x7fbc98067f90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0090b0 tx=0x7fbc9c01f040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.048+0000 7fbca8ff9700 1 -- 172.21.15.63:0/2162032367 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fbca4051810 con 0x7fbcac1d0290 2023-12-01T15:43:57.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.052+0000 7feccaffd700 1 -- 172.21.15.63:0/726444571 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7feccc050650 con 0x7fecdc13e910 2023-12-01T15:43:57.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.140+0000 7f74b9265700 1 -- 172.21.15.63:0/620498169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f74b40a19c0 con 0x7f749c006340 2023-12-01T15:43:57.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.140+0000 7f749b7fe700 1 -- 172.21.15.63:0/620498169 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74b40a19c0 con 0x7f749c006340 2023-12-01T15:43:57.144 INFO:teuthology.orchestra.run.smithi063.stdout:38654705673 2023-12-01T15:43:57.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 -- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f749c06bc60 msgr2=0x7f749c06e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f749c06bc60 0x7f749c06e120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74a4002230 tx=0x7f74a4009040 comp rx=0 tx=0).stop 2023-12-01T15:43:57.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 -- 172.21.15.63:0/620498169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 msgr2=0x7f74b406ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 0x7f74b406ece0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f74a8001930 tx=0x7f74a800da50 comp rx=0 tx=0).stop 2023-12-01T15:43:57.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 -- 172.21.15.63:0/620498169 shutdown_connections 2023-12-01T15:43:57.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f749c06bc60 0x7f749c06e120 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f74b41306b0 0x7f74b4130b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74b406f220 0x7f74b406f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 --2- 172.21.15.63:0/620498169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f749c006340 0x7f74b406ece0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 -- 172.21.15.63:0/620498169 >> 172.21.15.63:0/620498169 conn(0x7f74b40a5a10 msgr2=0x7f74b40a1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:57.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 -- 172.21.15.63:0/620498169 shutdown_connections 2023-12-01T15:43:57.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.144+0000 7f74b9265700 1 -- 172.21.15.63:0/620498169 wait complete. 2023-12-01T15:43:57.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.2 2023-12-01T15:43:57.158 DEBUG:teuthology.parallel:result is None 2023-12-01T15:43:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.216+0000 7fbcb151d700 1 -- 172.21.15.63:0/2162032367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbcac061d90 con 0x7fbcac1d0290 2023-12-01T15:43:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.216+0000 7fbca8ff9700 1 -- 172.21.15.63:0/2162032367 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbca401a020 con 0x7fbcac1d0290 2023-12-01T15:43:57.222 INFO:teuthology.orchestra.run.smithi063.stdout:38654705672 2023-12-01T15:43:57.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 -- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbc98065ad0 msgr2=0x7fbc98067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbc98065ad0 0x7fbc98067f90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0090b0 tx=0x7fbc9c01f040 comp rx=0 tx=0).stop 2023-12-01T15:43:57.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 -- 172.21.15.63:0/2162032367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcac1d0290 msgr2=0x7fbcac135290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcac1d0290 0x7fbcac135290 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbcac137f60 tx=0x7fbca40111d0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 -- 172.21.15.63:0/2162032367 shutdown_connections 2023-12-01T15:43:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbc98065ad0 0x7fbc98067f90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcac1d0290 0x7fbcac135290 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcac1369a0 0x7fbcac1cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 --2- 172.21.15.63:0/2162032367 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcac1226f0 0x7fbcac1cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 -- 172.21.15.63:0/2162032367 >> 172.21.15.63:0/2162032367 conn(0x7fbcac0a85a0 msgr2=0x7fbcac06c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 -- 172.21.15.63:0/2162032367 shutdown_connections 2023-12-01T15:43:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.220+0000 7fbcb151d700 1 -- 172.21.15.63:0/2162032367 wait complete. 2023-12-01T15:43:57.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 -- 172.21.15.63:0/3917339037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f92ac0a4380 con 0x7f92ac13e720 2023-12-01T15:43:57.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92a1ffb700 1 -- 172.21.15.63:0/3917339037 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92a4054c70 con 0x7f92ac13e720 2023-12-01T15:43:57.232 INFO:teuthology.orchestra.run.smithi063.stdout:38654705672 2023-12-01T15:43:57.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 -- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9290065ad0 msgr2=0x7f9290067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9290065ad0 0x7f9290067f90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92ac070b10 tx=0x7f929c009040 comp rx=0 tx=0).stop 2023-12-01T15:43:57.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 -- 172.21.15.63:0/3917339037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92ac13e720 msgr2=0x7f92ac06f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92ac13e720 0x7f92ac06f9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f92a400cb50 tx=0x7f92a400cf10 comp rx=0 tx=0).stop 2023-12-01T15:43:57.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 -- 172.21.15.63:0/3917339037 shutdown_connections 2023-12-01T15:43:57.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9290065ad0 0x7f9290067f90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92ac13e720 0x7f92ac06f9a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92ac135870 0x7f92ac1ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 --2- 172.21.15.63:0/3917339037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92ac0a4b40 0x7f92ac1ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 -- 172.21.15.63:0/3917339037 >> 172.21.15.63:0/3917339037 conn(0x7f92ac0a58a0 msgr2=0x7f92ac0a6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:57.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 -- 172.21.15.63:0/3917339037 shutdown_connections 2023-12-01T15:43:57.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.228+0000 7f92b2792700 1 -- 172.21.15.63:0/3917339037 wait complete. 2023-12-01T15:43:57.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.1 2023-12-01T15:43:57.236 DEBUG:teuthology.parallel:result is None 2023-12-01T15:43:57.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.240+0000 7fece09a9700 1 -- 172.21.15.63:0/726444571 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fecdc0994d0 con 0x7fecdc13e910 2023-12-01T15:43:57.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2023-12-01T15:43:57.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.240+0000 7feccaffd700 1 -- 172.21.15.63:0/726444571 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feccc053c70 con 0x7fecdc13e910 2023-12-01T15:43:57.246 INFO:teuthology.orchestra.run.smithi063.stdout:38654705672 2023-12-01T15:43:57.246 DEBUG:teuthology.parallel:result is None 2023-12-01T15:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 -- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fecc4065d50 msgr2=0x7fecc4068210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fecc4065d50 0x7fecc4068210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fecd40012e0 tx=0x7fecd4001710 comp rx=0 tx=0).stop 2023-12-01T15:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 -- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fecdc13e910 msgr2=0x7fecdc132310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fecdc13e910 0x7fecdc132310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c3e0 tx=0x7feccc00c6f0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 -- 172.21.15.63:0/726444571 shutdown_connections 2023-12-01T15:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fecc4065d50 0x7fecc4068210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fecdc13e910 0x7fecdc132310 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecdc135c70 0x7fecdc131dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 --2- 172.21.15.63:0/726444571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecdc135890 0x7fecdc131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 -- 172.21.15.63:0/726444571 >> 172.21.15.63:0/726444571 conn(0x7fecdc0a5a10 msgr2=0x7fecdc0a6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 -- 172.21.15.63:0/726444571 shutdown_connections 2023-12-01T15:43:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.244+0000 7fece09a9700 1 -- 172.21.15.63:0/726444571 wait complete. 2023-12-01T15:43:57.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.3 2023-12-01T15:43:57.261 DEBUG:teuthology.parallel:result is None 2023-12-01T15:43:57.261 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-01T15:43:57.262 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T15:43:57.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f651a801700 1 Processor -- start 2023-12-01T15:43:57.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f651a801700 1 -- start start 2023-12-01T15:43:57.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f651a801700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 0x7f65141346b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f651a801700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f65140722a0 0x7f65141428b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f651a801700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65140a5790 con 0x7f6514071750 2023-12-01T15:43:57.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f651a801700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65140a48d0 con 0x7f65140722a0 2023-12-01T15:43:57.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f651a801700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65140a42d0 con 0x7f65141342d0 2023-12-01T15:43:57.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f65197ff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 0x7f65141346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f651a000700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f65140722a0 0x7f65141428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f65197ff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 0x7f65141346b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:56148/0 (socket says 172.21.15.63:56148) 2023-12-01T15:43:57.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f65197ff700 1 -- 172.21.15.63:0/3133063600 learned_addr learned my addr 172.21.15.63:0/3133063600 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f65197ff700 1 -- 172.21.15.63:0/3133063600 >> v2:172.21.15.66:3300/0 conn(0x7f65140722a0 msgr2=0x7f65141428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f65197ff700 1 --2- 172.21.15.63:0/3133063600 >> v2:172.21.15.66:3300/0 conn(0x7f65140722a0 0x7f65141428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f65197ff700 1 -- 172.21.15.63:0/3133063600 >> v1:172.21.15.66:6789/0 conn(0x7f6514071750 legacy=0x7f6514071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f65197ff700 1 -- 172.21.15.63:0/3133063600 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65140a4610 con 0x7f65141342d0 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f65197ff700 1 --2- 172.21.15.63:0/3133063600 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 0x7f65141346b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6504009e50 tx=0x7f650400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=888719d2994685ef server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f6513fff700 1 -- 172.21.15.63:0/3133063600 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650400e070 con 0x7f65141342d0 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f6513fff700 1 -- 172.21.15.63:0/3133063600 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650400b910 con 0x7f65141342d0 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.364+0000 7f6513fff700 1 -- 172.21.15.63:0/3133063600 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650400bcc0 con 0x7f65141342d0 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 -- 172.21.15.63:0/3133063600 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 msgr2=0x7f65141346b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 --2- 172.21.15.63:0/3133063600 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 0x7f65141346b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6504009e50 tx=0x7f650400b330 comp rx=0 tx=0).stop 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 -- 172.21.15.63:0/3133063600 shutdown_connections 2023-12-01T15:43:57.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 --2- 172.21.15.63:0/3133063600 >> v2:172.21.15.66:3300/0 conn(0x7f65140722a0 0x7f65141428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 --2- 172.21.15.63:0/3133063600 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 0x7f65141346b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 -- 172.21.15.63:0/3133063600 >> 172.21.15.63:0/3133063600 conn(0x7f65140a9a90 msgr2=0x7f65140a5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:57.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 -- 172.21.15.63:0/3133063600 shutdown_connections 2023-12-01T15:43:57.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 -- 172.21.15.63:0/3133063600 wait complete. 2023-12-01T15:43:57.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 Processor -- start 2023-12-01T15:43:57.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 -- start start 2023-12-01T15:43:57.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6514071750 0x7f651409b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65140722a0 0x7f651409b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 0x7f651409baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651409e380 con 0x7f65140722a0 2023-12-01T15:43:57.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651409e150 con 0x7f6514071750 2023-12-01T15:43:57.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a801700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651409eff0 con 0x7f65141342d0 2023-12-01T15:43:57.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f6518ffe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65140722a0 0x7f651409b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f6518ffe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65140722a0 0x7f651409b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36058/0 (socket says 172.21.15.63:36058) 2023-12-01T15:43:57.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f6518ffe700 1 -- 172.21.15.63:0/1387904616 learned_addr learned my addr 172.21.15.63:0/1387904616 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:57.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f65197ff700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6514071750 0x7f651409b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a000700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 0x7f651409baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f6518ffe700 1 -- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 msgr2=0x7f651409baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f6518ffe700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 0x7f651409baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f6518ffe700 1 -- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6514071750 msgr2=0x7f651409b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f6518ffe700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6514071750 0x7f651409b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f6518ffe700 1 -- 172.21.15.63:0/1387904616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504009b30 con 0x7f65140722a0 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f651a000700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 0x7f651409baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f65197ff700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6514071750 0x7f651409b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.368+0000 7f6518ffe700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65140722a0 0x7f651409b560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f650800c480 tx=0x7f650800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.372+0000 7f6511ffb700 1 -- 172.21.15.63:0/1387904616 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080052d0 con 0x7f65140722a0 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.372+0000 7f6511ffb700 1 -- 172.21.15.63:0/1387904616 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6508005430 con 0x7f65140722a0 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.372+0000 7f651a801700 1 -- 172.21.15.63:0/1387904616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6514138160 con 0x7f65140722a0 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.372+0000 7f6511ffb700 1 -- 172.21.15.63:0/1387904616 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508003930 con 0x7f65140722a0 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.372+0000 7f651a801700 1 -- 172.21.15.63:0/1387904616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651409ed30 con 0x7f65140722a0 2023-12-01T15:43:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.372+0000 7f651a801700 1 -- 172.21.15.63:0/1387904616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6514065fb0 con 0x7f65140722a0 2023-12-01T15:43:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.372+0000 7f6511ffb700 1 -- 172.21.15.63:0/1387904616 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6508003a90 con 0x7f65140722a0 2023-12-01T15:43:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.372+0000 7f6511ffb700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6500065ad0 0x7f6500067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.372+0000 7f6511ffb700 1 -- 172.21.15.63:0/1387904616 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f6508082450 con 0x7f65140722a0 2023-12-01T15:43:57.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.372+0000 7f65197ff700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6500065ad0 0x7f6500067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.376+0000 7f65197ff700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6500065ad0 0x7f6500067f90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f650400b370 tx=0x7f6504009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.380+0000 7f6511ffb700 1 -- 172.21.15.63:0/1387904616 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6508050460 con 0x7f65140722a0 2023-12-01T15:43:57.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.544+0000 7f651a801700 1 -- 172.21.15.63:0/1387904616 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f651406aa00 con 0x7f6500065ad0 2023-12-01T15:43:57.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.560+0000 7f6511ffb700 1 -- 172.21.15.63:0/1387904616 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271298 (secure 0 0 0) 0x7f6504003b40 con 0x7f6500065ad0 2023-12-01T15:43:57.568 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:57.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.564+0000 7f651a801700 1 -- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6500065ad0 msgr2=0x7f6500067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.564+0000 7f651a801700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6500065ad0 0x7f6500067f90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f650400b370 tx=0x7f6504009000 comp rx=0 tx=0).stop 2023-12-01T15:43:57.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.564+0000 7f651a801700 1 -- 172.21.15.63:0/1387904616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65140722a0 msgr2=0x7f651409b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.564+0000 7f651a801700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65140722a0 0x7f651409b560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f650800c480 tx=0x7f650800c840 comp rx=0 tx=0).stop 2023-12-01T15:43:57.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.564+0000 7f651a801700 1 -- 172.21.15.63:0/1387904616 shutdown_connections 2023-12-01T15:43:57.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.564+0000 7f651a801700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6500065ad0 0x7f6500067f90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.564+0000 7f651a801700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65141342d0 0x7f651409baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.564+0000 7f651a801700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65140722a0 0x7f651409b560 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.564+0000 7f651a801700 1 --2- 172.21.15.63:0/1387904616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6514071750 0x7f651409b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.564+0000 7f651a801700 1 -- 172.21.15.63:0/1387904616 >> 172.21.15.63:0/1387904616 conn(0x7f65140a9a90 msgr2=0x7f651413a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:57.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.564+0000 7f651a801700 1 -- 172.21.15.63:0/1387904616 shutdown_connections 2023-12-01T15:43:57.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.568+0000 7f651a801700 1 -- 172.21.15.63:0/1387904616 wait complete. 2023-12-01T15:43:57.572 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T15:43:57.585 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-12-01T15:43:56.372803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109720,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377640,"statfs":{"total":386547056640,"available":386434703360,"internally_reserved":0,"allocated":1957888,"data_stored":1427848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003148"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842184+0000","last_change":"2023-12-01T15:43:45.574989+0000","last_active":"2023-12-01T15:43:46.842184+0000","last_peered":"2023-12-01T15:43:46.842184+0000","last_clean":"2023-12-01T15:43:46.842184+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:43:46.842184+0000","last_undegraded":"2023-12-01T15:43:46.842184+0000","last_fullsized":"2023-12-01T15:43:46.842184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843053+0000","last_change":"2023-12-01T15:43:45.575246+0000","last_active":"2023-12-01T15:43:46.843053+0000","last_peered":"2023-12-01T15:43:46.843053+0000","last_clean":"2023-12-01T15:43:46.843053+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T15:43:46.843053+0000","last_undegraded":"2023-12-01T15:43:46.843053+0000","last_fullsized":"2023-12-01T15:43:46.843053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568537+0000","last_change":"2023-12-01T15:43:45.586026+0000","last_active":"2023-12-01T15:43:46.568537+0000","last_peered":"2023-12-01T15:43:46.568537+0000","last_clean":"2023-12-01T15:43:46.568537+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:43:46.568537+0000","last_undegraded":"2023-12-01T15:43:46.568537+0000","last_fullsized":"2023-12-01T15:43:46.568537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:52:46.242732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843058+0000","last_change":"2023-12-01T15:43:45.573330+0000","last_active":"2023-12-01T15:43:46.843058+0000","last_peered":"2023-12-01T15:43:46.843058+0000","last_clean":"2023-12-01T15:43:46.843058+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:43:46.843058+0000","last_undegraded":"2023-12-01T15:43:46.843058+0000","last_fullsized":"2023-12-01T15:43:46.843058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841670+0000","last_change":"2023-12-01T15:43:45.573581+0000","last_active":"2023-12-01T15:43:46.841670+0000","last_peered":"2023-12-01T15:43:46.841670+0000","last_clean":"2023-12-01T15:43:46.841670+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T15:43:46.841670+0000","last_undegraded":"2023-12-01T15:43:46.841670+0000","last_fullsized":"2023-12-01T15:43:46.841670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567773+0000","last_change":"2023-12-01T15:43:45.587387+0000","last_active":"2023-12-01T15:43:46.567773+0000","last_peered":"2023-12-01T15:43:46.567773+0000","last_clean":"2023-12-01T15:43:46.567773+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T15:43:46.567773+0000","last_undegraded":"2023-12-01T15:43:46.567773+0000","last_fullsized":"2023-12-01T15:43:46.567773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567363+0000","last_change":"2023-12-01T15:43:45.586845+0000","last_active":"2023-12-01T15:43:46.567363+0000","last_peered":"2023-12-01T15:43:46.567363+0000","last_clean":"2023-12-01T15:43:46.567363+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T15:43:46.567363+0000","last_undegraded":"2023-12-01T15:43:46.567363+0000","last_fullsized":"2023-12-01T15:43:46.567363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567330+0000","last_change":"2023-12-01T15:43:45.589296+0000","last_active":"2023-12-01T15:43:46.567330+0000","last_peered":"2023-12-01T15:43:46.567330+0000","last_clean":"2023-12-01T15:43:46.567330+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:43:46.567330+0000","last_undegraded":"2023-12-01T15:43:46.567330+0000","last_fullsized":"2023-12-01T15:43:46.567330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:31:59.832465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841569+0000","last_change":"2023-12-01T15:43:45.574868+0000","last_active":"2023-12-01T15:43:46.841569+0000","last_peered":"2023-12-01T15:43:46.841569+0000","last_clean":"2023-12-01T15:43:46.841569+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:43:46.841569+0000","last_undegraded":"2023-12-01T15:43:46.841569+0000","last_fullsized":"2023-12-01T15:43:46.841569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568612+0000","last_change":"2023-12-01T15:43:45.586227+0000","last_active":"2023-12-01T15:43:46.568612+0000","last_peered":"2023-12-01T15:43:46.568612+0000","last_clean":"2023-12-01T15:43:46.568612+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:43:46.568612+0000","last_undegraded":"2023-12-01T15:43:46.568612+0000","last_fullsized":"2023-12-01T15:43:46.568612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:00:15.540017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842485+0000","last_change":"2023-12-01T15:43:45.581083+0000","last_active":"2023-12-01T15:43:46.842485+0000","last_peered":"2023-12-01T15:43:46.842485+0000","last_clean":"2023-12-01T15:43:46.842485+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:43:46.842485+0000","last_undegraded":"2023-12-01T15:43:46.842485+0000","last_fullsized":"2023-12-01T15:43:46.842485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565931+0000","last_change":"2023-12-01T15:43:45.573173+0000","last_active":"2023-12-01T15:43:46.565931+0000","last_peered":"2023-12-01T15:43:46.565931+0000","last_clean":"2023-12-01T15:43:46.565931+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T15:43:46.565931+0000","last_undegraded":"2023-12-01T15:43:46.565931+0000","last_fullsized":"2023-12-01T15:43:46.565931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840739+0000","last_change":"2023-12-01T15:43:45.566533+0000","last_active":"2023-12-01T15:43:46.840739+0000","last_peered":"2023-12-01T15:43:46.840739+0000","last_clean":"2023-12-01T15:43:46.840739+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T15:43:46.840739+0000","last_undegraded":"2023-12-01T15:43:46.840739+0000","last_fullsized":"2023-12-01T15:43:46.840739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841752+0000","last_change":"2023-12-01T15:43:45.574865+0000","last_active":"2023-12-01T15:43:46.841752+0000","last_peered":"2023-12-01T15:43:46.841752+0000","last_clean":"2023-12-01T15:43:46.841752+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T15:43:46.841752+0000","last_undegraded":"2023-12-01T15:43:46.841752+0000","last_fullsized":"2023-12-01T15:43:46.841752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841669+0000","last_change":"2023-12-01T15:43:45.575488+0000","last_active":"2023-12-01T15:43:46.841669+0000","last_peered":"2023-12-01T15:43:46.841669+0000","last_clean":"2023-12-01T15:43:46.841669+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:43:46.841669+0000","last_undegraded":"2023-12-01T15:43:46.841669+0000","last_fullsized":"2023-12-01T15:43:46.841669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567257+0000","last_change":"2023-12-01T15:43:45.586172+0000","last_active":"2023-12-01T15:43:46.567257+0000","last_peered":"2023-12-01T15:43:46.567257+0000","last_clean":"2023-12-01T15:43:46.567257+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T15:43:46.567257+0000","last_undegraded":"2023-12-01T15:43:46.567257+0000","last_fullsized":"2023-12-01T15:43:46.567257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:23.641161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841715+0000","last_change":"2023-12-01T15:43:45.571920+0000","last_active":"2023-12-01T15:43:46.841715+0000","last_peered":"2023-12-01T15:43:46.841715+0000","last_clean":"2023-12-01T15:43:46.841715+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T15:43:46.841715+0000","last_undegraded":"2023-12-01T15:43:46.841715+0000","last_fullsized":"2023-12-01T15:43:46.841715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568738+0000","last_change":"2023-12-01T15:43:45.587983+0000","last_active":"2023-12-01T15:43:46.568738+0000","last_peered":"2023-12-01T15:43:46.568738+0000","last_clean":"2023-12-01T15:43:46.568738+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T15:43:46.568738+0000","last_undegraded":"2023-12-01T15:43:46.568738+0000","last_fullsized":"2023-12-01T15:43:46.568738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:46:31.135544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841641+0000","last_change":"2023-12-01T15:43:45.580927+0000","last_active":"2023-12-01T15:43:46.841641+0000","last_peered":"2023-12-01T15:43:46.841641+0000","last_clean":"2023-12-01T15:43:46.841641+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T15:43:46.841641+0000","last_undegraded":"2023-12-01T15:43:46.841641+0000","last_fullsized":"2023-12-01T15:43:46.841641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568127+0000","last_change":"2023-12-01T15:43:45.585911+0000","last_active":"2023-12-01T15:43:46.568127+0000","last_peered":"2023-12-01T15:43:46.568127+0000","last_clean":"2023-12-01T15:43:46.568127+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:43:46.568127+0000","last_undegraded":"2023-12-01T15:43:46.568127+0000","last_fullsized":"2023-12-01T15:43:46.568127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:50.215328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842133+0000","last_change":"2023-12-01T15:43:45.577853+0000","last_active":"2023-12-01T15:43:46.842133+0000","last_peered":"2023-12-01T15:43:46.842133+0000","last_clean":"2023-12-01T15:43:46.842133+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T15:43:46.842133+0000","last_undegraded":"2023-12-01T15:43:46.842133+0000","last_fullsized":"2023-12-01T15:43:46.842133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840481+0000","last_change":"2023-12-01T15:43:45.571656+0000","last_active":"2023-12-01T15:43:46.840481+0000","last_peered":"2023-12-01T15:43:46.840481+0000","last_clean":"2023-12-01T15:43:46.840481+0000","last_became_active":"2023-12-01T15:43:45.571345+0000","last_became_peered":"2023-12-01T15:43:45.571345+0000","last_unstale":"2023-12-01T15:43:46.840481+0000","last_undegraded":"2023-12-01T15:43:46.840481+0000","last_fullsized":"2023-12-01T15:43:46.840481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565285+0000","last_change":"2023-12-01T15:43:45.571661+0000","last_active":"2023-12-01T15:43:46.565285+0000","last_peered":"2023-12-01T15:43:46.565285+0000","last_clean":"2023-12-01T15:43:46.565285+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T15:43:46.565285+0000","last_undegraded":"2023-12-01T15:43:46.565285+0000","last_fullsized":"2023-12-01T15:43:46.565285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567380+0000","last_change":"2023-12-01T15:43:45.588988+0000","last_active":"2023-12-01T15:43:46.567380+0000","last_peered":"2023-12-01T15:43:46.567380+0000","last_clean":"2023-12-01T15:43:46.567380+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:43:46.567380+0000","last_undegraded":"2023-12-01T15:43:46.567380+0000","last_fullsized":"2023-12-01T15:43:46.567380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:16:11.702379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566677+0000","last_change":"2023-12-01T15:43:45.583230+0000","last_active":"2023-12-01T15:43:46.566677+0000","last_peered":"2023-12-01T15:43:46.566677+0000","last_clean":"2023-12-01T15:43:46.566677+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T15:43:46.566677+0000","last_undegraded":"2023-12-01T15:43:46.566677+0000","last_fullsized":"2023-12-01T15:43:46.566677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566484+0000","last_change":"2023-12-01T15:43:45.571094+0000","last_active":"2023-12-01T15:43:46.566484+0000","last_peered":"2023-12-01T15:43:46.566484+0000","last_clean":"2023-12-01T15:43:46.566484+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T15:43:46.566484+0000","last_undegraded":"2023-12-01T15:43:46.566484+0000","last_fullsized":"2023-12-01T15:43:46.566484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568844+0000","last_change":"2023-12-01T15:43:45.588871+0000","last_active":"2023-12-01T15:43:46.568844+0000","last_peered":"2023-12-01T15:43:46.568844+0000","last_clean":"2023-12-01T15:43:46.568844+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T15:43:46.568844+0000","last_undegraded":"2023-12-01T15:43:46.568844+0000","last_fullsized":"2023-12-01T15:43:46.568844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:34:06.793940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566378+0000","last_change":"2023-12-01T15:43:45.581308+0000","last_active":"2023-12-01T15:43:46.566378+0000","last_peered":"2023-12-01T15:43:46.566378+0000","last_clean":"2023-12-01T15:43:46.566378+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T15:43:46.566378+0000","last_undegraded":"2023-12-01T15:43:46.566378+0000","last_fullsized":"2023-12-01T15:43:46.566378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841105+0000","last_change":"2023-12-01T15:43:45.573417+0000","last_active":"2023-12-01T15:43:46.841105+0000","last_peered":"2023-12-01T15:43:46.841105+0000","last_clean":"2023-12-01T15:43:46.841105+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T15:43:46.841105+0000","last_undegraded":"2023-12-01T15:43:46.841105+0000","last_fullsized":"2023-12-01T15:43:46.841105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567788+0000","last_change":"2023-12-01T15:43:45.587201+0000","last_active":"2023-12-01T15:43:46.567788+0000","last_peered":"2023-12-01T15:43:46.567788+0000","last_clean":"2023-12-01T15:43:46.567788+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:43:46.567788+0000","last_undegraded":"2023-12-01T15:43:46.567788+0000","last_fullsized":"2023-12-01T15:43:46.567788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565272+0000","last_change":"2023-12-01T15:43:45.575004+0000","last_active":"2023-12-01T15:43:46.565272+0000","last_peered":"2023-12-01T15:43:46.565272+0000","last_clean":"2023-12-01T15:43:46.565272+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T15:43:46.565272+0000","last_undegraded":"2023-12-01T15:43:46.565272+0000","last_fullsized":"2023-12-01T15:43:46.565272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842058+0000","last_change":"2023-12-01T15:43:45.572838+0000","last_active":"2023-12-01T15:43:46.842058+0000","last_peered":"2023-12-01T15:43:46.842058+0000","last_clean":"2023-12-01T15:43:46.842058+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T15:43:46.842058+0000","last_undegraded":"2023-12-01T15:43:46.842058+0000","last_fullsized":"2023-12-01T15:43:46.842058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566010+0000","last_change":"2023-12-01T15:43:45.581131+0000","last_active":"2023-12-01T15:43:46.566010+0000","last_peered":"2023-12-01T15:43:46.566010+0000","last_clean":"2023-12-01T15:43:46.566010+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:43:46.566010+0000","last_undegraded":"2023-12-01T15:43:46.566010+0000","last_fullsized":"2023-12-01T15:43:46.566010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.591056+0000","last_change":"2023-12-01T15:43:45.205685+0000","last_active":"2023-12-01T15:43:45.591056+0000","last_peered":"2023-12-01T15:43:45.591056+0000","last_clean":"2023-12-01T15:43:45.591056+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T15:43:45.591056+0000","last_undegraded":"2023-12-01T15:43:45.591056+0000","last_fullsized":"2023-12-01T15:43:45.591056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568613+0000","last_change":"2023-12-01T15:43:45.587537+0000","last_active":"2023-12-01T15:43:46.568613+0000","last_peered":"2023-12-01T15:43:46.568613+0000","last_clean":"2023-12-01T15:43:46.568613+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:43:46.568613+0000","last_undegraded":"2023-12-01T15:43:46.568613+0000","last_fullsized":"2023-12-01T15:43:46.568613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:53:22.216155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.553424+0000","last_change":"2023-12-01T15:43:45.203521+0000","last_active":"2023-12-01T15:43:45.553424+0000","last_peered":"2023-12-01T15:43:45.553424+0000","last_clean":"2023-12-01T15:43:45.553424+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T15:43:45.553424+0000","last_undegraded":"2023-12-01T15:43:45.553424+0000","last_fullsized":"2023-12-01T15:43:45.553424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842265+0000","last_change":"2023-12-01T15:43:45.566866+0000","last_active":"2023-12-01T15:43:46.842265+0000","last_peered":"2023-12-01T15:43:46.842265+0000","last_clean":"2023-12-01T15:43:46.842265+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:43:46.842265+0000","last_undegraded":"2023-12-01T15:43:46.842265+0000","last_fullsized":"2023-12-01T15:43:46.842265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.572883+0000","last_change":"2023-12-01T15:43:45.205291+0000","last_active":"2023-12-01T15:43:45.572883+0000","last_peered":"2023-12-01T15:43:45.572883+0000","last_clean":"2023-12-01T15:43:45.572883+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T15:43:45.572883+0000","last_undegraded":"2023-12-01T15:43:45.572883+0000","last_fullsized":"2023-12-01T15:43:45.572883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841968+0000","last_change":"2023-12-01T15:43:45.580597+0000","last_active":"2023-12-01T15:43:46.841968+0000","last_peered":"2023-12-01T15:43:46.841968+0000","last_clean":"2023-12-01T15:43:46.841968+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:43:46.841968+0000","last_undegraded":"2023-12-01T15:43:46.841968+0000","last_fullsized":"2023-12-01T15:43:46.841968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.593904+0000","last_change":"2023-12-01T15:43:45.207762+0000","last_active":"2023-12-01T15:43:45.593904+0000","last_peered":"2023-12-01T15:43:45.593904+0000","last_clean":"2023-12-01T15:43:45.593904+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T15:43:45.593904+0000","last_undegraded":"2023-12-01T15:43:45.593904+0000","last_fullsized":"2023-12-01T15:43:45.593904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571832+0000","last_change":"2023-12-01T15:43:45.203999+0000","last_active":"2023-12-01T15:43:45.571832+0000","last_peered":"2023-12-01T15:43:45.571832+0000","last_clean":"2023-12-01T15:43:45.571832+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T15:43:45.571832+0000","last_undegraded":"2023-12-01T15:43:45.571832+0000","last_fullsized":"2023-12-01T15:43:45.571832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567659+0000","last_change":"2023-12-01T15:43:45.589689+0000","last_active":"2023-12-01T15:43:46.567659+0000","last_peered":"2023-12-01T15:43:46.567659+0000","last_clean":"2023-12-01T15:43:46.567659+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:43:46.567659+0000","last_undegraded":"2023-12-01T15:43:46.567659+0000","last_fullsized":"2023-12-01T15:43:46.567659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:40:12.233063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.574715+0000","last_change":"2023-12-01T15:43:45.201303+0000","last_active":"2023-12-01T15:43:45.574715+0000","last_peered":"2023-12-01T15:43:45.574715+0000","last_clean":"2023-12-01T15:43:45.574715+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T15:43:45.574715+0000","last_undegraded":"2023-12-01T15:43:45.574715+0000","last_fullsized":"2023-12-01T15:43:45.574715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842340+0000","last_change":"2023-12-01T15:43:45.573607+0000","last_active":"2023-12-01T15:43:46.842340+0000","last_peered":"2023-12-01T15:43:46.842340+0000","last_clean":"2023-12-01T15:43:46.842340+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:43:46.842340+0000","last_undegraded":"2023-12-01T15:43:46.842340+0000","last_fullsized":"2023-12-01T15:43:46.842340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.587428+0000","last_change":"2023-12-01T15:43:45.207098+0000","last_active":"2023-12-01T15:43:45.587428+0000","last_peered":"2023-12-01T15:43:45.587428+0000","last_clean":"2023-12-01T15:43:45.587428+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T15:43:45.587428+0000","last_undegraded":"2023-12-01T15:43:45.587428+0000","last_fullsized":"2023-12-01T15:43:45.587428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842099+0000","last_change":"2023-12-01T15:43:45.582490+0000","last_active":"2023-12-01T15:43:46.842099+0000","last_peered":"2023-12-01T15:43:46.842099+0000","last_clean":"2023-12-01T15:43:46.842099+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:43:46.842099+0000","last_undegraded":"2023-12-01T15:43:46.842099+0000","last_fullsized":"2023-12-01T15:43:46.842099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:32:00.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.575523+0000","last_change":"2023-12-01T15:43:45.206777+0000","last_active":"2023-12-01T15:43:45.575523+0000","last_peered":"2023-12-01T15:43:45.575523+0000","last_clean":"2023-12-01T15:43:45.575523+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T15:43:45.575523+0000","last_undegraded":"2023-12-01T15:43:45.575523+0000","last_fullsized":"2023-12-01T15:43:45.575523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841297+0000","last_change":"2023-12-01T15:43:45.573244+0000","last_active":"2023-12-01T15:43:46.841297+0000","last_peered":"2023-12-01T15:43:46.841297+0000","last_clean":"2023-12-01T15:43:46.841297+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:43:46.841297+0000","last_undegraded":"2023-12-01T15:43:46.841297+0000","last_fullsized":"2023-12-01T15:43:46.841297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.581110+0000","last_change":"2023-12-01T15:43:45.204182+0000","last_active":"2023-12-01T15:43:45.581110+0000","last_peered":"2023-12-01T15:43:45.581110+0000","last_clean":"2023-12-01T15:43:45.581110+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T15:43:45.581110+0000","last_undegraded":"2023-12-01T15:43:45.581110+0000","last_fullsized":"2023-12-01T15:43:45.581110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568216+0000","last_change":"2023-12-01T15:43:45.587544+0000","last_active":"2023-12-01T15:43:46.568216+0000","last_peered":"2023-12-01T15:43:46.568216+0000","last_clean":"2023-12-01T15:43:46.568216+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T15:43:46.568216+0000","last_undegraded":"2023-12-01T15:43:46.568216+0000","last_fullsized":"2023-12-01T15:43:46.568216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573616+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:43:45.573616+0000","last_peered":"2023-12-01T15:43:45.573616+0000","last_clean":"2023-12-01T15:43:45.573616+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:43:45.573616+0000","last_undegraded":"2023-12-01T15:43:45.573616+0000","last_fullsized":"2023-12-01T15:43:45.573616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568613+0000","last_change":"2023-12-01T15:43:45.587006+0000","last_active":"2023-12-01T15:43:46.568613+0000","last_peered":"2023-12-01T15:43:46.568613+0000","last_clean":"2023-12-01T15:43:46.568613+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:43:46.568613+0000","last_undegraded":"2023-12-01T15:43:46.568613+0000","last_fullsized":"2023-12-01T15:43:46.568613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:51.219271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573182+0000","last_change":"2023-12-01T15:43:45.206261+0000","last_active":"2023-12-01T15:43:45.573182+0000","last_peered":"2023-12-01T15:43:45.573182+0000","last_clean":"2023-12-01T15:43:45.573182+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T15:43:45.573182+0000","last_undegraded":"2023-12-01T15:43:45.573182+0000","last_fullsized":"2023-12-01T15:43:45.573182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843197+0000","last_change":"2023-12-01T15:43:45.575553+0000","last_active":"2023-12-01T15:43:46.843197+0000","last_peered":"2023-12-01T15:43:46.843197+0000","last_clean":"2023-12-01T15:43:46.843197+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T15:43:46.843197+0000","last_undegraded":"2023-12-01T15:43:46.843197+0000","last_fullsized":"2023-12-01T15:43:46.843197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565758+0000","last_change":"2023-12-01T15:43:45.200481+0000","last_active":"2023-12-01T15:43:45.565758+0000","last_peered":"2023-12-01T15:43:45.565758+0000","last_clean":"2023-12-01T15:43:45.565758+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T15:43:45.565758+0000","last_undegraded":"2023-12-01T15:43:45.565758+0000","last_fullsized":"2023-12-01T15:43:45.565758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566765+0000","last_change":"2023-12-01T15:43:45.583342+0000","last_active":"2023-12-01T15:43:46.566765+0000","last_peered":"2023-12-01T15:43:46.566765+0000","last_clean":"2023-12-01T15:43:46.566765+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:43:46.566765+0000","last_undegraded":"2023-12-01T15:43:46.566765+0000","last_fullsized":"2023-12-01T15:43:46.566765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":167,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.576181+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:43:45.576181+0000","last_peered":"2023-12-01T15:43:45.576181+0000","last_clean":"2023-12-01T15:43:45.576181+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:43:45.576181+0000","last_undegraded":"2023-12-01T15:43:45.576181+0000","last_fullsized":"2023-12-01T15:43:45.576181+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:09:18.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573475+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:43:45.573475+0000","last_peered":"2023-12-01T15:43:45.573475+0000","last_clean":"2023-12-01T15:43:45.573475+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:43:45.573475+0000","last_undegraded":"2023-12-01T15:43:45.573475+0000","last_fullsized":"2023-12-01T15:43:45.573475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:10:37.881379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566049+0000","last_change":"2023-12-01T15:43:45.201766+0000","last_active":"2023-12-01T15:43:45.566049+0000","last_peered":"2023-12-01T15:43:45.566049+0000","last_clean":"2023-12-01T15:43:45.566049+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T15:43:45.566049+0000","last_undegraded":"2023-12-01T15:43:45.566049+0000","last_fullsized":"2023-12-01T15:43:45.566049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568848+0000","last_change":"2023-12-01T15:43:45.590436+0000","last_active":"2023-12-01T15:43:46.568848+0000","last_peered":"2023-12-01T15:43:46.568848+0000","last_clean":"2023-12-01T15:43:46.568848+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:43:46.568848+0000","last_undegraded":"2023-12-01T15:43:46.568848+0000","last_fullsized":"2023-12-01T15:43:46.568848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.576059+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:43:45.576059+0000","last_peered":"2023-12-01T15:43:45.576059+0000","last_clean":"2023-12-01T15:43:45.576059+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:43:45.576059+0000","last_undegraded":"2023-12-01T15:43:45.576059+0000","last_fullsized":"2023-12-01T15:43:45.576059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.553541+0000","last_change":"2023-12-01T15:43:45.209138+0000","last_active":"2023-12-01T15:43:45.553541+0000","last_peered":"2023-12-01T15:43:45.553541+0000","last_clean":"2023-12-01T15:43:45.553541+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T15:43:45.553541+0000","last_undegraded":"2023-12-01T15:43:45.553541+0000","last_fullsized":"2023-12-01T15:43:45.553541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842011+0000","last_change":"2023-12-01T15:43:45.571537+0000","last_active":"2023-12-01T15:43:46.842011+0000","last_peered":"2023-12-01T15:43:46.842011+0000","last_clean":"2023-12-01T15:43:46.842011+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T15:43:46.842011+0000","last_undegraded":"2023-12-01T15:43:46.842011+0000","last_fullsized":"2023-12-01T15:43:46.842011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566045+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:43:45.566045+0000","last_peered":"2023-12-01T15:43:45.566045+0000","last_clean":"2023-12-01T15:43:45.566045+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:43:45.566045+0000","last_undegraded":"2023-12-01T15:43:45.566045+0000","last_fullsized":"2023-12-01T15:43:45.566045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:05:36.049760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565894+0000","last_change":"2023-12-01T15:43:45.204466+0000","last_active":"2023-12-01T15:43:45.565894+0000","last_peered":"2023-12-01T15:43:45.565894+0000","last_clean":"2023-12-01T15:43:45.565894+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T15:43:45.565894+0000","last_undegraded":"2023-12-01T15:43:45.565894+0000","last_fullsized":"2023-12-01T15:43:45.565894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566877+0000","last_change":"2023-12-01T15:43:45.583120+0000","last_active":"2023-12-01T15:43:46.566877+0000","last_peered":"2023-12-01T15:43:46.566877+0000","last_clean":"2023-12-01T15:43:46.566877+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:43:46.566877+0000","last_undegraded":"2023-12-01T15:43:46.566877+0000","last_fullsized":"2023-12-01T15:43:46.566877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573724+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:43:45.573724+0000","last_peered":"2023-12-01T15:43:45.573724+0000","last_clean":"2023-12-01T15:43:45.573724+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:43:45.573724+0000","last_undegraded":"2023-12-01T15:43:45.573724+0000","last_fullsized":"2023-12-01T15:43:45.573724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:11:42.240939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.560516+0000","last_change":"2023-12-01T15:43:45.207506+0000","last_active":"2023-12-01T15:43:45.560516+0000","last_peered":"2023-12-01T15:43:45.560516+0000","last_clean":"2023-12-01T15:43:45.560516+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T15:43:45.560516+0000","last_undegraded":"2023-12-01T15:43:45.560516+0000","last_fullsized":"2023-12-01T15:43:45.560516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566104+0000","last_change":"2023-12-01T15:43:45.574596+0000","last_active":"2023-12-01T15:43:46.566104+0000","last_peered":"2023-12-01T15:43:46.566104+0000","last_clean":"2023-12-01T15:43:46.566104+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:43:46.566104+0000","last_undegraded":"2023-12-01T15:43:46.566104+0000","last_fullsized":"2023-12-01T15:43:46.566104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.559471+0000","last_change":"2023-12-01T15:43:45.210575+0000","last_active":"2023-12-01T15:43:45.559471+0000","last_peered":"2023-12-01T15:43:45.559471+0000","last_clean":"2023-12-01T15:43:45.559471+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T15:43:45.559471+0000","last_undegraded":"2023-12-01T15:43:45.559471+0000","last_fullsized":"2023-12-01T15:43:45.559471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566296+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:43:45.566296+0000","last_peered":"2023-12-01T15:43:45.566296+0000","last_clean":"2023-12-01T15:43:45.566296+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:43:45.566296+0000","last_undegraded":"2023-12-01T15:43:45.566296+0000","last_fullsized":"2023-12-01T15:43:45.566296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565752+0000","last_change":"2023-12-01T15:43:45.582851+0000","last_active":"2023-12-01T15:43:46.565752+0000","last_peered":"2023-12-01T15:43:46.565752+0000","last_clean":"2023-12-01T15:43:46.565752+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:43:46.565752+0000","last_undegraded":"2023-12-01T15:43:46.565752+0000","last_fullsized":"2023-12-01T15:43:46.565752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566272+0000","last_change":"2023-12-01T15:43:45.200408+0000","last_active":"2023-12-01T15:43:45.566272+0000","last_peered":"2023-12-01T15:43:45.566272+0000","last_clean":"2023-12-01T15:43:45.566272+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T15:43:45.566272+0000","last_undegraded":"2023-12-01T15:43:45.566272+0000","last_fullsized":"2023-12-01T15:43:45.566272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.578703+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:43:45.578703+0000","last_peered":"2023-12-01T15:43:45.578703+0000","last_clean":"2023-12-01T15:43:45.578703+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:43:45.578703+0000","last_undegraded":"2023-12-01T15:43:45.578703+0000","last_fullsized":"2023-12-01T15:43:45.578703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:50:39.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841404+0000","last_change":"2023-12-01T15:43:45.575493+0000","last_active":"2023-12-01T15:43:46.841404+0000","last_peered":"2023-12-01T15:43:46.841404+0000","last_clean":"2023-12-01T15:43:46.841404+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T15:43:46.841404+0000","last_undegraded":"2023-12-01T15:43:46.841404+0000","last_fullsized":"2023-12-01T15:43:46.841404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:19.706992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.580835+0000","last_change":"2023-12-01T15:43:45.203186+0000","last_active":"2023-12-01T15:43:45.580835+0000","last_peered":"2023-12-01T15:43:45.580835+0000","last_clean":"2023-12-01T15:43:45.580835+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T15:43:45.580835+0000","last_undegraded":"2023-12-01T15:43:45.580835+0000","last_fullsized":"2023-12-01T15:43:45.580835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566535+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:43:45.566535+0000","last_peered":"2023-12-01T15:43:45.566535+0000","last_clean":"2023-12-01T15:43:45.566535+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:43:45.566535+0000","last_undegraded":"2023-12-01T15:43:45.566535+0000","last_fullsized":"2023-12-01T15:43:45.566535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:40:03.704778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840408+0000","last_change":"2023-12-01T15:43:45.566432+0000","last_active":"2023-12-01T15:43:46.840408+0000","last_peered":"2023-12-01T15:43:46.840408+0000","last_clean":"2023-12-01T15:43:46.840408+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:43:46.840408+0000","last_undegraded":"2023-12-01T15:43:46.840408+0000","last_fullsized":"2023-12-01T15:43:46.840408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842376+0000","last_change":"2023-12-01T15:43:45.205286+0000","last_active":"2023-12-01T15:43:46.842376+0000","last_peered":"2023-12-01T15:43:46.842376+0000","last_clean":"2023-12-01T15:43:46.842376+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T15:43:46.842376+0000","last_undegraded":"2023-12-01T15:43:46.842376+0000","last_fullsized":"2023-12-01T15:43:46.842376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.577882+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:43:45.577882+0000","last_peered":"2023-12-01T15:43:45.577882+0000","last_clean":"2023-12-01T15:43:45.577882+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:43:45.577882+0000","last_undegraded":"2023-12-01T15:43:45.577882+0000","last_fullsized":"2023-12-01T15:43:45.577882+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:55:21.181781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841996+0000","last_change":"2023-12-01T15:43:45.581071+0000","last_active":"2023-12-01T15:43:46.841996+0000","last_peered":"2023-12-01T15:43:46.841996+0000","last_clean":"2023-12-01T15:43:46.841996+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T15:43:46.841996+0000","last_undegraded":"2023-12-01T15:43:46.841996+0000","last_fullsized":"2023-12-01T15:43:46.841996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842819+0000","last_change":"2023-12-01T15:43:45.576345+0000","last_active":"2023-12-01T15:43:46.842819+0000","last_peered":"2023-12-01T15:43:46.842819+0000","last_clean":"2023-12-01T15:43:46.842819+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:43:46.842819+0000","last_undegraded":"2023-12-01T15:43:46.842819+0000","last_fullsized":"2023-12-01T15:43:46.842819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:21:55.500677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.593872+0000","last_change":"2023-12-01T15:43:45.208015+0000","last_active":"2023-12-01T15:43:45.593872+0000","last_peered":"2023-12-01T15:43:45.593872+0000","last_clean":"2023-12-01T15:43:45.593872+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T15:43:45.593872+0000","last_undegraded":"2023-12-01T15:43:45.593872+0000","last_fullsized":"2023-12-01T15:43:45.593872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565594+0000","last_change":"2023-12-01T15:43:45.582830+0000","last_active":"2023-12-01T15:43:46.565594+0000","last_peered":"2023-12-01T15:43:46.565594+0000","last_clean":"2023-12-01T15:43:46.565594+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T15:43:46.565594+0000","last_undegraded":"2023-12-01T15:43:46.565594+0000","last_fullsized":"2023-12-01T15:43:46.565594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573539+0000","last_change":"2023-12-01T15:43:45.210538+0000","last_active":"2023-12-01T15:43:45.573539+0000","last_peered":"2023-12-01T15:43:45.573539+0000","last_clean":"2023-12-01T15:43:45.573539+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T15:43:45.573539+0000","last_undegraded":"2023-12-01T15:43:45.573539+0000","last_fullsized":"2023-12-01T15:43:45.573539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.562469+0000","last_change":"2023-12-01T15:43:45.204325+0000","last_active":"2023-12-01T15:43:45.562469+0000","last_peered":"2023-12-01T15:43:45.562469+0000","last_clean":"2023-12-01T15:43:45.562469+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T15:43:45.562469+0000","last_undegraded":"2023-12-01T15:43:45.562469+0000","last_fullsized":"2023-12-01T15:43:45.562469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840881+0000","last_change":"2023-12-01T15:43:45.583931+0000","last_active":"2023-12-01T15:43:46.840881+0000","last_peered":"2023-12-01T15:43:46.840881+0000","last_clean":"2023-12-01T15:43:46.840881+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T15:43:46.840881+0000","last_undegraded":"2023-12-01T15:43:46.840881+0000","last_fullsized":"2023-12-01T15:43:46.840881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:36.724287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.556940+0000","last_change":"2023-12-01T15:43:45.203624+0000","last_active":"2023-12-01T15:43:45.556940+0000","last_peered":"2023-12-01T15:43:45.556940+0000","last_clean":"2023-12-01T15:43:45.556940+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T15:43:45.556940+0000","last_undegraded":"2023-12-01T15:43:45.556940+0000","last_fullsized":"2023-12-01T15:43:45.556940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565039+0000","last_change":"2023-12-01T15:43:45.572933+0000","last_active":"2023-12-01T15:43:46.565039+0000","last_peered":"2023-12-01T15:43:46.565039+0000","last_clean":"2023-12-01T15:43:46.565039+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:43:46.565039+0000","last_undegraded":"2023-12-01T15:43:46.565039+0000","last_fullsized":"2023-12-01T15:43:46.565039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568640+0000","last_change":"2023-12-01T15:43:45.587913+0000","last_active":"2023-12-01T15:43:46.568640+0000","last_peered":"2023-12-01T15:43:46.568640+0000","last_clean":"2023-12-01T15:43:46.568640+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:43:46.568640+0000","last_undegraded":"2023-12-01T15:43:46.568640+0000","last_fullsized":"2023-12-01T15:43:46.568640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:20.675396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565673+0000","last_change":"2023-12-01T15:43:45.205650+0000","last_active":"2023-12-01T15:43:45.565673+0000","last_peered":"2023-12-01T15:43:45.565673+0000","last_clean":"2023-12-01T15:43:45.565673+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:43:45.565673+0000","last_undegraded":"2023-12-01T15:43:45.565673+0000","last_fullsized":"2023-12-01T15:43:45.565673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841953+0000","last_change":"2023-12-01T15:43:45.574378+0000","last_active":"2023-12-01T15:43:46.841953+0000","last_peered":"2023-12-01T15:43:46.841953+0000","last_clean":"2023-12-01T15:43:46.841953+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T15:43:46.841953+0000","last_undegraded":"2023-12-01T15:43:46.841953+0000","last_fullsized":"2023-12-01T15:43:46.841953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565955+0000","last_change":"2023-12-01T15:43:45.200400+0000","last_active":"2023-12-01T15:43:45.565955+0000","last_peered":"2023-12-01T15:43:45.565955+0000","last_clean":"2023-12-01T15:43:45.565955+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:43:45.565955+0000","last_undegraded":"2023-12-01T15:43:45.565955+0000","last_fullsized":"2023-12-01T15:43:45.565955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841820+0000","last_change":"2023-12-01T15:43:45.570253+0000","last_active":"2023-12-01T15:43:46.841820+0000","last_peered":"2023-12-01T15:43:46.841820+0000","last_clean":"2023-12-01T15:43:46.841820+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:43:46.841820+0000","last_undegraded":"2023-12-01T15:43:46.841820+0000","last_fullsized":"2023-12-01T15:43:46.841820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.574389+0000","last_change":"2023-12-01T15:43:45.200975+0000","last_active":"2023-12-01T15:43:45.574389+0000","last_peered":"2023-12-01T15:43:45.574389+0000","last_clean":"2023-12-01T15:43:45.574389+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:43:45.574389+0000","last_undegraded":"2023-12-01T15:43:45.574389+0000","last_fullsized":"2023-12-01T15:43:45.574389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566128+0000","last_change":"2023-12-01T15:43:45.575004+0000","last_active":"2023-12-01T15:43:46.566128+0000","last_peered":"2023-12-01T15:43:46.566128+0000","last_clean":"2023-12-01T15:43:46.566128+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T15:43:46.566128+0000","last_undegraded":"2023-12-01T15:43:46.566128+0000","last_fullsized":"2023-12-01T15:43:46.566128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.569598+0000","last_change":"2023-12-01T15:43:45.208899+0000","last_active":"2023-12-01T15:43:45.569598+0000","last_peered":"2023-12-01T15:43:45.569598+0000","last_clean":"2023-12-01T15:43:45.569598+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T15:43:45.569598+0000","last_undegraded":"2023-12-01T15:43:45.569598+0000","last_fullsized":"2023-12-01T15:43:45.569598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842631+0000","last_change":"2023-12-01T15:43:45.578059+0000","last_active":"2023-12-01T15:43:46.842631+0000","last_peered":"2023-12-01T15:43:46.842631+0000","last_clean":"2023-12-01T15:43:46.842631+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T15:43:46.842631+0000","last_undegraded":"2023-12-01T15:43:46.842631+0000","last_fullsized":"2023-12-01T15:43:46.842631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.570848+0000","last_change":"2023-12-01T15:43:45.203471+0000","last_active":"2023-12-01T15:43:45.570848+0000","last_peered":"2023-12-01T15:43:45.570848+0000","last_clean":"2023-12-01T15:43:45.570848+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T15:43:45.570848+0000","last_undegraded":"2023-12-01T15:43:45.570848+0000","last_fullsized":"2023-12-01T15:43:45.570848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841785+0000","last_change":"2023-12-01T15:43:45.573522+0000","last_active":"2023-12-01T15:43:46.841785+0000","last_peered":"2023-12-01T15:43:46.841785+0000","last_clean":"2023-12-01T15:43:46.841785+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:43:46.841785+0000","last_undegraded":"2023-12-01T15:43:46.841785+0000","last_fullsized":"2023-12-01T15:43:46.841785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.591060+0000","last_change":"2023-12-01T15:43:45.208222+0000","last_active":"2023-12-01T15:43:45.591060+0000","last_peered":"2023-12-01T15:43:45.591060+0000","last_clean":"2023-12-01T15:43:45.591060+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:43:45.591060+0000","last_undegraded":"2023-12-01T15:43:45.591060+0000","last_fullsized":"2023-12-01T15:43:45.591060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840961+0000","last_change":"2023-12-01T15:43:45.571469+0000","last_active":"2023-12-01T15:43:46.840961+0000","last_peered":"2023-12-01T15:43:46.840961+0000","last_clean":"2023-12-01T15:43:46.840961+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:43:46.840961+0000","last_undegraded":"2023-12-01T15:43:46.840961+0000","last_fullsized":"2023-12-01T15:43:46.840961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571989+0000","last_change":"2023-12-01T15:43:45.208256+0000","last_active":"2023-12-01T15:43:45.571989+0000","last_peered":"2023-12-01T15:43:45.571989+0000","last_clean":"2023-12-01T15:43:45.571989+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T15:43:45.571989+0000","last_undegraded":"2023-12-01T15:43:45.571989+0000","last_fullsized":"2023-12-01T15:43:45.571989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841878+0000","last_change":"2023-12-01T15:43:45.575215+0000","last_active":"2023-12-01T15:43:46.841878+0000","last_peered":"2023-12-01T15:43:46.841878+0000","last_clean":"2023-12-01T15:43:46.841878+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:43:46.841878+0000","last_undegraded":"2023-12-01T15:43:46.841878+0000","last_fullsized":"2023-12-01T15:43:46.841878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571407+0000","last_change":"2023-12-01T15:43:45.204599+0000","last_active":"2023-12-01T15:43:45.571407+0000","last_peered":"2023-12-01T15:43:45.571407+0000","last_clean":"2023-12-01T15:43:45.571407+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T15:43:45.571407+0000","last_undegraded":"2023-12-01T15:43:45.571407+0000","last_fullsized":"2023-12-01T15:43:45.571407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":798720,"data_stored":653237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":62307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":176128,"data_stored":60597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":782336,"data_stored":651707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T15:43:57.589 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T15:43:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.696+0000 7f9bb3fff700 1 Processor -- start 2023-12-01T15:43:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.696+0000 7f9bb3fff700 1 -- start start 2023-12-01T15:43:57.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.696+0000 7f9bb3fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9bb41342d0 0x7f9bb41346b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.696+0000 7f9bb3fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9bb40722a0 0x7f9bb41428b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.696+0000 7f9bb3fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40a5790 con 0x7f9bb4071750 2023-12-01T15:43:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.696+0000 7f9bb3fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb40a48d0 con 0x7f9bb40722a0 2023-12-01T15:43:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.696+0000 7f9bb3fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb40a42d0 con 0x7f9bb41342d0 2023-12-01T15:43:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.696+0000 7f9bb37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9bb40722a0 0x7f9bb41428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.696+0000 7f9bb37fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9bb40722a0 0x7f9bb41428b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36070/0 (socket says 172.21.15.63:36070) 2023-12-01T15:43:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb37fe700 1 -- 172.21.15.63:0/3515581580 learned_addr learned my addr 172.21.15.63:0/3515581580 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb2ffd700 1 --2- 172.21.15.63:0/3515581580 >> v2:172.21.15.66:3300/0 conn(0x7f9bb41342d0 0x7f9bb41346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb37fe700 1 -- 172.21.15.63:0/3515581580 >> v2:172.21.15.66:3300/0 conn(0x7f9bb41342d0 msgr2=0x7f9bb41346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:57.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb37fe700 1 --2- 172.21.15.63:0/3515581580 >> v2:172.21.15.66:3300/0 conn(0x7f9bb41342d0 0x7f9bb41346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb37fe700 1 -- 172.21.15.63:0/3515581580 >> v1:172.21.15.66:6789/0 conn(0x7f9bb4071750 legacy=0x7f9bb4071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb37fe700 1 -- 172.21.15.63:0/3515581580 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40a4610 con 0x7f9bb40722a0 2023-12-01T15:43:57.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb37fe700 1 --2- 172.21.15.63:0/3515581580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb40722a0 0x7f9bb41428b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40a5920 tx=0x7f9bac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf107d104ac6fd28 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb1ffb700 1 -- 172.21.15.63:0/3515581580 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00e070 con 0x7f9bb40722a0 2023-12-01T15:43:57.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb1ffb700 1 -- 172.21.15.63:0/3515581580 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac003a40 con 0x7f9bb40722a0 2023-12-01T15:43:57.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb1ffb700 1 -- 172.21.15.63:0/3515581580 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac003df0 con 0x7f9bb40722a0 2023-12-01T15:43:57.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb3fff700 1 -- 172.21.15.63:0/3515581580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb40722a0 msgr2=0x7f9bb41428b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb3fff700 1 --2- 172.21.15.63:0/3515581580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb40722a0 0x7f9bb41428b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40a5920 tx=0x7f9bac00b330 comp rx=0 tx=0).stop 2023-12-01T15:43:57.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb3fff700 1 -- 172.21.15.63:0/3515581580 shutdown_connections 2023-12-01T15:43:57.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb3fff700 1 --2- 172.21.15.63:0/3515581580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb40722a0 0x7f9bb41428b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb3fff700 1 --2- 172.21.15.63:0/3515581580 >> v2:172.21.15.66:3300/0 conn(0x7f9bb41342d0 0x7f9bb41346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb3fff700 1 -- 172.21.15.63:0/3515581580 >> 172.21.15.63:0/3515581580 conn(0x7f9bb40a9a90 msgr2=0x7f9bb40a5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:57.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb3fff700 1 -- 172.21.15.63:0/3515581580 shutdown_connections 2023-12-01T15:43:57.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb3fff700 1 -- 172.21.15.63:0/3515581580 wait complete. 2023-12-01T15:43:57.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb3fff700 1 Processor -- start 2023-12-01T15:43:57.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.700+0000 7f9bb3fff700 1 -- start start 2023-12-01T15:43:57.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bb4071750 0x7f9bb41cf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb40722a0 0x7f9bb41cf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb3fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb41342d0 0x7f9bb41cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb3fff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41be320 con 0x7f9bb40722a0 2023-12-01T15:43:57.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb3fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41bdd80 con 0x7f9bb41342d0 2023-12-01T15:43:57.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41bd980 con 0x7f9bb4071750 2023-12-01T15:43:57.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb27fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb40722a0 0x7f9bb41cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb27fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb40722a0 0x7f9bb41cf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36084/0 (socket says 172.21.15.63:36084) 2023-12-01T15:43:57.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb27fc700 1 -- 172.21.15.63:0/4182467795 learned_addr learned my addr 172.21.15.63:0/4182467795 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:57.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb37fe700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb41342d0 0x7f9bb41cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb2ffd700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bb4071750 0x7f9bb41cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb27fc700 1 -- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bb4071750 msgr2=0x7f9bb41cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb27fc700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bb4071750 0x7f9bb41cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb27fc700 1 -- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb41342d0 msgr2=0x7f9bb41cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb27fc700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb41342d0 0x7f9bb41cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb27fc700 1 -- 172.21.15.63:0/4182467795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac009b30 con 0x7f9bb40722a0 2023-12-01T15:43:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb27fc700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb40722a0 0x7f9bb41cf960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400c4f0 tx=0x7f9ba400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9b9b7fe700 1 -- 172.21.15.63:0/4182467795 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40052d0 con 0x7f9bb40722a0 2023-12-01T15:43:57.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9b9b7fe700 1 -- 172.21.15.63:0/4182467795 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4005430 con 0x7f9bb40722a0 2023-12-01T15:43:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb3fff700 1 -- 172.21.15.63:0/4182467795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb41be0f0 con 0x7f9bb40722a0 2023-12-01T15:43:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb3fff700 1 -- 172.21.15.63:0/4182467795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb41be9a0 con 0x7f9bb40722a0 2023-12-01T15:43:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9b9b7fe700 1 -- 172.21.15.63:0/4182467795 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4003930 con 0x7f9bb40722a0 2023-12-01T15:43:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.704+0000 7f9bb3fff700 1 -- 172.21.15.63:0/4182467795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb41bf140 con 0x7f9bb40722a0 2023-12-01T15:43:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.708+0000 7f9b9b7fe700 1 -- 172.21.15.63:0/4182467795 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9ba4003a90 con 0x7f9bb40722a0 2023-12-01T15:43:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.708+0000 7f9b9b7fe700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9ba0065ad0 0x7f9ba0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.708+0000 7f9b9b7fe700 1 -- 172.21.15.63:0/4182467795 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f9ba4082430 con 0x7f9bb40722a0 2023-12-01T15:43:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.708+0000 7f9bb2ffd700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9ba0065ad0 0x7f9ba0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:57.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.708+0000 7f9bb2ffd700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9ba0065ad0 0x7f9ba0067f90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8007a60 tx=0x7f9ba8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:57.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.716+0000 7f9b9b7fe700 1 -- 172.21.15.63:0/4182467795 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f9ba4050340 con 0x7f9bb40722a0 2023-12-01T15:43:57.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.872+0000 7f9bb3fff700 1 -- 172.21.15.63:0/4182467795 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9bb40a0330 con 0x7f9ba0065ad0 2023-12-01T15:43:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.888+0000 7f9b9b7fe700 1 -- 172.21.15.63:0/4182467795 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271298 (secure 0 0 0) 0x7f9ba8010740 con 0x7f9ba0065ad0 2023-12-01T15:43:57.897 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:57.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.892+0000 7f9bb3fff700 1 -- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9ba0065ad0 msgr2=0x7f9ba0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.892+0000 7f9bb3fff700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9ba0065ad0 0x7f9ba0067f90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8007a60 tx=0x7f9ba8008040 comp rx=0 tx=0).stop 2023-12-01T15:43:57.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.892+0000 7f9bb3fff700 1 -- 172.21.15.63:0/4182467795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb40722a0 msgr2=0x7f9bb41cf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:57.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.892+0000 7f9bb3fff700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb40722a0 0x7f9bb41cf960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400c4f0 tx=0x7f9ba400c800 comp rx=0 tx=0).stop 2023-12-01T15:43:57.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.892+0000 7f9bb3fff700 1 -- 172.21.15.63:0/4182467795 shutdown_connections 2023-12-01T15:43:57.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.892+0000 7f9bb3fff700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9ba0065ad0 0x7f9ba0067f90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.892+0000 7f9bb3fff700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb41342d0 0x7f9bb41cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.892+0000 7f9bb3fff700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb40722a0 0x7f9bb41cf960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.892+0000 7f9bb3fff700 1 --2- 172.21.15.63:0/4182467795 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bb4071750 0x7f9bb41cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.892+0000 7f9bb3fff700 1 -- 172.21.15.63:0/4182467795 >> 172.21.15.63:0/4182467795 conn(0x7f9bb40a9a90 msgr2=0x7f9bb40a2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.896+0000 7f9bb3fff700 1 -- 172.21.15.63:0/4182467795 shutdown_connections 2023-12-01T15:43:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:57.896+0000 7f9bb3fff700 1 -- 172.21.15.63:0/4182467795 wait complete. 2023-12-01T15:43:57.900 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T15:43:57.912 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-12-01T15:43:56.372803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109720,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377640,"statfs":{"total":386547056640,"available":386434703360,"internally_reserved":0,"allocated":1957888,"data_stored":1427848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003148"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842184+0000","last_change":"2023-12-01T15:43:45.574989+0000","last_active":"2023-12-01T15:43:46.842184+0000","last_peered":"2023-12-01T15:43:46.842184+0000","last_clean":"2023-12-01T15:43:46.842184+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:43:46.842184+0000","last_undegraded":"2023-12-01T15:43:46.842184+0000","last_fullsized":"2023-12-01T15:43:46.842184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843053+0000","last_change":"2023-12-01T15:43:45.575246+0000","last_active":"2023-12-01T15:43:46.843053+0000","last_peered":"2023-12-01T15:43:46.843053+0000","last_clean":"2023-12-01T15:43:46.843053+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T15:43:46.843053+0000","last_undegraded":"2023-12-01T15:43:46.843053+0000","last_fullsized":"2023-12-01T15:43:46.843053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568537+0000","last_change":"2023-12-01T15:43:45.586026+0000","last_active":"2023-12-01T15:43:46.568537+0000","last_peered":"2023-12-01T15:43:46.568537+0000","last_clean":"2023-12-01T15:43:46.568537+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:43:46.568537+0000","last_undegraded":"2023-12-01T15:43:46.568537+0000","last_fullsized":"2023-12-01T15:43:46.568537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:52:46.242732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843058+0000","last_change":"2023-12-01T15:43:45.573330+0000","last_active":"2023-12-01T15:43:46.843058+0000","last_peered":"2023-12-01T15:43:46.843058+0000","last_clean":"2023-12-01T15:43:46.843058+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:43:46.843058+0000","last_undegraded":"2023-12-01T15:43:46.843058+0000","last_fullsized":"2023-12-01T15:43:46.843058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841670+0000","last_change":"2023-12-01T15:43:45.573581+0000","last_active":"2023-12-01T15:43:46.841670+0000","last_peered":"2023-12-01T15:43:46.841670+0000","last_clean":"2023-12-01T15:43:46.841670+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T15:43:46.841670+0000","last_undegraded":"2023-12-01T15:43:46.841670+0000","last_fullsized":"2023-12-01T15:43:46.841670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567773+0000","last_change":"2023-12-01T15:43:45.587387+0000","last_active":"2023-12-01T15:43:46.567773+0000","last_peered":"2023-12-01T15:43:46.567773+0000","last_clean":"2023-12-01T15:43:46.567773+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T15:43:46.567773+0000","last_undegraded":"2023-12-01T15:43:46.567773+0000","last_fullsized":"2023-12-01T15:43:46.567773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567363+0000","last_change":"2023-12-01T15:43:45.586845+0000","last_active":"2023-12-01T15:43:46.567363+0000","last_peered":"2023-12-01T15:43:46.567363+0000","last_clean":"2023-12-01T15:43:46.567363+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T15:43:46.567363+0000","last_undegraded":"2023-12-01T15:43:46.567363+0000","last_fullsized":"2023-12-01T15:43:46.567363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567330+0000","last_change":"2023-12-01T15:43:45.589296+0000","last_active":"2023-12-01T15:43:46.567330+0000","last_peered":"2023-12-01T15:43:46.567330+0000","last_clean":"2023-12-01T15:43:46.567330+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:43:46.567330+0000","last_undegraded":"2023-12-01T15:43:46.567330+0000","last_fullsized":"2023-12-01T15:43:46.567330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:31:59.832465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841569+0000","last_change":"2023-12-01T15:43:45.574868+0000","last_active":"2023-12-01T15:43:46.841569+0000","last_peered":"2023-12-01T15:43:46.841569+0000","last_clean":"2023-12-01T15:43:46.841569+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:43:46.841569+0000","last_undegraded":"2023-12-01T15:43:46.841569+0000","last_fullsized":"2023-12-01T15:43:46.841569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568612+0000","last_change":"2023-12-01T15:43:45.586227+0000","last_active":"2023-12-01T15:43:46.568612+0000","last_peered":"2023-12-01T15:43:46.568612+0000","last_clean":"2023-12-01T15:43:46.568612+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:43:46.568612+0000","last_undegraded":"2023-12-01T15:43:46.568612+0000","last_fullsized":"2023-12-01T15:43:46.568612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:00:15.540017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842485+0000","last_change":"2023-12-01T15:43:45.581083+0000","last_active":"2023-12-01T15:43:46.842485+0000","last_peered":"2023-12-01T15:43:46.842485+0000","last_clean":"2023-12-01T15:43:46.842485+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:43:46.842485+0000","last_undegraded":"2023-12-01T15:43:46.842485+0000","last_fullsized":"2023-12-01T15:43:46.842485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565931+0000","last_change":"2023-12-01T15:43:45.573173+0000","last_active":"2023-12-01T15:43:46.565931+0000","last_peered":"2023-12-01T15:43:46.565931+0000","last_clean":"2023-12-01T15:43:46.565931+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T15:43:46.565931+0000","last_undegraded":"2023-12-01T15:43:46.565931+0000","last_fullsized":"2023-12-01T15:43:46.565931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840739+0000","last_change":"2023-12-01T15:43:45.566533+0000","last_active":"2023-12-01T15:43:46.840739+0000","last_peered":"2023-12-01T15:43:46.840739+0000","last_clean":"2023-12-01T15:43:46.840739+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T15:43:46.840739+0000","last_undegraded":"2023-12-01T15:43:46.840739+0000","last_fullsized":"2023-12-01T15:43:46.840739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841752+0000","last_change":"2023-12-01T15:43:45.574865+0000","last_active":"2023-12-01T15:43:46.841752+0000","last_peered":"2023-12-01T15:43:46.841752+0000","last_clean":"2023-12-01T15:43:46.841752+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T15:43:46.841752+0000","last_undegraded":"2023-12-01T15:43:46.841752+0000","last_fullsized":"2023-12-01T15:43:46.841752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841669+0000","last_change":"2023-12-01T15:43:45.575488+0000","last_active":"2023-12-01T15:43:46.841669+0000","last_peered":"2023-12-01T15:43:46.841669+0000","last_clean":"2023-12-01T15:43:46.841669+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:43:46.841669+0000","last_undegraded":"2023-12-01T15:43:46.841669+0000","last_fullsized":"2023-12-01T15:43:46.841669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567257+0000","last_change":"2023-12-01T15:43:45.586172+0000","last_active":"2023-12-01T15:43:46.567257+0000","last_peered":"2023-12-01T15:43:46.567257+0000","last_clean":"2023-12-01T15:43:46.567257+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T15:43:46.567257+0000","last_undegraded":"2023-12-01T15:43:46.567257+0000","last_fullsized":"2023-12-01T15:43:46.567257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:23.641161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841715+0000","last_change":"2023-12-01T15:43:45.571920+0000","last_active":"2023-12-01T15:43:46.841715+0000","last_peered":"2023-12-01T15:43:46.841715+0000","last_clean":"2023-12-01T15:43:46.841715+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T15:43:46.841715+0000","last_undegraded":"2023-12-01T15:43:46.841715+0000","last_fullsized":"2023-12-01T15:43:46.841715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568738+0000","last_change":"2023-12-01T15:43:45.587983+0000","last_active":"2023-12-01T15:43:46.568738+0000","last_peered":"2023-12-01T15:43:46.568738+0000","last_clean":"2023-12-01T15:43:46.568738+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T15:43:46.568738+0000","last_undegraded":"2023-12-01T15:43:46.568738+0000","last_fullsized":"2023-12-01T15:43:46.568738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:46:31.135544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841641+0000","last_change":"2023-12-01T15:43:45.580927+0000","last_active":"2023-12-01T15:43:46.841641+0000","last_peered":"2023-12-01T15:43:46.841641+0000","last_clean":"2023-12-01T15:43:46.841641+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T15:43:46.841641+0000","last_undegraded":"2023-12-01T15:43:46.841641+0000","last_fullsized":"2023-12-01T15:43:46.841641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568127+0000","last_change":"2023-12-01T15:43:45.585911+0000","last_active":"2023-12-01T15:43:46.568127+0000","last_peered":"2023-12-01T15:43:46.568127+0000","last_clean":"2023-12-01T15:43:46.568127+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:43:46.568127+0000","last_undegraded":"2023-12-01T15:43:46.568127+0000","last_fullsized":"2023-12-01T15:43:46.568127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:50.215328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842133+0000","last_change":"2023-12-01T15:43:45.577853+0000","last_active":"2023-12-01T15:43:46.842133+0000","last_peered":"2023-12-01T15:43:46.842133+0000","last_clean":"2023-12-01T15:43:46.842133+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T15:43:46.842133+0000","last_undegraded":"2023-12-01T15:43:46.842133+0000","last_fullsized":"2023-12-01T15:43:46.842133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840481+0000","last_change":"2023-12-01T15:43:45.571656+0000","last_active":"2023-12-01T15:43:46.840481+0000","last_peered":"2023-12-01T15:43:46.840481+0000","last_clean":"2023-12-01T15:43:46.840481+0000","last_became_active":"2023-12-01T15:43:45.571345+0000","last_became_peered":"2023-12-01T15:43:45.571345+0000","last_unstale":"2023-12-01T15:43:46.840481+0000","last_undegraded":"2023-12-01T15:43:46.840481+0000","last_fullsized":"2023-12-01T15:43:46.840481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565285+0000","last_change":"2023-12-01T15:43:45.571661+0000","last_active":"2023-12-01T15:43:46.565285+0000","last_peered":"2023-12-01T15:43:46.565285+0000","last_clean":"2023-12-01T15:43:46.565285+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T15:43:46.565285+0000","last_undegraded":"2023-12-01T15:43:46.565285+0000","last_fullsized":"2023-12-01T15:43:46.565285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567380+0000","last_change":"2023-12-01T15:43:45.588988+0000","last_active":"2023-12-01T15:43:46.567380+0000","last_peered":"2023-12-01T15:43:46.567380+0000","last_clean":"2023-12-01T15:43:46.567380+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:43:46.567380+0000","last_undegraded":"2023-12-01T15:43:46.567380+0000","last_fullsized":"2023-12-01T15:43:46.567380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:16:11.702379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566677+0000","last_change":"2023-12-01T15:43:45.583230+0000","last_active":"2023-12-01T15:43:46.566677+0000","last_peered":"2023-12-01T15:43:46.566677+0000","last_clean":"2023-12-01T15:43:46.566677+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T15:43:46.566677+0000","last_undegraded":"2023-12-01T15:43:46.566677+0000","last_fullsized":"2023-12-01T15:43:46.566677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566484+0000","last_change":"2023-12-01T15:43:45.571094+0000","last_active":"2023-12-01T15:43:46.566484+0000","last_peered":"2023-12-01T15:43:46.566484+0000","last_clean":"2023-12-01T15:43:46.566484+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T15:43:46.566484+0000","last_undegraded":"2023-12-01T15:43:46.566484+0000","last_fullsized":"2023-12-01T15:43:46.566484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568844+0000","last_change":"2023-12-01T15:43:45.588871+0000","last_active":"2023-12-01T15:43:46.568844+0000","last_peered":"2023-12-01T15:43:46.568844+0000","last_clean":"2023-12-01T15:43:46.568844+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T15:43:46.568844+0000","last_undegraded":"2023-12-01T15:43:46.568844+0000","last_fullsized":"2023-12-01T15:43:46.568844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:34:06.793940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566378+0000","last_change":"2023-12-01T15:43:45.581308+0000","last_active":"2023-12-01T15:43:46.566378+0000","last_peered":"2023-12-01T15:43:46.566378+0000","last_clean":"2023-12-01T15:43:46.566378+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T15:43:46.566378+0000","last_undegraded":"2023-12-01T15:43:46.566378+0000","last_fullsized":"2023-12-01T15:43:46.566378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841105+0000","last_change":"2023-12-01T15:43:45.573417+0000","last_active":"2023-12-01T15:43:46.841105+0000","last_peered":"2023-12-01T15:43:46.841105+0000","last_clean":"2023-12-01T15:43:46.841105+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T15:43:46.841105+0000","last_undegraded":"2023-12-01T15:43:46.841105+0000","last_fullsized":"2023-12-01T15:43:46.841105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567788+0000","last_change":"2023-12-01T15:43:45.587201+0000","last_active":"2023-12-01T15:43:46.567788+0000","last_peered":"2023-12-01T15:43:46.567788+0000","last_clean":"2023-12-01T15:43:46.567788+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:43:46.567788+0000","last_undegraded":"2023-12-01T15:43:46.567788+0000","last_fullsized":"2023-12-01T15:43:46.567788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565272+0000","last_change":"2023-12-01T15:43:45.575004+0000","last_active":"2023-12-01T15:43:46.565272+0000","last_peered":"2023-12-01T15:43:46.565272+0000","last_clean":"2023-12-01T15:43:46.565272+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T15:43:46.565272+0000","last_undegraded":"2023-12-01T15:43:46.565272+0000","last_fullsized":"2023-12-01T15:43:46.565272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842058+0000","last_change":"2023-12-01T15:43:45.572838+0000","last_active":"2023-12-01T15:43:46.842058+0000","last_peered":"2023-12-01T15:43:46.842058+0000","last_clean":"2023-12-01T15:43:46.842058+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T15:43:46.842058+0000","last_undegraded":"2023-12-01T15:43:46.842058+0000","last_fullsized":"2023-12-01T15:43:46.842058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566010+0000","last_change":"2023-12-01T15:43:45.581131+0000","last_active":"2023-12-01T15:43:46.566010+0000","last_peered":"2023-12-01T15:43:46.566010+0000","last_clean":"2023-12-01T15:43:46.566010+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:43:46.566010+0000","last_undegraded":"2023-12-01T15:43:46.566010+0000","last_fullsized":"2023-12-01T15:43:46.566010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.591056+0000","last_change":"2023-12-01T15:43:45.205685+0000","last_active":"2023-12-01T15:43:45.591056+0000","last_peered":"2023-12-01T15:43:45.591056+0000","last_clean":"2023-12-01T15:43:45.591056+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T15:43:45.591056+0000","last_undegraded":"2023-12-01T15:43:45.591056+0000","last_fullsized":"2023-12-01T15:43:45.591056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568613+0000","last_change":"2023-12-01T15:43:45.587537+0000","last_active":"2023-12-01T15:43:46.568613+0000","last_peered":"2023-12-01T15:43:46.568613+0000","last_clean":"2023-12-01T15:43:46.568613+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:43:46.568613+0000","last_undegraded":"2023-12-01T15:43:46.568613+0000","last_fullsized":"2023-12-01T15:43:46.568613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:53:22.216155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.553424+0000","last_change":"2023-12-01T15:43:45.203521+0000","last_active":"2023-12-01T15:43:45.553424+0000","last_peered":"2023-12-01T15:43:45.553424+0000","last_clean":"2023-12-01T15:43:45.553424+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T15:43:45.553424+0000","last_undegraded":"2023-12-01T15:43:45.553424+0000","last_fullsized":"2023-12-01T15:43:45.553424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842265+0000","last_change":"2023-12-01T15:43:45.566866+0000","last_active":"2023-12-01T15:43:46.842265+0000","last_peered":"2023-12-01T15:43:46.842265+0000","last_clean":"2023-12-01T15:43:46.842265+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:43:46.842265+0000","last_undegraded":"2023-12-01T15:43:46.842265+0000","last_fullsized":"2023-12-01T15:43:46.842265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.572883+0000","last_change":"2023-12-01T15:43:45.205291+0000","last_active":"2023-12-01T15:43:45.572883+0000","last_peered":"2023-12-01T15:43:45.572883+0000","last_clean":"2023-12-01T15:43:45.572883+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T15:43:45.572883+0000","last_undegraded":"2023-12-01T15:43:45.572883+0000","last_fullsized":"2023-12-01T15:43:45.572883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841968+0000","last_change":"2023-12-01T15:43:45.580597+0000","last_active":"2023-12-01T15:43:46.841968+0000","last_peered":"2023-12-01T15:43:46.841968+0000","last_clean":"2023-12-01T15:43:46.841968+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:43:46.841968+0000","last_undegraded":"2023-12-01T15:43:46.841968+0000","last_fullsized":"2023-12-01T15:43:46.841968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.593904+0000","last_change":"2023-12-01T15:43:45.207762+0000","last_active":"2023-12-01T15:43:45.593904+0000","last_peered":"2023-12-01T15:43:45.593904+0000","last_clean":"2023-12-01T15:43:45.593904+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T15:43:45.593904+0000","last_undegraded":"2023-12-01T15:43:45.593904+0000","last_fullsized":"2023-12-01T15:43:45.593904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571832+0000","last_change":"2023-12-01T15:43:45.203999+0000","last_active":"2023-12-01T15:43:45.571832+0000","last_peered":"2023-12-01T15:43:45.571832+0000","last_clean":"2023-12-01T15:43:45.571832+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T15:43:45.571832+0000","last_undegraded":"2023-12-01T15:43:45.571832+0000","last_fullsized":"2023-12-01T15:43:45.571832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.567659+0000","last_change":"2023-12-01T15:43:45.589689+0000","last_active":"2023-12-01T15:43:46.567659+0000","last_peered":"2023-12-01T15:43:46.567659+0000","last_clean":"2023-12-01T15:43:46.567659+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:43:46.567659+0000","last_undegraded":"2023-12-01T15:43:46.567659+0000","last_fullsized":"2023-12-01T15:43:46.567659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:40:12.233063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.574715+0000","last_change":"2023-12-01T15:43:45.201303+0000","last_active":"2023-12-01T15:43:45.574715+0000","last_peered":"2023-12-01T15:43:45.574715+0000","last_clean":"2023-12-01T15:43:45.574715+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T15:43:45.574715+0000","last_undegraded":"2023-12-01T15:43:45.574715+0000","last_fullsized":"2023-12-01T15:43:45.574715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842340+0000","last_change":"2023-12-01T15:43:45.573607+0000","last_active":"2023-12-01T15:43:46.842340+0000","last_peered":"2023-12-01T15:43:46.842340+0000","last_clean":"2023-12-01T15:43:46.842340+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:43:46.842340+0000","last_undegraded":"2023-12-01T15:43:46.842340+0000","last_fullsized":"2023-12-01T15:43:46.842340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.587428+0000","last_change":"2023-12-01T15:43:45.207098+0000","last_active":"2023-12-01T15:43:45.587428+0000","last_peered":"2023-12-01T15:43:45.587428+0000","last_clean":"2023-12-01T15:43:45.587428+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T15:43:45.587428+0000","last_undegraded":"2023-12-01T15:43:45.587428+0000","last_fullsized":"2023-12-01T15:43:45.587428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842099+0000","last_change":"2023-12-01T15:43:45.582490+0000","last_active":"2023-12-01T15:43:46.842099+0000","last_peered":"2023-12-01T15:43:46.842099+0000","last_clean":"2023-12-01T15:43:46.842099+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:43:46.842099+0000","last_undegraded":"2023-12-01T15:43:46.842099+0000","last_fullsized":"2023-12-01T15:43:46.842099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:32:00.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.575523+0000","last_change":"2023-12-01T15:43:45.206777+0000","last_active":"2023-12-01T15:43:45.575523+0000","last_peered":"2023-12-01T15:43:45.575523+0000","last_clean":"2023-12-01T15:43:45.575523+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T15:43:45.575523+0000","last_undegraded":"2023-12-01T15:43:45.575523+0000","last_fullsized":"2023-12-01T15:43:45.575523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841297+0000","last_change":"2023-12-01T15:43:45.573244+0000","last_active":"2023-12-01T15:43:46.841297+0000","last_peered":"2023-12-01T15:43:46.841297+0000","last_clean":"2023-12-01T15:43:46.841297+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:43:46.841297+0000","last_undegraded":"2023-12-01T15:43:46.841297+0000","last_fullsized":"2023-12-01T15:43:46.841297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.581110+0000","last_change":"2023-12-01T15:43:45.204182+0000","last_active":"2023-12-01T15:43:45.581110+0000","last_peered":"2023-12-01T15:43:45.581110+0000","last_clean":"2023-12-01T15:43:45.581110+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T15:43:45.581110+0000","last_undegraded":"2023-12-01T15:43:45.581110+0000","last_fullsized":"2023-12-01T15:43:45.581110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568216+0000","last_change":"2023-12-01T15:43:45.587544+0000","last_active":"2023-12-01T15:43:46.568216+0000","last_peered":"2023-12-01T15:43:46.568216+0000","last_clean":"2023-12-01T15:43:46.568216+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T15:43:46.568216+0000","last_undegraded":"2023-12-01T15:43:46.568216+0000","last_fullsized":"2023-12-01T15:43:46.568216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573616+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:43:45.573616+0000","last_peered":"2023-12-01T15:43:45.573616+0000","last_clean":"2023-12-01T15:43:45.573616+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:43:45.573616+0000","last_undegraded":"2023-12-01T15:43:45.573616+0000","last_fullsized":"2023-12-01T15:43:45.573616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568613+0000","last_change":"2023-12-01T15:43:45.587006+0000","last_active":"2023-12-01T15:43:46.568613+0000","last_peered":"2023-12-01T15:43:46.568613+0000","last_clean":"2023-12-01T15:43:46.568613+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:43:46.568613+0000","last_undegraded":"2023-12-01T15:43:46.568613+0000","last_fullsized":"2023-12-01T15:43:46.568613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:51.219271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573182+0000","last_change":"2023-12-01T15:43:45.206261+0000","last_active":"2023-12-01T15:43:45.573182+0000","last_peered":"2023-12-01T15:43:45.573182+0000","last_clean":"2023-12-01T15:43:45.573182+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T15:43:45.573182+0000","last_undegraded":"2023-12-01T15:43:45.573182+0000","last_fullsized":"2023-12-01T15:43:45.573182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.843197+0000","last_change":"2023-12-01T15:43:45.575553+0000","last_active":"2023-12-01T15:43:46.843197+0000","last_peered":"2023-12-01T15:43:46.843197+0000","last_clean":"2023-12-01T15:43:46.843197+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T15:43:46.843197+0000","last_undegraded":"2023-12-01T15:43:46.843197+0000","last_fullsized":"2023-12-01T15:43:46.843197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565758+0000","last_change":"2023-12-01T15:43:45.200481+0000","last_active":"2023-12-01T15:43:45.565758+0000","last_peered":"2023-12-01T15:43:45.565758+0000","last_clean":"2023-12-01T15:43:45.565758+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T15:43:45.565758+0000","last_undegraded":"2023-12-01T15:43:45.565758+0000","last_fullsized":"2023-12-01T15:43:45.565758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566765+0000","last_change":"2023-12-01T15:43:45.583342+0000","last_active":"2023-12-01T15:43:46.566765+0000","last_peered":"2023-12-01T15:43:46.566765+0000","last_clean":"2023-12-01T15:43:46.566765+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:43:46.566765+0000","last_undegraded":"2023-12-01T15:43:46.566765+0000","last_fullsized":"2023-12-01T15:43:46.566765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":167,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.576181+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:43:45.576181+0000","last_peered":"2023-12-01T15:43:45.576181+0000","last_clean":"2023-12-01T15:43:45.576181+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:43:45.576181+0000","last_undegraded":"2023-12-01T15:43:45.576181+0000","last_fullsized":"2023-12-01T15:43:45.576181+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:09:18.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573475+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:43:45.573475+0000","last_peered":"2023-12-01T15:43:45.573475+0000","last_clean":"2023-12-01T15:43:45.573475+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:43:45.573475+0000","last_undegraded":"2023-12-01T15:43:45.573475+0000","last_fullsized":"2023-12-01T15:43:45.573475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:10:37.881379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566049+0000","last_change":"2023-12-01T15:43:45.201766+0000","last_active":"2023-12-01T15:43:45.566049+0000","last_peered":"2023-12-01T15:43:45.566049+0000","last_clean":"2023-12-01T15:43:45.566049+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T15:43:45.566049+0000","last_undegraded":"2023-12-01T15:43:45.566049+0000","last_fullsized":"2023-12-01T15:43:45.566049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568848+0000","last_change":"2023-12-01T15:43:45.590436+0000","last_active":"2023-12-01T15:43:46.568848+0000","last_peered":"2023-12-01T15:43:46.568848+0000","last_clean":"2023-12-01T15:43:46.568848+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:43:46.568848+0000","last_undegraded":"2023-12-01T15:43:46.568848+0000","last_fullsized":"2023-12-01T15:43:46.568848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.576059+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:43:45.576059+0000","last_peered":"2023-12-01T15:43:45.576059+0000","last_clean":"2023-12-01T15:43:45.576059+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:43:45.576059+0000","last_undegraded":"2023-12-01T15:43:45.576059+0000","last_fullsized":"2023-12-01T15:43:45.576059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.553541+0000","last_change":"2023-12-01T15:43:45.209138+0000","last_active":"2023-12-01T15:43:45.553541+0000","last_peered":"2023-12-01T15:43:45.553541+0000","last_clean":"2023-12-01T15:43:45.553541+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T15:43:45.553541+0000","last_undegraded":"2023-12-01T15:43:45.553541+0000","last_fullsized":"2023-12-01T15:43:45.553541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842011+0000","last_change":"2023-12-01T15:43:45.571537+0000","last_active":"2023-12-01T15:43:46.842011+0000","last_peered":"2023-12-01T15:43:46.842011+0000","last_clean":"2023-12-01T15:43:46.842011+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T15:43:46.842011+0000","last_undegraded":"2023-12-01T15:43:46.842011+0000","last_fullsized":"2023-12-01T15:43:46.842011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566045+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:43:45.566045+0000","last_peered":"2023-12-01T15:43:45.566045+0000","last_clean":"2023-12-01T15:43:45.566045+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:43:45.566045+0000","last_undegraded":"2023-12-01T15:43:45.566045+0000","last_fullsized":"2023-12-01T15:43:45.566045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:05:36.049760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565894+0000","last_change":"2023-12-01T15:43:45.204466+0000","last_active":"2023-12-01T15:43:45.565894+0000","last_peered":"2023-12-01T15:43:45.565894+0000","last_clean":"2023-12-01T15:43:45.565894+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T15:43:45.565894+0000","last_undegraded":"2023-12-01T15:43:45.565894+0000","last_fullsized":"2023-12-01T15:43:45.565894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566877+0000","last_change":"2023-12-01T15:43:45.583120+0000","last_active":"2023-12-01T15:43:46.566877+0000","last_peered":"2023-12-01T15:43:46.566877+0000","last_clean":"2023-12-01T15:43:46.566877+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:43:46.566877+0000","last_undegraded":"2023-12-01T15:43:46.566877+0000","last_fullsized":"2023-12-01T15:43:46.566877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573724+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:43:45.573724+0000","last_peered":"2023-12-01T15:43:45.573724+0000","last_clean":"2023-12-01T15:43:45.573724+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:43:45.573724+0000","last_undegraded":"2023-12-01T15:43:45.573724+0000","last_fullsized":"2023-12-01T15:43:45.573724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:11:42.240939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.560516+0000","last_change":"2023-12-01T15:43:45.207506+0000","last_active":"2023-12-01T15:43:45.560516+0000","last_peered":"2023-12-01T15:43:45.560516+0000","last_clean":"2023-12-01T15:43:45.560516+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T15:43:45.560516+0000","last_undegraded":"2023-12-01T15:43:45.560516+0000","last_fullsized":"2023-12-01T15:43:45.560516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566104+0000","last_change":"2023-12-01T15:43:45.574596+0000","last_active":"2023-12-01T15:43:46.566104+0000","last_peered":"2023-12-01T15:43:46.566104+0000","last_clean":"2023-12-01T15:43:46.566104+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:43:46.566104+0000","last_undegraded":"2023-12-01T15:43:46.566104+0000","last_fullsized":"2023-12-01T15:43:46.566104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.559471+0000","last_change":"2023-12-01T15:43:45.210575+0000","last_active":"2023-12-01T15:43:45.559471+0000","last_peered":"2023-12-01T15:43:45.559471+0000","last_clean":"2023-12-01T15:43:45.559471+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T15:43:45.559471+0000","last_undegraded":"2023-12-01T15:43:45.559471+0000","last_fullsized":"2023-12-01T15:43:45.559471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566296+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:43:45.566296+0000","last_peered":"2023-12-01T15:43:45.566296+0000","last_clean":"2023-12-01T15:43:45.566296+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:43:45.566296+0000","last_undegraded":"2023-12-01T15:43:45.566296+0000","last_fullsized":"2023-12-01T15:43:45.566296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565752+0000","last_change":"2023-12-01T15:43:45.582851+0000","last_active":"2023-12-01T15:43:46.565752+0000","last_peered":"2023-12-01T15:43:46.565752+0000","last_clean":"2023-12-01T15:43:46.565752+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:43:46.565752+0000","last_undegraded":"2023-12-01T15:43:46.565752+0000","last_fullsized":"2023-12-01T15:43:46.565752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566272+0000","last_change":"2023-12-01T15:43:45.200408+0000","last_active":"2023-12-01T15:43:45.566272+0000","last_peered":"2023-12-01T15:43:45.566272+0000","last_clean":"2023-12-01T15:43:45.566272+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T15:43:45.566272+0000","last_undegraded":"2023-12-01T15:43:45.566272+0000","last_fullsized":"2023-12-01T15:43:45.566272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.578703+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:43:45.578703+0000","last_peered":"2023-12-01T15:43:45.578703+0000","last_clean":"2023-12-01T15:43:45.578703+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:43:45.578703+0000","last_undegraded":"2023-12-01T15:43:45.578703+0000","last_fullsized":"2023-12-01T15:43:45.578703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:50:39.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841404+0000","last_change":"2023-12-01T15:43:45.575493+0000","last_active":"2023-12-01T15:43:46.841404+0000","last_peered":"2023-12-01T15:43:46.841404+0000","last_clean":"2023-12-01T15:43:46.841404+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T15:43:46.841404+0000","last_undegraded":"2023-12-01T15:43:46.841404+0000","last_fullsized":"2023-12-01T15:43:46.841404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:19.706992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.580835+0000","last_change":"2023-12-01T15:43:45.203186+0000","last_active":"2023-12-01T15:43:45.580835+0000","last_peered":"2023-12-01T15:43:45.580835+0000","last_clean":"2023-12-01T15:43:45.580835+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T15:43:45.580835+0000","last_undegraded":"2023-12-01T15:43:45.580835+0000","last_fullsized":"2023-12-01T15:43:45.580835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.566535+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:43:45.566535+0000","last_peered":"2023-12-01T15:43:45.566535+0000","last_clean":"2023-12-01T15:43:45.566535+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:43:45.566535+0000","last_undegraded":"2023-12-01T15:43:45.566535+0000","last_fullsized":"2023-12-01T15:43:45.566535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:40:03.704778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840408+0000","last_change":"2023-12-01T15:43:45.566432+0000","last_active":"2023-12-01T15:43:46.840408+0000","last_peered":"2023-12-01T15:43:46.840408+0000","last_clean":"2023-12-01T15:43:46.840408+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:43:46.840408+0000","last_undegraded":"2023-12-01T15:43:46.840408+0000","last_fullsized":"2023-12-01T15:43:46.840408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842376+0000","last_change":"2023-12-01T15:43:45.205286+0000","last_active":"2023-12-01T15:43:46.842376+0000","last_peered":"2023-12-01T15:43:46.842376+0000","last_clean":"2023-12-01T15:43:46.842376+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T15:43:46.842376+0000","last_undegraded":"2023-12-01T15:43:46.842376+0000","last_fullsized":"2023-12-01T15:43:46.842376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.577882+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:43:45.577882+0000","last_peered":"2023-12-01T15:43:45.577882+0000","last_clean":"2023-12-01T15:43:45.577882+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:43:45.577882+0000","last_undegraded":"2023-12-01T15:43:45.577882+0000","last_fullsized":"2023-12-01T15:43:45.577882+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:55:21.181781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841996+0000","last_change":"2023-12-01T15:43:45.581071+0000","last_active":"2023-12-01T15:43:46.841996+0000","last_peered":"2023-12-01T15:43:46.841996+0000","last_clean":"2023-12-01T15:43:46.841996+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T15:43:46.841996+0000","last_undegraded":"2023-12-01T15:43:46.841996+0000","last_fullsized":"2023-12-01T15:43:46.841996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842819+0000","last_change":"2023-12-01T15:43:45.576345+0000","last_active":"2023-12-01T15:43:46.842819+0000","last_peered":"2023-12-01T15:43:46.842819+0000","last_clean":"2023-12-01T15:43:46.842819+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:43:46.842819+0000","last_undegraded":"2023-12-01T15:43:46.842819+0000","last_fullsized":"2023-12-01T15:43:46.842819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:21:55.500677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.593872+0000","last_change":"2023-12-01T15:43:45.208015+0000","last_active":"2023-12-01T15:43:45.593872+0000","last_peered":"2023-12-01T15:43:45.593872+0000","last_clean":"2023-12-01T15:43:45.593872+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T15:43:45.593872+0000","last_undegraded":"2023-12-01T15:43:45.593872+0000","last_fullsized":"2023-12-01T15:43:45.593872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565594+0000","last_change":"2023-12-01T15:43:45.582830+0000","last_active":"2023-12-01T15:43:46.565594+0000","last_peered":"2023-12-01T15:43:46.565594+0000","last_clean":"2023-12-01T15:43:46.565594+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T15:43:46.565594+0000","last_undegraded":"2023-12-01T15:43:46.565594+0000","last_fullsized":"2023-12-01T15:43:46.565594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.573539+0000","last_change":"2023-12-01T15:43:45.210538+0000","last_active":"2023-12-01T15:43:45.573539+0000","last_peered":"2023-12-01T15:43:45.573539+0000","last_clean":"2023-12-01T15:43:45.573539+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T15:43:45.573539+0000","last_undegraded":"2023-12-01T15:43:45.573539+0000","last_fullsized":"2023-12-01T15:43:45.573539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.562469+0000","last_change":"2023-12-01T15:43:45.204325+0000","last_active":"2023-12-01T15:43:45.562469+0000","last_peered":"2023-12-01T15:43:45.562469+0000","last_clean":"2023-12-01T15:43:45.562469+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T15:43:45.562469+0000","last_undegraded":"2023-12-01T15:43:45.562469+0000","last_fullsized":"2023-12-01T15:43:45.562469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840881+0000","last_change":"2023-12-01T15:43:45.583931+0000","last_active":"2023-12-01T15:43:46.840881+0000","last_peered":"2023-12-01T15:43:46.840881+0000","last_clean":"2023-12-01T15:43:46.840881+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T15:43:46.840881+0000","last_undegraded":"2023-12-01T15:43:46.840881+0000","last_fullsized":"2023-12-01T15:43:46.840881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:36.724287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.556940+0000","last_change":"2023-12-01T15:43:45.203624+0000","last_active":"2023-12-01T15:43:45.556940+0000","last_peered":"2023-12-01T15:43:45.556940+0000","last_clean":"2023-12-01T15:43:45.556940+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T15:43:45.556940+0000","last_undegraded":"2023-12-01T15:43:45.556940+0000","last_fullsized":"2023-12-01T15:43:45.556940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.565039+0000","last_change":"2023-12-01T15:43:45.572933+0000","last_active":"2023-12-01T15:43:46.565039+0000","last_peered":"2023-12-01T15:43:46.565039+0000","last_clean":"2023-12-01T15:43:46.565039+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:43:46.565039+0000","last_undegraded":"2023-12-01T15:43:46.565039+0000","last_fullsized":"2023-12-01T15:43:46.565039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.568640+0000","last_change":"2023-12-01T15:43:45.587913+0000","last_active":"2023-12-01T15:43:46.568640+0000","last_peered":"2023-12-01T15:43:46.568640+0000","last_clean":"2023-12-01T15:43:46.568640+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:43:46.568640+0000","last_undegraded":"2023-12-01T15:43:46.568640+0000","last_fullsized":"2023-12-01T15:43:46.568640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:20.675396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565673+0000","last_change":"2023-12-01T15:43:45.205650+0000","last_active":"2023-12-01T15:43:45.565673+0000","last_peered":"2023-12-01T15:43:45.565673+0000","last_clean":"2023-12-01T15:43:45.565673+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:43:45.565673+0000","last_undegraded":"2023-12-01T15:43:45.565673+0000","last_fullsized":"2023-12-01T15:43:45.565673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841953+0000","last_change":"2023-12-01T15:43:45.574378+0000","last_active":"2023-12-01T15:43:46.841953+0000","last_peered":"2023-12-01T15:43:46.841953+0000","last_clean":"2023-12-01T15:43:46.841953+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T15:43:46.841953+0000","last_undegraded":"2023-12-01T15:43:46.841953+0000","last_fullsized":"2023-12-01T15:43:46.841953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.565955+0000","last_change":"2023-12-01T15:43:45.200400+0000","last_active":"2023-12-01T15:43:45.565955+0000","last_peered":"2023-12-01T15:43:45.565955+0000","last_clean":"2023-12-01T15:43:45.565955+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:43:45.565955+0000","last_undegraded":"2023-12-01T15:43:45.565955+0000","last_fullsized":"2023-12-01T15:43:45.565955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841820+0000","last_change":"2023-12-01T15:43:45.570253+0000","last_active":"2023-12-01T15:43:46.841820+0000","last_peered":"2023-12-01T15:43:46.841820+0000","last_clean":"2023-12-01T15:43:46.841820+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:43:46.841820+0000","last_undegraded":"2023-12-01T15:43:46.841820+0000","last_fullsized":"2023-12-01T15:43:46.841820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.574389+0000","last_change":"2023-12-01T15:43:45.200975+0000","last_active":"2023-12-01T15:43:45.574389+0000","last_peered":"2023-12-01T15:43:45.574389+0000","last_clean":"2023-12-01T15:43:45.574389+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:43:45.574389+0000","last_undegraded":"2023-12-01T15:43:45.574389+0000","last_fullsized":"2023-12-01T15:43:45.574389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.566128+0000","last_change":"2023-12-01T15:43:45.575004+0000","last_active":"2023-12-01T15:43:46.566128+0000","last_peered":"2023-12-01T15:43:46.566128+0000","last_clean":"2023-12-01T15:43:46.566128+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T15:43:46.566128+0000","last_undegraded":"2023-12-01T15:43:46.566128+0000","last_fullsized":"2023-12-01T15:43:46.566128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.569598+0000","last_change":"2023-12-01T15:43:45.208899+0000","last_active":"2023-12-01T15:43:45.569598+0000","last_peered":"2023-12-01T15:43:45.569598+0000","last_clean":"2023-12-01T15:43:45.569598+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T15:43:45.569598+0000","last_undegraded":"2023-12-01T15:43:45.569598+0000","last_fullsized":"2023-12-01T15:43:45.569598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.842631+0000","last_change":"2023-12-01T15:43:45.578059+0000","last_active":"2023-12-01T15:43:46.842631+0000","last_peered":"2023-12-01T15:43:46.842631+0000","last_clean":"2023-12-01T15:43:46.842631+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T15:43:46.842631+0000","last_undegraded":"2023-12-01T15:43:46.842631+0000","last_fullsized":"2023-12-01T15:43:46.842631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.570848+0000","last_change":"2023-12-01T15:43:45.203471+0000","last_active":"2023-12-01T15:43:45.570848+0000","last_peered":"2023-12-01T15:43:45.570848+0000","last_clean":"2023-12-01T15:43:45.570848+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T15:43:45.570848+0000","last_undegraded":"2023-12-01T15:43:45.570848+0000","last_fullsized":"2023-12-01T15:43:45.570848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841785+0000","last_change":"2023-12-01T15:43:45.573522+0000","last_active":"2023-12-01T15:43:46.841785+0000","last_peered":"2023-12-01T15:43:46.841785+0000","last_clean":"2023-12-01T15:43:46.841785+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:43:46.841785+0000","last_undegraded":"2023-12-01T15:43:46.841785+0000","last_fullsized":"2023-12-01T15:43:46.841785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.591060+0000","last_change":"2023-12-01T15:43:45.208222+0000","last_active":"2023-12-01T15:43:45.591060+0000","last_peered":"2023-12-01T15:43:45.591060+0000","last_clean":"2023-12-01T15:43:45.591060+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:43:45.591060+0000","last_undegraded":"2023-12-01T15:43:45.591060+0000","last_fullsized":"2023-12-01T15:43:45.591060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.840961+0000","last_change":"2023-12-01T15:43:45.571469+0000","last_active":"2023-12-01T15:43:46.840961+0000","last_peered":"2023-12-01T15:43:46.840961+0000","last_clean":"2023-12-01T15:43:46.840961+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:43:46.840961+0000","last_undegraded":"2023-12-01T15:43:46.840961+0000","last_fullsized":"2023-12-01T15:43:46.840961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571989+0000","last_change":"2023-12-01T15:43:45.208256+0000","last_active":"2023-12-01T15:43:45.571989+0000","last_peered":"2023-12-01T15:43:45.571989+0000","last_clean":"2023-12-01T15:43:45.571989+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T15:43:45.571989+0000","last_undegraded":"2023-12-01T15:43:45.571989+0000","last_fullsized":"2023-12-01T15:43:45.571989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-01T15:43:46.841878+0000","last_change":"2023-12-01T15:43:45.575215+0000","last_active":"2023-12-01T15:43:46.841878+0000","last_peered":"2023-12-01T15:43:46.841878+0000","last_clean":"2023-12-01T15:43:46.841878+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:43:46.841878+0000","last_undegraded":"2023-12-01T15:43:46.841878+0000","last_fullsized":"2023-12-01T15:43:46.841878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-01T15:43:45.571407+0000","last_change":"2023-12-01T15:43:45.204599+0000","last_active":"2023-12-01T15:43:45.571407+0000","last_peered":"2023-12-01T15:43:45.571407+0000","last_clean":"2023-12-01T15:43:45.571407+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T15:43:45.571407+0000","last_undegraded":"2023-12-01T15:43:45.571407+0000","last_fullsized":"2023-12-01T15:43:45.571407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":798720,"data_stored":653237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":62307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":176128,"data_stored":60597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":782336,"data_stored":651707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T15:43:57.916 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-01T15:43:57.916 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-01T15:43:57.916 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-01T15:43:57.916 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-01T15:43:58.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fe579b700 1 Processor -- start 2023-12-01T15:43:58.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fe579b700 1 -- start start 2023-12-01T15:43:58.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fe579b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6fe013af60 0x7f6fe013b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fe579b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe013a910 con 0x7f6fe0098a60 2023-12-01T15:43:58.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fe579b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe00a8000 con 0x7f6fe00995c0 2023-12-01T15:43:58.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fe579b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe013b880 con 0x7f6fe013af60 2023-12-01T15:43:58.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fde7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6fe0098a60 0x7f6fe0098eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48432/0 (socket says 172.21.15.63:48432) 2023-12-01T15:43:58.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fde7fc700 1 -- 172.21.15.63:0/1433703406 learned_addr learned my addr 172.21.15.63:0/1433703406 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:58.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fdeffd700 1 --2- 172.21.15.63:0/1433703406 >> v2:172.21.15.66:3300/0 conn(0x7f6fe013af60 0x7f6fe013b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fdeffd700 1 -- 172.21.15.63:0/1433703406 >> v1:172.21.15.66:6789/0 conn(0x7f6fe00995c0 legacy=0x7f6fe0142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fdeffd700 1 -- 172.21.15.63:0/1433703406 >> v1:172.21.15.63:6789/0 conn(0x7f6fe0098a60 legacy=0x7f6fe0098eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.028+0000 7f6fdeffd700 1 -- 172.21.15.63:0/1433703406 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00a8380 con 0x7f6fe013af60 2023-12-01T15:43:58.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.032+0000 7f6fdeffd700 1 --2- 172.21.15.63:0/1433703406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe013af60 0x7f6fe013b340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009d90 tx=0x7f6fd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba049ec5a298033c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:58.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fddffb700 1 -- 172.21.15.63:0/1433703406 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd800e070 con 0x7f6fe013af60 2023-12-01T15:43:58.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fddffb700 1 -- 172.21.15.63:0/1433703406 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd800bbd0 con 0x7f6fe013af60 2023-12-01T15:43:58.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fddffb700 1 -- 172.21.15.63:0/1433703406 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8012430 con 0x7f6fe013af60 2023-12-01T15:43:58.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fe579b700 1 -- 172.21.15.63:0/1433703406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe013af60 msgr2=0x7f6fe013b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fe579b700 1 --2- 172.21.15.63:0/1433703406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe013af60 0x7f6fe013b340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009d90 tx=0x7f6fd800b330 comp rx=0 tx=0).stop 2023-12-01T15:43:58.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fe579b700 1 -- 172.21.15.63:0/1433703406 shutdown_connections 2023-12-01T15:43:58.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fe579b700 1 --2- 172.21.15.63:0/1433703406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe013af60 0x7f6fe013b340 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fe579b700 1 -- 172.21.15.63:0/1433703406 >> 172.21.15.63:0/1433703406 conn(0x7f6fe0073a30 msgr2=0x7f6fe00a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:58.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fe579b700 1 -- 172.21.15.63:0/1433703406 shutdown_connections 2023-12-01T15:43:58.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fe579b700 1 -- 172.21.15.63:0/1433703406 wait complete. 2023-12-01T15:43:58.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fe579b700 1 Processor -- start 2023-12-01T15:43:58.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.036+0000 7f6fe579b700 1 -- start start 2023-12-01T15:43:58.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fe579b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0098a60 0x7f6fe009e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fe579b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6fe00995c0 0x7f6fe009e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fe579b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe013af60 0x7f6fe009ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fe579b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00a1750 con 0x7f6fe0098a60 2023-12-01T15:43:58.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fe579b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0138570 con 0x7f6fe013af60 2023-12-01T15:43:58.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fe579b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00a0150 con 0x7f6fe00995c0 2023-12-01T15:43:58.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fdeffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0098a60 0x7f6fe009e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fdeffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0098a60 0x7f6fe009e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36092/0 (socket says 172.21.15.63:36092) 2023-12-01T15:43:58.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fdeffd700 1 -- 172.21.15.63:0/3722682835 learned_addr learned my addr 172.21.15.63:0/3722682835 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:58.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fdf7fe700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe013af60 0x7f6fe009ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fde7fc700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6fe00995c0 0x7f6fe009e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fdeffd700 1 -- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6fe00995c0 msgr2=0x7f6fe009e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fdeffd700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6fe00995c0 0x7f6fe009e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fdeffd700 1 -- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe013af60 msgr2=0x7f6fe009ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fdeffd700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe013af60 0x7f6fe009ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fdeffd700 1 -- 172.21.15.63:0/3722682835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd8009a70 con 0x7f6fe0098a60 2023-12-01T15:43:58.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fde7fc700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6fe00995c0 0x7f6fe009e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:43:58.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fdeffd700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0098a60 0x7f6fe009e200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8014040 tx=0x7f6fd8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:58.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fc77fe700 1 -- 172.21.15.63:0/3722682835 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd80098f0 con 0x7f6fe0098a60 2023-12-01T15:43:58.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fc77fe700 1 -- 172.21.15.63:0/3722682835 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd8020070 con 0x7f6fe0098a60 2023-12-01T15:43:58.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fe579b700 1 -- 172.21.15.63:0/3722682835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe00a1990 con 0x7f6fe0098a60 2023-12-01T15:43:58.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fc77fe700 1 -- 172.21.15.63:0/3722682835 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8004280 con 0x7f6fe0098a60 2023-12-01T15:43:58.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fe579b700 1 -- 172.21.15.63:0/3722682835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe00a1f60 con 0x7f6fe0098a60 2023-12-01T15:43:58.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fe579b700 1 -- 172.21.15.63:0/3722682835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe0065fb0 con 0x7f6fe0098a60 2023-12-01T15:43:58.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.040+0000 7f6fc77fe700 1 -- 172.21.15.63:0/3722682835 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6fd80043e0 con 0x7f6fe0098a60 2023-12-01T15:43:58.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.044+0000 7f6fc77fe700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fcc065ad0 0x7f6fcc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.044+0000 7f6fc77fe700 1 -- 172.21.15.63:0/3722682835 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f6fd8022070 con 0x7f6fe0098a60 2023-12-01T15:43:58.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.044+0000 7f6fde7fc700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fcc065ad0 0x7f6fcc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.044+0000 7f6fde7fc700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fcc065ad0 0x7f6fcc067f90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00a0f80 tx=0x7f6fd0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:58.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.052+0000 7f6fc77fe700 1 -- 172.21.15.63:0/3722682835 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6fd8052df0 con 0x7f6fe0098a60 2023-12-01T15:43:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.244+0000 7f6fe579b700 1 -- 172.21.15.63:0/3722682835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6fe0061d90 con 0x7f6fe0098a60 2023-12-01T15:43:58.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.244+0000 7f6fc77fe700 1 -- 172.21.15.63:0/3722682835 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6fd8056410 con 0x7f6fe0098a60 2023-12-01T15:43:58.249 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:58.249 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-01T15:43:58.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 -- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fcc065ad0 msgr2=0x7f6fcc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fcc065ad0 0x7f6fcc067f90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00a0f80 tx=0x7f6fd0009040 comp rx=0 tx=0).stop 2023-12-01T15:43:58.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 -- 172.21.15.63:0/3722682835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0098a60 msgr2=0x7f6fe009e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0098a60 0x7f6fe009e200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8014040 tx=0x7f6fd8004af0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 -- 172.21.15.63:0/3722682835 shutdown_connections 2023-12-01T15:43:58.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6fcc065ad0 0x7f6fcc067f90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6fe00995c0 0x7f6fe009e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fe013af60 0x7f6fe009ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 --2- 172.21.15.63:0/3722682835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe0098a60 0x7f6fe009e200 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 -- 172.21.15.63:0/3722682835 >> 172.21.15.63:0/3722682835 conn(0x7f6fe0073a30 msgr2=0x7f6fe01395a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:58.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 -- 172.21.15.63:0/3722682835 shutdown_connections 2023-12-01T15:43:58.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.248+0000 7f6fe579b700 1 -- 172.21.15.63:0/3722682835 wait complete. 2023-12-01T15:43:58.263 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-01T15:43:58.264 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:43:58.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6abfff700 1 Processor -- start 2023-12-01T15:43:58.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6abfff700 1 -- start start 2023-12-01T15:43:58.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6abfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe6ac0719e0 0x7fe6ac13f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6abfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe6ac144d70 0x7fe6ac147160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6abfff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac06f7e0 con 0x7fe6ac071600 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6abfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ac06f4f0 con 0x7fe6ac144d70 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6abfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ac06e770 con 0x7fe6ac0719e0 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6ab7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe6ac144d70 0x7fe6ac147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6aaffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe6ac071600 0x7fe6ac13ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48434/0 (socket says 172.21.15.63:48434) 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6aaffd700 1 -- 172.21.15.63:0/3426853320 learned_addr learned my addr 172.21.15.63:0/3426853320 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6aa7fc700 1 --2- 172.21.15.63:0/3426853320 >> v2:172.21.15.66:3300/0 conn(0x7fe6ac0719e0 0x7fe6ac13f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6ab7fe700 1 -- 172.21.15.63:0/3426853320 >> v2:172.21.15.66:3300/0 conn(0x7fe6ac0719e0 msgr2=0x7fe6ac13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6ab7fe700 1 --2- 172.21.15.63:0/3426853320 >> v2:172.21.15.66:3300/0 conn(0x7fe6ac0719e0 0x7fe6ac13f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6ab7fe700 1 -- 172.21.15.63:0/3426853320 >> v1:172.21.15.63:6789/0 conn(0x7fe6ac071600 legacy=0x7fe6ac13ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6a9ffb700 1 -- 172.21.15.63:0/3426853320 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615777103 0 0) 0x7fe6ac06f7e0 con 0x7fe6ac071600 2023-12-01T15:43:58.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6ab7fe700 1 -- 172.21.15.63:0/3426853320 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac071e50 con 0x7fe6ac144d70 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6ab7fe700 1 --2- 172.21.15.63:0/3426853320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6ac144d70 0x7fe6ac147160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac06f080 tx=0x7fe6a4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb3d296aec19a9a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6a9ffb700 1 -- 172.21.15.63:0/3426853320 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4011830 con 0x7fe6ac144d70 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6a9ffb700 1 -- 172.21.15.63:0/3426853320 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a4011990 con 0x7fe6ac144d70 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6a9ffb700 1 -- 172.21.15.63:0/3426853320 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4011d20 con 0x7fe6ac144d70 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6abfff700 1 -- 172.21.15.63:0/3426853320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6ac144d70 msgr2=0x7fe6ac147160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.376+0000 7fe6abfff700 1 --2- 172.21.15.63:0/3426853320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6ac144d70 0x7fe6ac147160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac06f080 tx=0x7fe6a4009b30 comp rx=0 tx=0).stop 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 -- 172.21.15.63:0/3426853320 shutdown_connections 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 --2- 172.21.15.63:0/3426853320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6ac144d70 0x7fe6ac147160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 --2- 172.21.15.63:0/3426853320 >> v2:172.21.15.66:3300/0 conn(0x7fe6ac0719e0 0x7fe6ac13f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 -- 172.21.15.63:0/3426853320 >> 172.21.15.63:0/3426853320 conn(0x7fe6ac0a8bd0 msgr2=0x7fe6ac098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 -- 172.21.15.63:0/3426853320 shutdown_connections 2023-12-01T15:43:58.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 -- 172.21.15.63:0/3426853320 wait complete. 2023-12-01T15:43:58.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 Processor -- start 2023-12-01T15:43:58.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 -- start start 2023-12-01T15:43:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6ac071600 0x7fe6ac1d36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6ac0719e0 0x7fe6ac1d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ac144d70 0x7fe6ac1d4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac09d300 con 0x7fe6ac071600 2023-12-01T15:43:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac09c530 con 0x7fe6ac144d70 2023-12-01T15:43:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac09d550 con 0x7fe6ac0719e0 2023-12-01T15:43:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6aaffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6ac071600 0x7fe6ac1d36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6aaffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6ac071600 0x7fe6ac1d36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36106/0 (socket says 172.21.15.63:36106) 2023-12-01T15:43:58.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6aaffd700 1 -- 172.21.15.63:0/4122982759 learned_addr learned my addr 172.21.15.63:0/4122982759 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:58.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6aa7fc700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6ac0719e0 0x7fe6ac1d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6ab7fe700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ac144d70 0x7fe6ac1d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6aaffd700 1 -- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6ac0719e0 msgr2=0x7fe6ac1d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6aaffd700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6ac0719e0 0x7fe6ac1d3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6aaffd700 1 -- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ac144d70 msgr2=0x7fe6ac1d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6aaffd700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ac144d70 0x7fe6ac1d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6aaffd700 1 -- 172.21.15.63:0/4122982759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40094b0 con 0x7fe6ac071600 2023-12-01T15:43:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6aaffd700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6ac071600 0x7fe6ac1d36b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c510 tx=0x7fe69400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6a37fe700 1 -- 172.21.15.63:0/4122982759 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694004ca0 con 0x7fe6ac071600 2023-12-01T15:43:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6a37fe700 1 -- 172.21.15.63:0/4122982759 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694004e20 con 0x7fe6ac071600 2023-12-01T15:43:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6a37fe700 1 -- 172.21.15.63:0/4122982759 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694007310 con 0x7fe6ac071600 2023-12-01T15:43:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 -- 172.21.15.63:0/4122982759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ac09d060 con 0x7fe6ac071600 2023-12-01T15:43:58.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.380+0000 7fe6abfff700 1 -- 172.21.15.63:0/4122982759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac0a5da0 con 0x7fe6ac071600 2023-12-01T15:43:58.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.384+0000 7fe6abfff700 1 -- 172.21.15.63:0/4122982759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ac06d820 con 0x7fe6ac071600 2023-12-01T15:43:58.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.384+0000 7fe6a37fe700 1 -- 172.21.15.63:0/4122982759 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe694007470 con 0x7fe6ac071600 2023-12-01T15:43:58.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.384+0000 7fe6a37fe700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe68c065ad0 0x7fe68c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.384+0000 7fe6a37fe700 1 -- 172.21.15.63:0/4122982759 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fe694082960 con 0x7fe6ac071600 2023-12-01T15:43:58.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.384+0000 7fe6aa7fc700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe68c065ad0 0x7fe68c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.384+0000 7fe6aa7fc700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe68c065ad0 0x7fe68c067f90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac13c810 tx=0x7fe69c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:58.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.392+0000 7fe6a37fe700 1 -- 172.21.15.63:0/4122982759 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe6ac06d820 con 0x7fe6ac071600 2023-12-01T15:43:58.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.556+0000 7fe6abfff700 1 -- 172.21.15.63:0/4122982759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6ac06d820 con 0x7fe6ac071600 2023-12-01T15:43:58.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6a37fe700 1 -- 172.21.15.63:0/4122982759 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7fe6ac06d820 con 0x7fe6ac071600 2023-12-01T15:43:58.563 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:43:58.563 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:46.548806+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:43:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 -- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe68c065ad0 msgr2=0x7fe68c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe68c065ad0 0x7fe68c067f90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac13c810 tx=0x7fe69c00b040 comp rx=0 tx=0).stop 2023-12-01T15:43:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 -- 172.21.15.63:0/4122982759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6ac071600 msgr2=0x7fe6ac1d36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6ac071600 0x7fe6ac1d36b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c510 tx=0x7fe69400c8d0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 -- 172.21.15.63:0/4122982759 shutdown_connections 2023-12-01T15:43:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe68c065ad0 0x7fe68c067f90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6ac0719e0 0x7fe6ac1d3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ac144d70 0x7fe6ac1d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 --2- 172.21.15.63:0/4122982759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6ac071600 0x7fe6ac1d36b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 -- 172.21.15.63:0/4122982759 >> 172.21.15.63:0/4122982759 conn(0x7fe6ac0a8bd0 msgr2=0x7fe6ac13d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 -- 172.21.15.63:0/4122982759 shutdown_connections 2023-12-01T15:43:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.560+0000 7fe6abfff700 1 -- 172.21.15.63:0/4122982759 wait complete. 2023-12-01T15:43:58.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T15:43:34.432064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-01T15:43:39.868591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T15:43:43.988414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T15:43:44.550416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T15:43:58.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T15:43:58.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.688+0000 7f9040f3b700 1 Processor -- start 2023-12-01T15:43:58.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.688+0000 7f9040f3b700 1 -- start start 2023-12-01T15:43:58.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.688+0000 7f9040f3b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f903c135500 0x7f903c1358e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f903c138e10 0x7f903c140650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c0a4420 con 0x7f903c1382f0 2023-12-01T15:43:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c09bae0 con 0x7f903c135500 2023-12-01T15:43:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c0a2330 con 0x7f903c138e10 2023-12-01T15:43:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f903c135500 0x7f903c1358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f903c135500 0x7f903c1358e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36114/0 (socket says 172.21.15.63:36114) 2023-12-01T15:43:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903b7fe700 1 -- 172.21.15.63:0/3143356685 learned_addr learned my addr 172.21.15.63:0/3143356685 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:58.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903bfff700 1 --2- 172.21.15.63:0/3143356685 >> v2:172.21.15.66:3300/0 conn(0x7f903c138e10 0x7f903c140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903b7fe700 1 -- 172.21.15.63:0/3143356685 >> v2:172.21.15.66:3300/0 conn(0x7f903c138e10 msgr2=0x7f903c140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903b7fe700 1 --2- 172.21.15.63:0/3143356685 >> v2:172.21.15.66:3300/0 conn(0x7f903c138e10 0x7f903c140650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903b7fe700 1 -- 172.21.15.63:0/3143356685 >> v1:172.21.15.66:6789/0 conn(0x7f903c1382f0 legacy=0x7f903c138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903b7fe700 1 -- 172.21.15.63:0/3143356685 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c134e90 con 0x7f903c135500 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903b7fe700 1 --2- 172.21.15.63:0/3143356685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f903c135500 0x7f903c1358e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9030009910 tx=0x7f9030009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0090c378403d23 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903a7fc700 1 -- 172.21.15.63:0/3143356685 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030011830 con 0x7f903c135500 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903a7fc700 1 -- 172.21.15.63:0/3143356685 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9030011990 con 0x7f903c135500 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f903a7fc700 1 -- 172.21.15.63:0/3143356685 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030011d40 con 0x7f903c135500 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 -- 172.21.15.63:0/3143356685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f903c135500 msgr2=0x7f903c1358e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 --2- 172.21.15.63:0/3143356685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f903c135500 0x7f903c1358e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9030009910 tx=0x7f9030009c20 comp rx=0 tx=0).stop 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 -- 172.21.15.63:0/3143356685 shutdown_connections 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 --2- 172.21.15.63:0/3143356685 >> v2:172.21.15.66:3300/0 conn(0x7f903c138e10 0x7f903c140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 --2- 172.21.15.63:0/3143356685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f903c135500 0x7f903c1358e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 -- 172.21.15.63:0/3143356685 >> 172.21.15.63:0/3143356685 conn(0x7f903c0a8a70 msgr2=0x7f903c0a4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 -- 172.21.15.63:0/3143356685 shutdown_connections 2023-12-01T15:43:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 -- 172.21.15.63:0/3143356685 wait complete. 2023-12-01T15:43:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 Processor -- start 2023-12-01T15:43:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.692+0000 7f9040f3b700 1 -- start start 2023-12-01T15:43:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9040f3b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f903c135500 0x7f903c1cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9040f3b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f903c1382f0 0x7f903c1cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9040f3b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f903c138e10 0x7f903c1cff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9040f3b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c072520 con 0x7f903c135500 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9040f3b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0712a0 con 0x7f903c1382f0 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9040f3b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c1347c0 con 0x7f903c138e10 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f903b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f903c135500 0x7f903c1cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f903b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f903c135500 0x7f903c1cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36124/0 (socket says 172.21.15.63:36124) 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f903b7fe700 1 -- 172.21.15.63:0/1879729751 learned_addr learned my addr 172.21.15.63:0/1879729751 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f903affd700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f903c1382f0 0x7f903c1cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f903bfff700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f903c138e10 0x7f903c1cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f903b7fe700 1 -- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f903c138e10 msgr2=0x7f903c1cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f903b7fe700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f903c138e10 0x7f903c1cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f903b7fe700 1 -- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f903c1382f0 msgr2=0x7f903c1cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f903b7fe700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f903c1382f0 0x7f903c1cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f903b7fe700 1 -- 172.21.15.63:0/1879729751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030009570 con 0x7f903c135500 2023-12-01T15:43:58.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f903b7fe700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f903c135500 0x7f903c1cf4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9030000c00 tx=0x7f9030004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:58.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9023fff700 1 -- 172.21.15.63:0/1879729751 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030004590 con 0x7f903c135500 2023-12-01T15:43:58.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9023fff700 1 -- 172.21.15.63:0/1879729751 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903001e070 con 0x7f903c135500 2023-12-01T15:43:58.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9040f3b700 1 -- 172.21.15.63:0/1879729751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c070200 con 0x7f903c135500 2023-12-01T15:43:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9023fff700 1 -- 172.21.15.63:0/1879729751 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030003900 con 0x7f903c135500 2023-12-01T15:43:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9040f3b700 1 -- 172.21.15.63:0/1879729751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c070e40 con 0x7f903c135500 2023-12-01T15:43:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.696+0000 7f9040f3b700 1 -- 172.21.15.63:0/1879729751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c065fb0 con 0x7f903c135500 2023-12-01T15:43:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.700+0000 7f9023fff700 1 -- 172.21.15.63:0/1879729751 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9030003a60 con 0x7f903c135500 2023-12-01T15:43:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.700+0000 7f9023fff700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9028065ad0 0x7f9028067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.700+0000 7f9023fff700 1 -- 172.21.15.63:0/1879729751 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f9030020070 con 0x7f903c135500 2023-12-01T15:43:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.700+0000 7f903affd700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9028065ad0 0x7f9028067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.700+0000 7f903affd700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9028065ad0 0x7f9028067f90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f903c0a1a20 tx=0x7f902c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:58.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.704+0000 7f9023fff700 1 -- 172.21.15.63:0/1879729751 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f9030052130 con 0x7f903c135500 2023-12-01T15:43:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 -- 172.21.15.63:0/1879729751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f903c06ff70 con 0x7f903c135500 2023-12-01T15:43:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9023fff700 1 -- 172.21.15.63:0/1879729751 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9030055750 con 0x7f903c135500 2023-12-01T15:43:58.875 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-01T15:43:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 -- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9028065ad0 msgr2=0x7f9028067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9028065ad0 0x7f9028067f90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f903c0a1a20 tx=0x7f902c009040 comp rx=0 tx=0).stop 2023-12-01T15:43:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 -- 172.21.15.63:0/1879729751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f903c135500 msgr2=0x7f903c1cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f903c135500 0x7f903c1cf4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9030000c00 tx=0x7f9030004770 comp rx=0 tx=0).stop 2023-12-01T15:43:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 -- 172.21.15.63:0/1879729751 shutdown_connections 2023-12-01T15:43:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9028065ad0 0x7f9028067f90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f903c138e10 0x7f903c1cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f903c1382f0 0x7f903c1cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 --2- 172.21.15.63:0/1879729751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f903c135500 0x7f903c1cf4f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:58.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 -- 172.21.15.63:0/1879729751 >> 172.21.15.63:0/1879729751 conn(0x7f903c0a8a70 msgr2=0x7f903c09dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:58.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 -- 172.21.15.63:0/1879729751 shutdown_connections 2023-12-01T15:43:58.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:58.872+0000 7f9040f3b700 1 -- 172.21.15.63:0/1879729751 wait complete. 2023-12-01T15:43:58.890 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-01T15:43:59.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.008+0000 7fa36dc10700 1 Processor -- start 2023-12-01T15:43:59.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.008+0000 7fa36dc10700 1 -- start start 2023-12-01T15:43:59.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa3681370e0 0x7fa3681374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3680a47d0 con 0x7fa3680a0390 2023-12-01T15:43:59.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa368137a00 con 0x7fa3680a1b20 2023-12-01T15:43:59.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3680a3b80 con 0x7fa3681370e0 2023-12-01T15:43:59.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36cc0e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa3681370e0 0x7fa3681374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa367fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa3680a0390 0x7fa3680a2d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48444/0 (socket says 172.21.15.63:48444) 2023-12-01T15:43:59.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa367fff700 1 -- 172.21.15.63:0/3621393986 learned_addr learned my addr 172.21.15.63:0/3621393986 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:59.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36cc0e700 1 -- 172.21.15.63:0/3621393986 >> v1:172.21.15.66:6789/0 conn(0x7fa3680a1b20 legacy=0x7fa3680a3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36cc0e700 1 -- 172.21.15.63:0/3621393986 >> v1:172.21.15.63:6789/0 conn(0x7fa3680a0390 legacy=0x7fa3680a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa3677fe700 1 -- 172.21.15.63:0/3621393986 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016617804 0 0) 0x7fa3680a47d0 con 0x7fa3680a0390 2023-12-01T15:43:59.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36cc0e700 1 -- 172.21.15.63:0/3621393986 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3680a09a0 con 0x7fa3681370e0 2023-12-01T15:43:59.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36cc0e700 1 --2- 172.21.15.63:0/3621393986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3681370e0 0x7fa3681374c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009850 tx=0x7fa35c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433833d830c7cffc server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa3677fe700 1 -- 172.21.15.63:0/3621393986 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c011830 con 0x7fa3681370e0 2023-12-01T15:43:59.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa3677fe700 1 -- 172.21.15.63:0/3621393986 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c011990 con 0x7fa3681370e0 2023-12-01T15:43:59.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa3677fe700 1 -- 172.21.15.63:0/3621393986 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c011d20 con 0x7fa3681370e0 2023-12-01T15:43:59.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 -- 172.21.15.63:0/3621393986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3681370e0 msgr2=0x7fa3681374c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 --2- 172.21.15.63:0/3621393986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3681370e0 0x7fa3681374c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009850 tx=0x7fa35c009b60 comp rx=0 tx=0).stop 2023-12-01T15:43:59.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 -- 172.21.15.63:0/3621393986 shutdown_connections 2023-12-01T15:43:59.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 --2- 172.21.15.63:0/3621393986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3681370e0 0x7fa3681374c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 -- 172.21.15.63:0/3621393986 >> 172.21.15.63:0/3621393986 conn(0x7fa3680a8a70 msgr2=0x7fa3680a4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:59.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 -- 172.21.15.63:0/3621393986 shutdown_connections 2023-12-01T15:43:59.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 -- 172.21.15.63:0/3621393986 wait complete. 2023-12-01T15:43:59.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 Processor -- start 2023-12-01T15:43:59.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.012+0000 7fa36dc10700 1 -- start start 2023-12-01T15:43:59.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa36dc10700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680a0390 0x7fa36806c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa36dc10700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3680a1b20 0x7fa36806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa36dc10700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3681370e0 0x7fa36806cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa36dc10700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36806f5b0 con 0x7fa3680a1b20 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa36dc10700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36806fae0 con 0x7fa3680a0390 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa36dc10700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36806f070 con 0x7fa3681370e0 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa367fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3680a1b20 0x7fa36806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa367fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3680a1b20 0x7fa36806ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36140/0 (socket says 172.21.15.63:36140) 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa367fff700 1 -- 172.21.15.63:0/1637181366 learned_addr learned my addr 172.21.15.63:0/1637181366 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa36d40f700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3681370e0 0x7fa36806cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa36cc0e700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680a0390 0x7fa36806c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa367fff700 1 -- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3681370e0 msgr2=0x7fa36806cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa367fff700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3681370e0 0x7fa36806cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa367fff700 1 -- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680a0390 msgr2=0x7fa36806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa367fff700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680a0390 0x7fa36806c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa367fff700 1 -- 172.21.15.63:0/1637181366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0094b0 con 0x7fa3680a1b20 2023-12-01T15:43:59.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa367fff700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3680a1b20 0x7fa36806ca10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa35800c450 tx=0x7fa35800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa3657fa700 1 -- 172.21.15.63:0/1637181366 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358004ca0 con 0x7fa3680a1b20 2023-12-01T15:43:59.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa3657fa700 1 -- 172.21.15.63:0/1637181366 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa358004e00 con 0x7fa3680a1b20 2023-12-01T15:43:59.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa36dc10700 1 -- 172.21.15.63:0/1637181366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36806f310 con 0x7fa3680a1b20 2023-12-01T15:43:59.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa3657fa700 1 -- 172.21.15.63:0/1637181366 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358007310 con 0x7fa3680a1b20 2023-12-01T15:43:59.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa36dc10700 1 -- 172.21.15.63:0/1637181366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36806e840 con 0x7fa3680a1b20 2023-12-01T15:43:59.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.016+0000 7fa36dc10700 1 -- 172.21.15.63:0/1637181366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa368065fb0 con 0x7fa3680a1b20 2023-12-01T15:43:59.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.020+0000 7fa3657fa700 1 -- 172.21.15.63:0/1637181366 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa358007470 con 0x7fa3680a1b20 2023-12-01T15:43:59.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.020+0000 7fa3657fa700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa354065ad0 0x7fa354067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.020+0000 7fa3657fa700 1 -- 172.21.15.63:0/1637181366 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fa358082ec0 con 0x7fa3680a1b20 2023-12-01T15:43:59.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.020+0000 7fa36cc0e700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa354065ad0 0x7fa354067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.020+0000 7fa36cc0e700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa354065ad0 0x7fa354067f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0090b0 tx=0x7fa35c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.028 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.024+0000 7fa3657fa700 1 -- 172.21.15.63:0/1637181366 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa358050de0 con 0x7fa3680a1b20 2023-12-01T15:43:59.190 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 -- 172.21.15.63:0/1637181366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa368061d90 con 0x7fa3680a1b20 2023-12-01T15:43:59.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa3657fa700 1 -- 172.21.15.63:0/1637181366 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa358001160 con 0x7fa3680a1b20 2023-12-01T15:43:59.191 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2023-12-01T15:43:59.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 -- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa354065ad0 msgr2=0x7fa354067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa354065ad0 0x7fa354067f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0090b0 tx=0x7fa35c008030 comp rx=0 tx=0).stop 2023-12-01T15:43:59.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 -- 172.21.15.63:0/1637181366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3680a1b20 msgr2=0x7fa36806ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3680a1b20 0x7fa36806ca10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa35800c450 tx=0x7fa35800c810 comp rx=0 tx=0).stop 2023-12-01T15:43:59.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 -- 172.21.15.63:0/1637181366 shutdown_connections 2023-12-01T15:43:59.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa354065ad0 0x7fa354067f90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3681370e0 0x7fa36806cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3680a1b20 0x7fa36806ca10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 --2- 172.21.15.63:0/1637181366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3680a0390 0x7fa36806c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 -- 172.21.15.63:0/1637181366 >> 172.21.15.63:0/1637181366 conn(0x7fa3680a8a70 msgr2=0x7fa3680a4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:59.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 -- 172.21.15.63:0/1637181366 shutdown_connections 2023-12-01T15:43:59.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.188+0000 7fa36dc10700 1 -- 172.21.15.63:0/1637181366 wait complete. 2023-12-01T15:43:59.205 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T15:43:59.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fddac843700 1 Processor -- start 2023-12-01T15:43:59.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fddac843700 1 -- start start 2023-12-01T15:43:59.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fddac843700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdda81358e0 0x7fdda8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fddac843700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdda813e640 0x7fdda8140a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fddac843700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda8135cf0 con 0x7fdda8135500 2023-12-01T15:43:59.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fddac843700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda80a4420 con 0x7fdda81358e0 2023-12-01T15:43:59.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fddac843700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda809bae0 con 0x7fdda813e640 2023-12-01T15:43:59.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda6d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdda8135500 0x7fdda81382f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48450/0 (socket says 172.21.15.63:48450) 2023-12-01T15:43:59.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda6d9d700 1 -- 172.21.15.63:0/2266357079 learned_addr learned my addr 172.21.15.63:0/2266357079 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:59.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda759e700 1 --2- 172.21.15.63:0/2266357079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdda813e640 0x7fdda8140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda659c700 1 --2- 172.21.15.63:0/2266357079 >> v2:172.21.15.66:3300/0 conn(0x7fdda81358e0 0x7fdda8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda5d9b700 1 -- 172.21.15.63:0/2266357079 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564921835 0 0) 0x7fdda8135cf0 con 0x7fdda8135500 2023-12-01T15:43:59.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda5d9b700 1 -- 172.21.15.63:0/2266357079 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd900035d0 con 0x7fdda8135500 2023-12-01T15:43:59.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda759e700 1 -- 172.21.15.63:0/2266357079 >> v2:172.21.15.66:3300/0 conn(0x7fdda81358e0 msgr2=0x7fdda8138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:59.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda759e700 1 --2- 172.21.15.63:0/2266357079 >> v2:172.21.15.66:3300/0 conn(0x7fdda81358e0 0x7fdda8138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda759e700 1 -- 172.21.15.63:0/2266357079 >> v1:172.21.15.63:6789/0 conn(0x7fdda8135500 legacy=0x7fdda81382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda759e700 1 -- 172.21.15.63:0/2266357079 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda80a2330 con 0x7fdda813e640 2023-12-01T15:43:59.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda659c700 1 --2- 172.21.15.63:0/2266357079 >> v2:172.21.15.66:3300/0 conn(0x7fdda81358e0 0x7fdda8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:43:59.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.316+0000 7fdda759e700 1 --2- 172.21.15.63:0/2266357079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdda813e640 0x7fdda8140a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009840 tx=0x7fdda0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d011b6253556fb9c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fdda5d9b700 1 -- 172.21.15.63:0/2266357079 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda0005ea0 con 0x7fdda813e640 2023-12-01T15:43:59.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fdda5d9b700 1 -- 172.21.15.63:0/2266357079 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda0006030 con 0x7fdda813e640 2023-12-01T15:43:59.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fdda5d9b700 1 -- 172.21.15.63:0/2266357079 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda00063c0 con 0x7fdda813e640 2023-12-01T15:43:59.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 -- 172.21.15.63:0/2266357079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdda813e640 msgr2=0x7fdda8140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 --2- 172.21.15.63:0/2266357079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdda813e640 0x7fdda8140a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009840 tx=0x7fdda0009b50 comp rx=0 tx=0).stop 2023-12-01T15:43:59.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 -- 172.21.15.63:0/2266357079 shutdown_connections 2023-12-01T15:43:59.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 --2- 172.21.15.63:0/2266357079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdda813e640 0x7fdda8140a30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 --2- 172.21.15.63:0/2266357079 >> v2:172.21.15.66:3300/0 conn(0x7fdda81358e0 0x7fdda8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 -- 172.21.15.63:0/2266357079 >> 172.21.15.63:0/2266357079 conn(0x7fdda80a8a70 msgr2=0x7fdda80a4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:59.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 -- 172.21.15.63:0/2266357079 shutdown_connections 2023-12-01T15:43:59.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 -- 172.21.15.63:0/2266357079 wait complete. 2023-12-01T15:43:59.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 Processor -- start 2023-12-01T15:43:59.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 -- start start 2023-12-01T15:43:59.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdda8135500 0x7fdda81ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdda81358e0 0x7fdda81cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdda813e640 0x7fdda81cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda806fac0 con 0x7fdda8135500 2023-12-01T15:43:59.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda8071a90 con 0x7fdda81358e0 2023-12-01T15:43:59.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fddac843700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda8070ec0 con 0x7fdda813e640 2023-12-01T15:43:59.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fdda6d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdda8135500 0x7fdda81ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fdda759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdda813e640 0x7fdda81cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fdda6d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdda8135500 0x7fdda81ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36144/0 (socket says 172.21.15.63:36144) 2023-12-01T15:43:59.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fdda659c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdda81358e0 0x7fdda81cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.320+0000 7fdda6d9d700 1 -- 172.21.15.63:0/513189961 learned_addr learned my addr 172.21.15.63:0/513189961 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:59.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fdda659c700 1 -- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdda813e640 msgr2=0x7fdda81cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fdda659c700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdda813e640 0x7fdda81cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fdda659c700 1 -- 172.21.15.63:0/513189961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdda8135500 msgr2=0x7fdda81ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fdda659c700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdda8135500 0x7fdda81ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fdda659c700 1 -- 172.21.15.63:0/513189961 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd98009a70 con 0x7fdda81358e0 2023-12-01T15:43:59.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fdda659c700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdda81358e0 0x7fdda81cd4c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009e60 tx=0x7fdd9800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fdd8f7fe700 1 -- 172.21.15.63:0/513189961 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9800cd10 con 0x7fdda81358e0 2023-12-01T15:43:59.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fdd8f7fe700 1 -- 172.21.15.63:0/513189961 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9800f040 con 0x7fdda81358e0 2023-12-01T15:43:59.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fddac843700 1 -- 172.21.15.63:0/513189961 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda00094a0 con 0x7fdda81358e0 2023-12-01T15:43:59.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fdd8f7fe700 1 -- 172.21.15.63:0/513189961 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd980146c0 con 0x7fdda81358e0 2023-12-01T15:43:59.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fddac843700 1 -- 172.21.15.63:0/513189961 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda8071660 con 0x7fdda81358e0 2023-12-01T15:43:59.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fdd8f7fe700 1 -- 172.21.15.63:0/513189961 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdd98014820 con 0x7fdda81358e0 2023-12-01T15:43:59.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.324+0000 7fddac843700 1 -- 172.21.15.63:0/513189961 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda8065fb0 con 0x7fdda81358e0 2023-12-01T15:43:59.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.328+0000 7fdd8f7fe700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdd94065ad0 0x7fdd94067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.328+0000 7fdd8f7fe700 1 -- 172.21.15.63:0/513189961 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fdd980837b0 con 0x7fdda81358e0 2023-12-01T15:43:59.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.328+0000 7fdda6d9d700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdd94065ad0 0x7fdd94067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.328+0000 7fdda6d9d700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdd94065ad0 0x7fdd94067f90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0011e0 tx=0x7fdd9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.336+0000 7fdd8f7fe700 1 -- 172.21.15.63:0/513189961 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fdd980516e0 con 0x7fdda81358e0 2023-12-01T15:43:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.504+0000 7fddac843700 1 -- 172.21.15.63:0/513189961 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdda8061d90 con 0x7fdda81358e0 2023-12-01T15:43:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.504+0000 7fdd8f7fe700 1 -- 172.21.15.63:0/513189961 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd98054d00 con 0x7fdda81358e0 2023-12-01T15:43:59.510 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-01T15:43:59.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 -- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdd94065ad0 msgr2=0x7fdd94067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdd94065ad0 0x7fdd94067f90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0011e0 tx=0x7fdd9c009040 comp rx=0 tx=0).stop 2023-12-01T15:43:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 -- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdda81358e0 msgr2=0x7fdda81cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdda81358e0 0x7fdda81cd4c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009e60 tx=0x7fdd9800c3a0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 -- 172.21.15.63:0/513189961 shutdown_connections 2023-12-01T15:43:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdd94065ad0 0x7fdd94067f90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdda813e640 0x7fdda81cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdda81358e0 0x7fdda81cd4c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 --2- 172.21.15.63:0/513189961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdda8135500 0x7fdda81ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 -- 172.21.15.63:0/513189961 >> 172.21.15.63:0/513189961 conn(0x7fdda80a8a70 msgr2=0x7fdda8134490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:59.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 -- 172.21.15.63:0/513189961 shutdown_connections 2023-12-01T15:43:59.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.508+0000 7fddac843700 1 -- 172.21.15.63:0/513189961 wait complete. 2023-12-01T15:43:59.524 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T15:43:59.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.636+0000 7f15074f3700 1 Processor -- start 2023-12-01T15:43:59.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.636+0000 7f15074f3700 1 -- start start 2023-12-01T15:43:59.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.636+0000 7f15074f3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f15001347d0 0x7f150006e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.636+0000 7f15074f3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1500134bb0 0x7f1500137630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.636+0000 7f15074f3700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1500134610 con 0x7f1500137b70 2023-12-01T15:43:59.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.636+0000 7f15074f3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1500070010 con 0x7f15001347d0 2023-12-01T15:43:59.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.636+0000 7f15074f3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150006f360 con 0x7f1500134bb0 2023-12-01T15:43:59.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.636+0000 7f1506cf2700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1500137b70 0x7f150013e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48466/0 (socket says 172.21.15.63:48466) 2023-12-01T15:43:59.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.636+0000 7f1506cf2700 1 -- 172.21.15.63:0/2630194099 learned_addr learned my addr 172.21.15.63:0/2630194099 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:43:59.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.636+0000 7f1505cf0700 1 --2- 172.21.15.63:0/2630194099 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1500134bb0 0x7f1500137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.636+0000 7f15064f1700 1 --2- 172.21.15.63:0/2630194099 >> v2:172.21.15.66:3300/0 conn(0x7f15001347d0 0x7f150006e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15054ef700 1 -- 172.21.15.63:0/2630194099 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438536549 0 0) 0x7f1500134610 con 0x7f1500137b70 2023-12-01T15:43:59.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15054ef700 1 -- 172.21.15.63:0/2630194099 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14ec0035d0 con 0x7f1500137b70 2023-12-01T15:43:59.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f1505cf0700 1 -- 172.21.15.63:0/2630194099 >> v2:172.21.15.66:3300/0 conn(0x7f15001347d0 msgr2=0x7f150006e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:59.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f1505cf0700 1 --2- 172.21.15.63:0/2630194099 >> v2:172.21.15.66:3300/0 conn(0x7f15001347d0 0x7f150006e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f1505cf0700 1 -- 172.21.15.63:0/2630194099 >> v1:172.21.15.63:6789/0 conn(0x7f1500137b70 legacy=0x7f150013e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f1505cf0700 1 -- 172.21.15.63:0/2630194099 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150006db00 con 0x7f1500134bb0 2023-12-01T15:43:59.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f1505cf0700 1 --2- 172.21.15.63:0/2630194099 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1500134bb0 0x7f1500137630 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00f9e0 tx=0x7f14fc00fcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2f7464fa477b5d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15054ef700 1 -- 172.21.15.63:0/2630194099 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00f460 con 0x7f1500134bb0 2023-12-01T15:43:59.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15054ef700 1 -- 172.21.15.63:0/2630194099 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc00fe80 con 0x7f1500134bb0 2023-12-01T15:43:59.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15054ef700 1 -- 172.21.15.63:0/2630194099 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc009ae0 con 0x7f1500134bb0 2023-12-01T15:43:59.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15074f3700 1 -- 172.21.15.63:0/2630194099 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1500134bb0 msgr2=0x7f1500137630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15074f3700 1 --2- 172.21.15.63:0/2630194099 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1500134bb0 0x7f1500137630 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00f9e0 tx=0x7f14fc00fcf0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15074f3700 1 -- 172.21.15.63:0/2630194099 shutdown_connections 2023-12-01T15:43:59.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15074f3700 1 --2- 172.21.15.63:0/2630194099 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1500134bb0 0x7f1500137630 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15074f3700 1 --2- 172.21.15.63:0/2630194099 >> v2:172.21.15.66:3300/0 conn(0x7f15001347d0 0x7f150006e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15074f3700 1 -- 172.21.15.63:0/2630194099 >> 172.21.15.63:0/2630194099 conn(0x7f15000a96b0 msgr2=0x7f15000a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:59.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15074f3700 1 -- 172.21.15.63:0/2630194099 shutdown_connections 2023-12-01T15:43:59.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15074f3700 1 -- 172.21.15.63:0/2630194099 wait complete. 2023-12-01T15:43:59.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15074f3700 1 Processor -- start 2023-12-01T15:43:59.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.640+0000 7f15074f3700 1 -- start start 2023-12-01T15:43:59.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15074f3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15001347d0 0x7f15001cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15074f3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1500134bb0 0x7f15001cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15074f3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1500137b70 0x7f15001cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15074f3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15000a5270 con 0x7f15001347d0 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15074f3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15000a6780 con 0x7f1500134bb0 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15074f3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15000a3260 con 0x7f1500137b70 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15064f1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15001347d0 0x7f15001cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15064f1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15001347d0 0x7f15001cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36158/0 (socket says 172.21.15.63:36158) 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15064f1700 1 -- 172.21.15.63:0/2885260582 learned_addr learned my addr 172.21.15.63:0/2885260582 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f1506cf2700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1500137b70 0x7f15001cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f1505cf0700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1500134bb0 0x7f15001cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15064f1700 1 -- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1500137b70 msgr2=0x7f15001cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15064f1700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1500137b70 0x7f15001cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15064f1700 1 -- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1500134bb0 msgr2=0x7f15001cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15064f1700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1500134bb0 0x7f15001cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15064f1700 1 -- 172.21.15.63:0/2885260582 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc00f610 con 0x7f15001347d0 2023-12-01T15:43:59.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15064f1700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15001347d0 0x7f15001cafd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f14f000e870 tx=0x7f14f000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f14f6ffd700 1 -- 172.21.15.63:0/2885260582 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f00095a0 con 0x7f15001347d0 2023-12-01T15:43:59.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f14f6ffd700 1 -- 172.21.15.63:0/2885260582 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f0013680 con 0x7f15001347d0 2023-12-01T15:43:59.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15074f3700 1 -- 172.21.15.63:0/2885260582 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15000a6cc0 con 0x7f15001347d0 2023-12-01T15:43:59.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f14f6ffd700 1 -- 172.21.15.63:0/2885260582 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f00139f0 con 0x7f15001347d0 2023-12-01T15:43:59.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15074f3700 1 -- 172.21.15.63:0/2885260582 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15000a4fb0 con 0x7f15001347d0 2023-12-01T15:43:59.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.644+0000 7f15074f3700 1 -- 172.21.15.63:0/2885260582 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1500065fb0 con 0x7f15001347d0 2023-12-01T15:43:59.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.648+0000 7f14f6ffd700 1 -- 172.21.15.63:0/2885260582 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14f0013b50 con 0x7f15001347d0 2023-12-01T15:43:59.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.648+0000 7f14f6ffd700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f14e4065ad0 0x7f14e4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.648+0000 7f14f6ffd700 1 -- 172.21.15.63:0/2885260582 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f14f0082ac0 con 0x7f15001347d0 2023-12-01T15:43:59.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.648+0000 7f1505cf0700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f14e4065ad0 0x7f14e4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.648+0000 7f1505cf0700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f14e4065ad0 0x7f14e4067f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14fc01a040 tx=0x7f14fc013000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.652+0000 7f14f6ffd700 1 -- 172.21.15.63:0/2885260582 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f14f00509d0 con 0x7f15001347d0 2023-12-01T15:43:59.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.816+0000 7f15074f3700 1 -- 172.21.15.63:0/2885260582 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1500061d90 con 0x7f15001347d0 2023-12-01T15:43:59.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.816+0000 7f14f6ffd700 1 -- 172.21.15.63:0/2885260582 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14f0021020 con 0x7f15001347d0 2023-12-01T15:43:59.820 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-01T15:43:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 -- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f14e4065ad0 msgr2=0x7f14e4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f14e4065ad0 0x7f14e4067f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14fc01a040 tx=0x7f14fc013000 comp rx=0 tx=0).stop 2023-12-01T15:43:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 -- 172.21.15.63:0/2885260582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15001347d0 msgr2=0x7f15001cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15001347d0 0x7f15001cafd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f14f000e870 tx=0x7f14f000eb80 comp rx=0 tx=0).stop 2023-12-01T15:43:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 -- 172.21.15.63:0/2885260582 shutdown_connections 2023-12-01T15:43:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f14e4065ad0 0x7f14e4067f90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1500137b70 0x7f15001cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1500134bb0 0x7f15001cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 --2- 172.21.15.63:0/2885260582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15001347d0 0x7f15001cafd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 -- 172.21.15.63:0/2885260582 >> 172.21.15.63:0/2885260582 conn(0x7f15000a96b0 msgr2=0x7f150009af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 -- 172.21.15.63:0/2885260582 shutdown_connections 2023-12-01T15:43:59.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.820+0000 7f15074f3700 1 -- 172.21.15.63:0/2885260582 wait complete. 2023-12-01T15:43:59.835 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T15:43:59.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 Processor -- start 2023-12-01T15:43:59.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 -- start start 2023-12-01T15:43:59.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd041376e0 0x7fdd04137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd0406ba50 0x7fdd0406bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0409c240 con 0x7fdd0406c3e0 2023-12-01T15:43:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd04138000 con 0x7fdd041376e0 2023-12-01T15:43:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0406c870 con 0x7fdd0406ba50 2023-12-01T15:43:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd03fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd041376e0 0x7fdd04137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd03fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd041376e0 0x7fdd04137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36160/0 (socket says 172.21.15.63:36160) 2023-12-01T15:43:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd03fff700 1 -- 172.21.15.63:0/4126148473 learned_addr learned my addr 172.21.15.63:0/4126148473 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd037fe700 1 --2- 172.21.15.63:0/4126148473 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd0406ba50 0x7fdd0406bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd03fff700 1 -- 172.21.15.63:0/4126148473 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd0406ba50 msgr2=0x7fdd0406bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:43:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd03fff700 1 --2- 172.21.15.63:0/4126148473 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd0406ba50 0x7fdd0406bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd03fff700 1 -- 172.21.15.63:0/4126148473 >> v1:172.21.15.66:6789/0 conn(0x7fdd0406c3e0 legacy=0x7fdd041418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd03fff700 1 -- 172.21.15.63:0/4126148473 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0409bc90 con 0x7fdd041376e0 2023-12-01T15:43:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd03fff700 1 --2- 172.21.15.63:0/4126148473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd041376e0 0x7fdd04137ac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009910 tx=0x7fdcf8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6034e69de14eecf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd02ffd700 1 -- 172.21.15.63:0/4126148473 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8011830 con 0x7fdd041376e0 2023-12-01T15:43:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd02ffd700 1 -- 172.21.15.63:0/4126148473 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf8011990 con 0x7fdd041376e0 2023-12-01T15:43:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd02ffd700 1 -- 172.21.15.63:0/4126148473 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8011d40 con 0x7fdd041376e0 2023-12-01T15:43:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 -- 172.21.15.63:0/4126148473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd041376e0 msgr2=0x7fdd04137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 --2- 172.21.15.63:0/4126148473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd041376e0 0x7fdd04137ac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009910 tx=0x7fdcf8009c20 comp rx=0 tx=0).stop 2023-12-01T15:43:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 -- 172.21.15.63:0/4126148473 shutdown_connections 2023-12-01T15:43:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 --2- 172.21.15.63:0/4126148473 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd0406ba50 0x7fdd0406bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 --2- 172.21.15.63:0/4126148473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd041376e0 0x7fdd04137ac0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 -- 172.21.15.63:0/4126148473 >> 172.21.15.63:0/4126148473 conn(0x7fdd040737a0 msgr2=0x7fdd040ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:43:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 -- 172.21.15.63:0/4126148473 shutdown_connections 2023-12-01T15:43:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.948+0000 7fdd09489700 1 -- 172.21.15.63:0/4126148473 wait complete. 2023-12-01T15:43:59.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd09489700 1 Processor -- start 2023-12-01T15:43:59.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd09489700 1 -- start start 2023-12-01T15:43:59.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd09489700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd0406ba50 0x7fdd041ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd09489700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd0406c3e0 0x7fdd041cea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd09489700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd041376e0 0x7fdd041cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd09489700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040a94c0 con 0x7fdd041376e0 2023-12-01T15:43:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd09489700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd041232c0 con 0x7fdd0406c3e0 2023-12-01T15:43:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd09489700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040a8900 con 0x7fdd0406ba50 2023-12-01T15:43:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd08c88700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd041376e0 0x7fdd041cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd03fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd0406ba50 0x7fdd041ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd08c88700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd041376e0 0x7fdd041cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36166/0 (socket says 172.21.15.63:36166) 2023-12-01T15:43:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd08c88700 1 -- 172.21.15.63:0/164222596 learned_addr learned my addr 172.21.15.63:0/164222596 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:43:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.952+0000 7fdd037fe700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd0406c3e0 0x7fdd041cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd08c88700 1 -- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd0406ba50 msgr2=0x7fdd041ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd08c88700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd0406ba50 0x7fdd041ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd08c88700 1 -- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd0406c3e0 msgr2=0x7fdd041cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:43:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd08c88700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd0406c3e0 0x7fdd041cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:43:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd08c88700 1 -- 172.21.15.63:0/164222596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf8009570 con 0x7fdd041376e0 2023-12-01T15:43:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd08c88700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd041376e0 0x7fdd041cf220 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00cb50 tx=0x7fdcfc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd00ff9700 1 -- 172.21.15.63:0/164222596 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc003c20 con 0x7fdd041376e0 2023-12-01T15:43:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd00ff9700 1 -- 172.21.15.63:0/164222596 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc003d80 con 0x7fdd041376e0 2023-12-01T15:43:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd09489700 1 -- 172.21.15.63:0/164222596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd04123f00 con 0x7fdd041376e0 2023-12-01T15:43:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd00ff9700 1 -- 172.21.15.63:0/164222596 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00aa20 con 0x7fdd041376e0 2023-12-01T15:43:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd09489700 1 -- 172.21.15.63:0/164222596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd041241c0 con 0x7fdd041376e0 2023-12-01T15:43:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd09489700 1 -- 172.21.15.63:0/164222596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0409b7e0 con 0x7fdd041376e0 2023-12-01T15:43:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd00ff9700 1 -- 172.21.15.63:0/164222596 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdcfc00ab80 con 0x7fdd041376e0 2023-12-01T15:43:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd00ff9700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdcf0065ad0 0x7fdcf0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:43:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.956+0000 7fdd00ff9700 1 -- 172.21.15.63:0/164222596 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fdcfc082be0 con 0x7fdd041376e0 2023-12-01T15:43:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.960+0000 7fdd03fff700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdcf0065ad0 0x7fdcf0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:43:59.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.960+0000 7fdd03fff700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdcf0065ad0 0x7fdcf0067f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009c60 tx=0x7fdcf8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:43:59.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:43:59.968+0000 7fdd00ff9700 1 -- 172.21.15.63:0/164222596 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fdcfc050b10 con 0x7fdd041376e0 2023-12-01T15:44:00.029 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:44:00.032 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:44:00.034 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:44:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.172+0000 7fdd09489700 1 -- 172.21.15.63:0/164222596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd04065fb0 con 0x7fdd041376e0 2023-12-01T15:44:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.172+0000 7fdd00ff9700 1 -- 172.21.15.63:0/164222596 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3130 (secure 0 0 0) 0x7fdcfc054130 con 0x7fdd041376e0 2023-12-01T15:44:00.177 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:44:00.177 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6817/2060518783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2060518783},{"type":"v1","addr":"172.21.15.63:6817","nonce":2060518783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T15:43:45.544844+0000","modified":"2023-12-01T15:43:48.562365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6819/2416365697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2416365697},{"type":"v1","addr":"172.21.15.66:6819","nonce":2416365697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T15:44:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 -- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdcf0065ad0 msgr2=0x7fdcf0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdcf0065ad0 0x7fdcf0067f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009c60 tx=0x7fdcf8008030 comp rx=0 tx=0).stop 2023-12-01T15:44:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 -- 172.21.15.63:0/164222596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd041376e0 msgr2=0x7fdd041cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd041376e0 0x7fdd041cf220 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00cb50 tx=0x7fdcfc00ce60 comp rx=0 tx=0).stop 2023-12-01T15:44:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 -- 172.21.15.63:0/164222596 shutdown_connections 2023-12-01T15:44:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fdcf0065ad0 0x7fdcf0067f90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd041376e0 0x7fdd041cf220 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd0406c3e0 0x7fdd041cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 --2- 172.21.15.63:0/164222596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd0406ba50 0x7fdd041ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 -- 172.21.15.63:0/164222596 >> 172.21.15.63:0/164222596 conn(0x7fdd040737a0 msgr2=0x7fdd040aa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 -- 172.21.15.63:0/164222596 shutdown_connections 2023-12-01T15:44:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.176+0000 7fdd09489700 1 -- 172.21.15.63:0/164222596 wait complete. 2023-12-01T15:44:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2023-12-01T15:44:00.191 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:44:00.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f6431afd700 1 Processor -- start 2023-12-01T15:44:00.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f6431afd700 1 -- start start 2023-12-01T15:44:00.302 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f6431afd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f642c137ac0 0x7f642c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f6431afd700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c09c240 con 0x7f642c1408b0 2023-12-01T15:44:00.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f6431afd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c09bc90 con 0x7f642c1376e0 2023-12-01T15:44:00.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f6431afd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c09bf80 con 0x7f642c137ac0 2023-12-01T15:44:00.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f64312fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f642c1408b0 0x7f642c142ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48480/0 (socket says 172.21.15.63:48480) 2023-12-01T15:44:00.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f64312fc700 1 -- 172.21.15.63:0/2761696823 learned_addr learned my addr 172.21.15.63:0/2761696823 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:44:00.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f642bfff700 1 --2- 172.21.15.63:0/2761696823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f642c137ac0 0x7f642c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f642b7fe700 1 -- 172.21.15.63:0/2761696823 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334723770 0 0) 0x7f642c09c240 con 0x7f642c1408b0 2023-12-01T15:44:00.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f642b7fe700 1 -- 172.21.15.63:0/2761696823 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64140035d0 con 0x7f642c1408b0 2023-12-01T15:44:00.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f642b7fe700 1 -- 172.21.15.63:0/2761696823 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653243413 0 0) 0x7f642c09bc90 con 0x7f642c1376e0 2023-12-01T15:44:00.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.296+0000 7f642b7fe700 1 -- 172.21.15.63:0/2761696823 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f642c09c240 con 0x7f642c1376e0 2023-12-01T15:44:00.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f642bfff700 1 -- 172.21.15.63:0/2761696823 >> v1:172.21.15.66:6789/0 conn(0x7f642c1376e0 legacy=0x7f642c06ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f642bfff700 1 -- 172.21.15.63:0/2761696823 >> v1:172.21.15.63:6789/0 conn(0x7f642c1408b0 legacy=0x7f642c142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f642bfff700 1 -- 172.21.15.63:0/2761696823 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c09ebd0 con 0x7f642c137ac0 2023-12-01T15:44:00.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f642bfff700 1 --2- 172.21.15.63:0/2761696823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f642c137ac0 0x7f642c06c160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6420009880 tx=0x7f6420009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1ed2fb42dfc9fe9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:00.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f642b7fe700 1 -- 172.21.15.63:0/2761696823 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420011830 con 0x7f642c137ac0 2023-12-01T15:44:00.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f642b7fe700 1 -- 172.21.15.63:0/2761696823 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6420011990 con 0x7f642c137ac0 2023-12-01T15:44:00.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f642b7fe700 1 -- 172.21.15.63:0/2761696823 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420011d20 con 0x7f642c137ac0 2023-12-01T15:44:00.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 -- 172.21.15.63:0/2761696823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f642c137ac0 msgr2=0x7f642c06c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 --2- 172.21.15.63:0/2761696823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f642c137ac0 0x7f642c06c160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6420009880 tx=0x7f6420009b90 comp rx=0 tx=0).stop 2023-12-01T15:44:00.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 -- 172.21.15.63:0/2761696823 shutdown_connections 2023-12-01T15:44:00.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 --2- 172.21.15.63:0/2761696823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f642c137ac0 0x7f642c06c160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 -- 172.21.15.63:0/2761696823 >> 172.21.15.63:0/2761696823 conn(0x7f642c0737a0 msgr2=0x7f642c0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:00.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 -- 172.21.15.63:0/2761696823 shutdown_connections 2023-12-01T15:44:00.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 -- 172.21.15.63:0/2761696823 wait complete. 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 Processor -- start 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 -- start start 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f642c1376e0 0x7f642c1323f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f642c137ac0 0x7f642c132930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c1408b0 0x7f642c1cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c13f8a0 con 0x7f642c1408b0 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c13fd90 con 0x7f642c137ac0 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6431afd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c13f600 con 0x7f642c1376e0 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f64312fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c1408b0 0x7f642c1cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f6430afb700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f642c1376e0 0x7f642c1323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f64312fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c1408b0 0x7f642c1cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36172/0 (socket says 172.21.15.63:36172) 2023-12-01T15:44:00.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f64312fc700 1 -- 172.21.15.63:0/508317990 learned_addr learned my addr 172.21.15.63:0/508317990 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f642bfff700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f642c137ac0 0x7f642c132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f64312fc700 1 -- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f642c1376e0 msgr2=0x7f642c1323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.300+0000 7f64312fc700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f642c1376e0 0x7f642c1323f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.304+0000 7f64312fc700 1 -- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f642c137ac0 msgr2=0x7f642c132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.304+0000 7f64312fc700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f642c137ac0 0x7f642c132930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.304+0000 7f64312fc700 1 -- 172.21.15.63:0/508317990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64200094b0 con 0x7f642c1408b0 2023-12-01T15:44:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.304+0000 7f64312fc700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c1408b0 0x7f642c1cf070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f641c00c430 tx=0x7f641c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.304+0000 7f64297fa700 1 -- 172.21.15.63:0/508317990 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c005b90 con 0x7f642c1408b0 2023-12-01T15:44:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.304+0000 7f64297fa700 1 -- 172.21.15.63:0/508317990 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c005cf0 con 0x7f642c1408b0 2023-12-01T15:44:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.304+0000 7f6431afd700 1 -- 172.21.15.63:0/508317990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642c13edd0 con 0x7f642c1408b0 2023-12-01T15:44:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.304+0000 7f64297fa700 1 -- 172.21.15.63:0/508317990 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c007310 con 0x7f642c1408b0 2023-12-01T15:44:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.304+0000 7f6431afd700 1 -- 172.21.15.63:0/508317990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642c13fb20 con 0x7f642c1408b0 2023-12-01T15:44:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.304+0000 7f6431afd700 1 -- 172.21.15.63:0/508317990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642c065fb0 con 0x7f642c1408b0 2023-12-01T15:44:00.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.304+0000 7f64297fa700 1 -- 172.21.15.63:0/508317990 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f641c007470 con 0x7f642c1408b0 2023-12-01T15:44:00.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.308+0000 7f64297fa700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6418065ad0 0x7f6418067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.308+0000 7f64297fa700 1 -- 172.21.15.63:0/508317990 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f641c081ef0 con 0x7f642c1408b0 2023-12-01T15:44:00.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.308+0000 7f6430afb700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6418065ad0 0x7f6418067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.308+0000 7f6430afb700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6418065ad0 0x7f6418067f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6424001560 tx=0x7f6424009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:00.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.312+0000 7f64297fa700 1 -- 172.21.15.63:0/508317990 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f641c04fe10 con 0x7f642c1408b0 2023-12-01T15:44:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.480+0000 7f6431afd700 1 -- 172.21.15.63:0/508317990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f642c061d90 con 0x7f642c1408b0 2023-12-01T15:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.480+0000 7f64297fa700 1 -- 172.21.15.63:0/508317990 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7f641c017090 con 0x7f642c1408b0 2023-12-01T15:44:00.484 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:44:00.484 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:46.548806+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:44:00.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.480+0000 7f6431afd700 1 -- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6418065ad0 msgr2=0x7f6418067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.480+0000 7f6431afd700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6418065ad0 0x7f6418067f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6424001560 tx=0x7f6424009040 comp rx=0 tx=0).stop 2023-12-01T15:44:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.480+0000 7f6431afd700 1 -- 172.21.15.63:0/508317990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c1408b0 msgr2=0x7f642c1cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.480+0000 7f6431afd700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c1408b0 0x7f642c1cf070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f641c00c430 tx=0x7f641c00c740 comp rx=0 tx=0).stop 2023-12-01T15:44:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.484+0000 7f6431afd700 1 -- 172.21.15.63:0/508317990 shutdown_connections 2023-12-01T15:44:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.484+0000 7f6431afd700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6418065ad0 0x7f6418067f90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.484+0000 7f6431afd700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c1408b0 0x7f642c1cf070 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.484+0000 7f6431afd700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f642c137ac0 0x7f642c132930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.484+0000 7f6431afd700 1 --2- 172.21.15.63:0/508317990 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f642c1376e0 0x7f642c1323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.484+0000 7f6431afd700 1 -- 172.21.15.63:0/508317990 >> 172.21.15.63:0/508317990 conn(0x7f642c0737a0 msgr2=0x7f642c136b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.484+0000 7f6431afd700 1 -- 172.21.15.63:0/508317990 shutdown_connections 2023-12-01T15:44:00.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.484+0000 7f6431afd700 1 -- 172.21.15.63:0/508317990 wait complete. 2023-12-01T15:44:00.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T15:43:34.432064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-01T15:43:39.868591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T15:43:43.988414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T15:43:44.550416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T15:44:00.503 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T15:44:00.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0c158a700 1 Processor -- start 2023-12-01T15:44:00.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0c158a700 1 -- start start 2023-12-01T15:44:00.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0c158a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd0bc1370e0 0x7fd0bc1374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0c158a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd0bc0a0390 0x7fd0bc0a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0c158a700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0bc0a47d0 con 0x7fd0bc0a1b20 2023-12-01T15:44:00.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0c158a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0bc137a00 con 0x7fd0bc1370e0 2023-12-01T15:44:00.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0c158a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc0a09a0 con 0x7fd0bc0a0390 2023-12-01T15:44:00.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0c0d89700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd0bc0a1b20 0x7fd0bc0a32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48492/0 (socket says 172.21.15.63:48492) 2023-12-01T15:44:00.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0c0d89700 1 -- 172.21.15.63:0/892523169 learned_addr learned my addr 172.21.15.63:0/892523169 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:44:00.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0bbfff700 1 --2- 172.21.15.63:0/892523169 >> v2:172.21.15.66:3300/0 conn(0x7fd0bc1370e0 0x7fd0bc1374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0bb7fe700 1 --2- 172.21.15.63:0/892523169 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd0bc0a0390 0x7fd0bc0a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0baffd700 1 -- 172.21.15.63:0/892523169 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526299793 0 0) 0x7fd0bc0a47d0 con 0x7fd0bc0a1b20 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0baffd700 1 -- 172.21.15.63:0/892523169 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a80046e0 con 0x7fd0bc0a1b20 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0baffd700 1 -- 172.21.15.63:0/892523169 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2951371487 0 0) 0x7fd0a80046e0 con 0x7fd0bc0a1b20 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0bbfff700 1 -- 172.21.15.63:0/892523169 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd0bc0a0390 msgr2=0x7fd0bc0a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0bbfff700 1 --2- 172.21.15.63:0/892523169 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd0bc0a0390 0x7fd0bc0a2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0bbfff700 1 -- 172.21.15.63:0/892523169 >> v1:172.21.15.63:6789/0 conn(0x7fd0bc0a1b20 legacy=0x7fd0bc0a32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0bbfff700 1 -- 172.21.15.63:0/892523169 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc0a2060 con 0x7fd0bc1370e0 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0bbfff700 1 --2- 172.21.15.63:0/892523169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0bc1370e0 0x7fd0bc1374c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009880 tx=0x7fd0b4009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a39b4a81c24e93 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0baffd700 1 -- 172.21.15.63:0/892523169 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac001a40 con 0x7fd0bc1370e0 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0baffd700 1 -- 172.21.15.63:0/892523169 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b4004030 con 0x7fd0bc1370e0 2023-12-01T15:44:00.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.620+0000 7fd0baffd700 1 -- 172.21.15.63:0/892523169 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40043a0 con 0x7fd0bc1370e0 2023-12-01T15:44:00.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 -- 172.21.15.63:0/892523169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0bc1370e0 msgr2=0x7fd0bc1374c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 --2- 172.21.15.63:0/892523169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0bc1370e0 0x7fd0bc1374c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009880 tx=0x7fd0b4009b90 comp rx=0 tx=0).stop 2023-12-01T15:44:00.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 -- 172.21.15.63:0/892523169 shutdown_connections 2023-12-01T15:44:00.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 --2- 172.21.15.63:0/892523169 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd0bc0a0390 0x7fd0bc0a2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 --2- 172.21.15.63:0/892523169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0bc1370e0 0x7fd0bc1374c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 -- 172.21.15.63:0/892523169 >> 172.21.15.63:0/892523169 conn(0x7fd0bc0a8a70 msgr2=0x7fd0bc0a4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:00.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 -- 172.21.15.63:0/892523169 shutdown_connections 2023-12-01T15:44:00.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 -- 172.21.15.63:0/892523169 wait complete. 2023-12-01T15:44:00.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 Processor -- start 2023-12-01T15:44:00.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 -- start start 2023-12-01T15:44:00.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd0bc0a0390 0x7fd0bc1cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0bc0a1b20 0x7fd0bc1cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0bc1370e0 0x7fd0bc1cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc06fa70 con 0x7fd0bc1370e0 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc06efc0 con 0x7fd0bc0a1b20 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c158a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc09fdb0 con 0x7fd0bc0a0390 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c0d89700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0bc1370e0 0x7fd0bc1cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c0d89700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0bc1370e0 0x7fd0bc1cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36176/0 (socket says 172.21.15.63:36176) 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c0d89700 1 -- 172.21.15.63:0/1934346939 learned_addr learned my addr 172.21.15.63:0/1934346939 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0bb7fe700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0bc0a1b20 0x7fd0bc1cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0bbfff700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd0bc0a0390 0x7fd0bc1cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c0d89700 1 -- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd0bc0a0390 msgr2=0x7fd0bc1cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c0d89700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd0bc0a0390 0x7fd0bc1cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c0d89700 1 -- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0bc0a1b20 msgr2=0x7fd0bc1cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c0d89700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0bc0a1b20 0x7fd0bc1cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.624+0000 7fd0c0d89700 1 -- 172.21.15.63:0/1934346939 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b40094b0 con 0x7fd0bc1370e0 2023-12-01T15:44:00.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.628+0000 7fd0c0d89700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0bc1370e0 0x7fd0bc1cb800 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00cc30 tx=0x7fd0ac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:00.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.628+0000 7fd0b8ff9700 1 -- 172.21.15.63:0/1934346939 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac00aba0 con 0x7fd0bc1370e0 2023-12-01T15:44:00.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.628+0000 7fd0b8ff9700 1 -- 172.21.15.63:0/1934346939 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac00ad00 con 0x7fd0bc1370e0 2023-12-01T15:44:00.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.628+0000 7fd0c158a700 1 -- 172.21.15.63:0/1934346939 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc06e100 con 0x7fd0bc1370e0 2023-12-01T15:44:00.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.628+0000 7fd0b8ff9700 1 -- 172.21.15.63:0/1934346939 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac007310 con 0x7fd0bc1370e0 2023-12-01T15:44:00.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.628+0000 7fd0c158a700 1 -- 172.21.15.63:0/1934346939 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc06f790 con 0x7fd0bc1370e0 2023-12-01T15:44:00.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.628+0000 7fd0c158a700 1 -- 172.21.15.63:0/1934346939 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc065fb0 con 0x7fd0bc1370e0 2023-12-01T15:44:00.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.628+0000 7fd0b8ff9700 1 -- 172.21.15.63:0/1934346939 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd0ac007470 con 0x7fd0bc1370e0 2023-12-01T15:44:00.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.628+0000 7fd0b8ff9700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd09c065ad0 0x7fd09c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.628+0000 7fd0b8ff9700 1 -- 172.21.15.63:0/1934346939 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fd0ac0829c0 con 0x7fd0bc1370e0 2023-12-01T15:44:00.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.628+0000 7fd0bbfff700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd09c065ad0 0x7fd09c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.632+0000 7fd0bbfff700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd09c065ad0 0x7fd09c067f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4000c00 tx=0x7fd0b4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:00.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.636+0000 7fd0b8ff9700 1 -- 172.21.15.63:0/1934346939 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd0ac050970 con 0x7fd0bc1370e0 2023-12-01T15:44:00.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.792+0000 7fd0c158a700 1 -- 172.21.15.63:0/1934346939 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0bc061d90 con 0x7fd0bc1370e0 2023-12-01T15:44:00.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.792+0000 7fd0b8ff9700 1 -- 172.21.15.63:0/1934346939 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0ac018020 con 0x7fd0bc1370e0 2023-12-01T15:44:00.796 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-01T15:44:00.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.792+0000 7fd0c158a700 1 -- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd09c065ad0 msgr2=0x7fd09c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.792+0000 7fd0c158a700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd09c065ad0 0x7fd09c067f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4000c00 tx=0x7fd0b4010000 comp rx=0 tx=0).stop 2023-12-01T15:44:00.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.792+0000 7fd0c158a700 1 -- 172.21.15.63:0/1934346939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0bc1370e0 msgr2=0x7fd0bc1cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.792+0000 7fd0c158a700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0bc1370e0 0x7fd0bc1cb800 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00cc30 tx=0x7fd0ac00a060 comp rx=0 tx=0).stop 2023-12-01T15:44:00.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.796+0000 7fd0c158a700 1 -- 172.21.15.63:0/1934346939 shutdown_connections 2023-12-01T15:44:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.796+0000 7fd0c158a700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd09c065ad0 0x7fd09c067f90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.796+0000 7fd0c158a700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0bc1370e0 0x7fd0bc1cb800 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.796+0000 7fd0c158a700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0bc0a1b20 0x7fd0bc1cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.796+0000 7fd0c158a700 1 --2- 172.21.15.63:0/1934346939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd0bc0a0390 0x7fd0bc1cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.796+0000 7fd0c158a700 1 -- 172.21.15.63:0/1934346939 >> 172.21.15.63:0/1934346939 conn(0x7fd0bc0a8a70 msgr2=0x7fd0bc1be8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.796+0000 7fd0c158a700 1 -- 172.21.15.63:0/1934346939 shutdown_connections 2023-12-01T15:44:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.796+0000 7fd0c158a700 1 -- 172.21.15.63:0/1934346939 wait complete. 2023-12-01T15:44:00.809 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-01T15:44:00.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a74a84700 1 Processor -- start 2023-12-01T15:44:00.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a74a84700 1 -- start start 2023-12-01T15:44:00.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a74a84700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a7006ce90 0x7f2a70099a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a74a84700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2a7013eab0 0x7f2a7013ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a74a84700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7006c970 con 0x7f2a7013f3d0 2023-12-01T15:44:00.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a74a84700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7013bdf0 con 0x7f2a7013eab0 2023-12-01T15:44:00.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a74a84700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7013c090 con 0x7f2a7006ce90 2023-12-01T15:44:00.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a6effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2a7013eab0 0x7f2a7013ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a6effd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2a7013eab0 0x7f2a7013ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36188/0 (socket says 172.21.15.63:36188) 2023-12-01T15:44:00.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a6effd700 1 -- 172.21.15.63:0/1614410336 learned_addr learned my addr 172.21.15.63:0/1614410336 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:00.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a6f7fe700 1 --2- 172.21.15.63:0/1614410336 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a7006ce90 0x7f2a70099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a6effd700 1 -- 172.21.15.63:0/1614410336 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a7006ce90 msgr2=0x7f2a70099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:00.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a6effd700 1 --2- 172.21.15.63:0/1614410336 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a7006ce90 0x7f2a70099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a6effd700 1 -- 172.21.15.63:0/1614410336 >> v1:172.21.15.66:6789/0 conn(0x7f2a7013f3d0 legacy=0x7f2a70145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a6effd700 1 -- 172.21.15.63:0/1614410336 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a700a96d0 con 0x7f2a7013eab0 2023-12-01T15:44:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.916+0000 7f2a6effd700 1 --2- 172.21.15.63:0/1614410336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a7013eab0 0x7f2a7013ee90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009e50 tx=0x7f2a6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe32f5250e65763 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a6e7fc700 1 -- 172.21.15.63:0/1614410336 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000e070 con 0x7f2a7013eab0 2023-12-01T15:44:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a6e7fc700 1 -- 172.21.15.63:0/1614410336 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6000b9c0 con 0x7f2a7013eab0 2023-12-01T15:44:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a6e7fc700 1 -- 172.21.15.63:0/1614410336 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000bd70 con 0x7f2a7013eab0 2023-12-01T15:44:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 -- 172.21.15.63:0/1614410336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a7013eab0 msgr2=0x7f2a7013ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 --2- 172.21.15.63:0/1614410336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a7013eab0 0x7f2a7013ee90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009e50 tx=0x7f2a6000b330 comp rx=0 tx=0).stop 2023-12-01T15:44:00.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 -- 172.21.15.63:0/1614410336 shutdown_connections 2023-12-01T15:44:00.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 --2- 172.21.15.63:0/1614410336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a7013eab0 0x7f2a7013ee90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 --2- 172.21.15.63:0/1614410336 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a7006ce90 0x7f2a70099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 -- 172.21.15.63:0/1614410336 >> 172.21.15.63:0/1614410336 conn(0x7f2a70073920 msgr2=0x7f2a700a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:00.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 -- 172.21.15.63:0/1614410336 shutdown_connections 2023-12-01T15:44:00.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 -- 172.21.15.63:0/1614410336 wait complete. 2023-12-01T15:44:00.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 Processor -- start 2023-12-01T15:44:00.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 -- start start 2023-12-01T15:44:00.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a7006ce90 0x7f2a701d3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a7013eab0 0x7f2a701d41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a7013f3d0 0x7f2a701d46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700715a0 con 0x7f2a7013f3d0 2023-12-01T15:44:00.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7009b290 con 0x7f2a7006ce90 2023-12-01T15:44:00.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a74a84700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700708c0 con 0x7f2a7013eab0 2023-12-01T15:44:00.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a7013f3d0 0x7f2a701d46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a7013f3d0 0x7f2a701d46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36192/0 (socket says 172.21.15.63:36192) 2023-12-01T15:44:00.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a6f7fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a7006ce90 0x7f2a701d3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a6ffff700 1 -- 172.21.15.63:0/66574618 learned_addr learned my addr 172.21.15.63:0/66574618 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:00.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.920+0000 7f2a6effd700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a7013eab0 0x7f2a701d41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a6ffff700 1 -- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a7013eab0 msgr2=0x7f2a701d41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a6ffff700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a7013eab0 0x7f2a701d41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a6ffff700 1 -- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a7006ce90 msgr2=0x7f2a701d3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:00.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a6ffff700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a7006ce90 0x7f2a701d3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:00.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a6ffff700 1 -- 172.21.15.63:0/66574618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a60009b30 con 0x7f2a7013f3d0 2023-12-01T15:44:00.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a6ffff700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a7013f3d0 0x7f2a701d46e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c480 tx=0x7f2a5800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:00.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a67fff700 1 -- 172.21.15.63:0/66574618 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580052d0 con 0x7f2a7013f3d0 2023-12-01T15:44:00.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a67fff700 1 -- 172.21.15.63:0/66574618 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5800ce90 con 0x7f2a7013f3d0 2023-12-01T15:44:00.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a74a84700 1 -- 172.21.15.63:0/66574618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7009bd50 con 0x7f2a7013f3d0 2023-12-01T15:44:00.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a67fff700 1 -- 172.21.15.63:0/66574618 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580036a0 con 0x7f2a7013f3d0 2023-12-01T15:44:00.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a74a84700 1 -- 172.21.15.63:0/66574618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7009c010 con 0x7f2a7013f3d0 2023-12-01T15:44:00.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a74a84700 1 -- 172.21.15.63:0/66574618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a70065fb0 con 0x7f2a7013f3d0 2023-12-01T15:44:00.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.924+0000 7f2a67fff700 1 -- 172.21.15.63:0/66574618 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2a58003800 con 0x7f2a7013f3d0 2023-12-01T15:44:00.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.928+0000 7f2a67fff700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f2a54065ad0 0x7f2a54067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:00.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.928+0000 7f2a67fff700 1 -- 172.21.15.63:0/66574618 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f2a58081f10 con 0x7f2a7013f3d0 2023-12-01T15:44:00.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.928+0000 7f2a6f7fe700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f2a54065ad0 0x7f2a54067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:00.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.928+0000 7f2a6f7fe700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f2a54065ad0 0x7f2a54067f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a68007a60 tx=0x7f2a68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:00.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:00.932+0000 7f2a67fff700 1 -- 172.21.15.63:0/66574618 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f2a5804fe40 con 0x7f2a7013f3d0 2023-12-01T15:44:01.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.096+0000 7f2a74a84700 1 -- 172.21.15.63:0/66574618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a70061d90 con 0x7f2a7013f3d0 2023-12-01T15:44:01.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a67fff700 1 -- 172.21.15.63:0/66574618 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a58053460 con 0x7f2a7013f3d0 2023-12-01T15:44:01.103 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2023-12-01T15:44:01.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 -- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f2a54065ad0 msgr2=0x7f2a54067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f2a54065ad0 0x7f2a54067f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a68007a60 tx=0x7f2a68008040 comp rx=0 tx=0).stop 2023-12-01T15:44:01.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 -- 172.21.15.63:0/66574618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a7013f3d0 msgr2=0x7f2a701d46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a7013f3d0 0x7f2a701d46e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c480 tx=0x7f2a5800c790 comp rx=0 tx=0).stop 2023-12-01T15:44:01.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 -- 172.21.15.63:0/66574618 shutdown_connections 2023-12-01T15:44:01.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f2a54065ad0 0x7f2a54067f90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a7013eab0 0x7f2a701d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a7013f3d0 0x7f2a701d46e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 --2- 172.21.15.63:0/66574618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a7006ce90 0x7f2a701d3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 -- 172.21.15.63:0/66574618 >> 172.21.15.63:0/66574618 conn(0x7f2a70073920 msgr2=0x7f2a70139430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:01.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 -- 172.21.15.63:0/66574618 shutdown_connections 2023-12-01T15:44:01.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.100+0000 7f2a74a84700 1 -- 172.21.15.63:0/66574618 wait complete. 2023-12-01T15:44:01.117 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T15:44:01.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.228+0000 7f968eb33700 1 Processor -- start 2023-12-01T15:44:01.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.228+0000 7f968eb33700 1 -- start start 2023-12-01T15:44:01.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.228+0000 7f968eb33700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96881347d0 0x7f968806e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.228+0000 7f968eb33700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9688134610 con 0x7f9688134bb0 2023-12-01T15:44:01.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.228+0000 7f968eb33700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968806db00 con 0x7f9688137d40 2023-12-01T15:44:01.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.228+0000 7f968eb33700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9688070010 con 0x7f96881347d0 2023-12-01T15:44:01.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.228+0000 7f968d330700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9688134bb0 0x7f9688137630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48494/0 (socket says 172.21.15.63:48494) 2023-12-01T15:44:01.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.228+0000 7f968d330700 1 -- 172.21.15.63:0/1953003887 learned_addr learned my addr 172.21.15.63:0/1953003887 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:44:01.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.228+0000 7f968db31700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96881347d0 0x7f968806e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.228+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723538593 0 0) 0x7f9688134610 con 0x7f9688134bb0 2023-12-01T15:44:01.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96740035d0 con 0x7f9688134bb0 2023-12-01T15:44:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666447015 0 0) 0x7f968806db00 con 0x7f9688137d40 2023-12-01T15:44:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9688134610 con 0x7f9688137d40 2023-12-01T15:44:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1171592428 0 0) 0x7f96740035d0 con 0x7f9688134bb0 2023-12-01T15:44:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96881347d0 msgr2=0x7f968806e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96881347d0 0x7f968806e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 >> v1:172.21.15.66:6789/0 conn(0x7f9688137d40 legacy=0x7f968813f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968806f580 con 0x7f9688134bb0 2023-12-01T15:44:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3363315130 0 0) 0x7f9678001670 con 0x7f9688134bb0 2023-12-01T15:44:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968db31700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96881347d0 0x7f968806e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:44:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 >> v1:172.21.15.63:6789/0 conn(0x7f9688134bb0 legacy=0x7f9688137630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96881347d0 0x7f9674003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9674004190 0x7f9674004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9674004db0 0x7f9674005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9688070010 con 0x7f9674004db0 2023-12-01T15:44:01.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967400bc90 con 0x7f9674004190 2023-12-01T15:44:01.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967400be50 con 0x7f96881347d0 2023-12-01T15:44:01.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968e332700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9674004db0 0x7f9674005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968db31700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96881347d0 0x7f9674003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968d330700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9674004190 0x7f9674004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968e332700 1 -- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96881347d0 msgr2=0x7f9674003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:01.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968e332700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96881347d0 0x7f9674003c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968e332700 1 -- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9674004190 msgr2=0x7f9674004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:01.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968e332700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9674004190 0x7f9674004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968e332700 1 -- 172.21.15.63:0/1953003887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840094b0 con 0x7f9674004db0 2023-12-01T15:44:01.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968d330700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9674004190 0x7f9674004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:44:01.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968e332700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9674004db0 0x7f9674005230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f968000c2f0 tx=0x7f96740058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a40caf4fe96c8df server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:01.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680001f30 con 0x7f9674004db0 2023-12-01T15:44:01.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968000ce90 con 0x7f9674004db0 2023-12-01T15:44:01.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968cb2f700 1 -- 172.21.15.63:0/1953003887 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680003c60 con 0x7f9674004db0 2023-12-01T15:44:01.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968eb33700 1 -- 172.21.15.63:0/1953003887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9674004db0 msgr2=0x7f9674005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968eb33700 1 --2- 172.21.15.63:0/1953003887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9674004db0 0x7f9674005230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f968000c2f0 tx=0x7f96740058a0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968e332700 1 -- 172.21.15.63:0/1953003887 reap_dead start 2023-12-01T15:44:01.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968eb33700 1 -- 172.21.15.63:0/1953003887 shutdown_connections 2023-12-01T15:44:01.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968eb33700 1 -- 172.21.15.63:0/1953003887 >> 172.21.15.63:0/1953003887 conn(0x7f96880a96b0 msgr2=0x7f96880a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:01.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968eb33700 1 -- 172.21.15.63:0/1953003887 shutdown_connections 2023-12-01T15:44:01.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.232+0000 7f968eb33700 1 -- 172.21.15.63:0/1953003887 wait complete. 2023-12-01T15:44:01.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968eb33700 1 Processor -- start 2023-12-01T15:44:01.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968eb33700 1 -- start start 2023-12-01T15:44:01.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968eb33700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9688133540 0x7f9688133920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968eb33700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f968809de80 0x7f9688141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968eb33700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9688141590 0x7f9688141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968eb33700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968809e950 con 0x7f9688133540 2023-12-01T15:44:01.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968eb33700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968809ede0 con 0x7f9688141590 2023-12-01T15:44:01.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968eb33700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968809f630 con 0x7f968809de80 2023-12-01T15:44:01.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968db31700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9688133540 0x7f9688133920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968db31700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9688133540 0x7f9688133920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36212/0 (socket says 172.21.15.63:36212) 2023-12-01T15:44:01.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968db31700 1 -- 172.21.15.63:0/157790637 learned_addr learned my addr 172.21.15.63:0/157790637 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:01.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968d330700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f968809de80 0x7f9688141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968e332700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9688141590 0x7f9688141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968db31700 1 -- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f968809de80 msgr2=0x7f9688141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968db31700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f968809de80 0x7f9688141050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968db31700 1 -- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9688141590 msgr2=0x7f9688141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968db31700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9688141590 0x7f9688141a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968db31700 1 -- 172.21.15.63:0/157790637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968809f2b0 con 0x7f9688133540 2023-12-01T15:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968d330700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f968809de80 0x7f9688141050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968db31700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9688133540 0x7f9688133920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9684011cd0 tx=0x7f968400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f967e7fc700 1 -- 172.21.15.63:0/157790637 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400fb30 con 0x7f9688133540 2023-12-01T15:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f967e7fc700 1 -- 172.21.15.63:0/157790637 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968400fc90 con 0x7f9688133540 2023-12-01T15:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968eb33700 1 -- 172.21.15.63:0/157790637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9688133e60 con 0x7f9688133540 2023-12-01T15:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f967e7fc700 1 -- 172.21.15.63:0/157790637 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684014440 con 0x7f9688133540 2023-12-01T15:44:01.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.236+0000 7f968eb33700 1 -- 172.21.15.63:0/157790637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968809eff0 con 0x7f9688133540 2023-12-01T15:44:01.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.240+0000 7f968eb33700 1 -- 172.21.15.63:0/157790637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96881398e0 con 0x7f9688133540 2023-12-01T15:44:01.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.240+0000 7f967e7fc700 1 -- 172.21.15.63:0/157790637 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f968401d400 con 0x7f9688133540 2023-12-01T15:44:01.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.240+0000 7f967e7fc700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f966c065b00 0x7f966c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.240+0000 7f967e7fc700 1 -- 172.21.15.63:0/157790637 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f9684083550 con 0x7f9688133540 2023-12-01T15:44:01.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.240+0000 7f968d330700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f966c065b00 0x7f966c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.240+0000 7f968d330700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f966c065b00 0x7f966c067fc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9688142390 tx=0x7f9678009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:01.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.248+0000 7f967e7fc700 1 -- 172.21.15.63:0/157790637 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f9684051460 con 0x7f9688133540 2023-12-01T15:44:01.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.408+0000 7f968eb33700 1 -- 172.21.15.63:0/157790637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9688065fb0 con 0x7f9688133540 2023-12-01T15:44:01.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.408+0000 7f967e7fc700 1 -- 172.21.15.63:0/157790637 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9684054a80 con 0x7f9688133540 2023-12-01T15:44:01.412 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-01T15:44:01.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 -- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f966c065b00 msgr2=0x7f966c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f966c065b00 0x7f966c067fc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9688142390 tx=0x7f9678009040 comp rx=0 tx=0).stop 2023-12-01T15:44:01.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 -- 172.21.15.63:0/157790637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9688133540 msgr2=0x7f9688133920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9688133540 0x7f9688133920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9684011cd0 tx=0x7f968400f520 comp rx=0 tx=0).stop 2023-12-01T15:44:01.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 -- 172.21.15.63:0/157790637 shutdown_connections 2023-12-01T15:44:01.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f966c065b00 0x7f966c067fc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f968809de80 0x7f9688141050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9688141590 0x7f9688141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 --2- 172.21.15.63:0/157790637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9688133540 0x7f9688133920 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 -- 172.21.15.63:0/157790637 >> 172.21.15.63:0/157790637 conn(0x7f96880a96b0 msgr2=0x7f9688140540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:01.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 -- 172.21.15.63:0/157790637 shutdown_connections 2023-12-01T15:44:01.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.412+0000 7f968eb33700 1 -- 172.21.15.63:0/157790637 wait complete. 2023-12-01T15:44:01.426 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T15:44:01.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 Processor -- start 2023-12-01T15:44:01.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 -- start start 2023-12-01T15:44:01.543 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0eac06ba50 0x7f0eac06be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac06c370 0x7f0eac13f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac09c320 con 0x7f0eac13f590 2023-12-01T15:44:01.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac072830 con 0x7f0eac06ba50 2023-12-01T15:44:01.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac09b150 con 0x7f0eac06c370 2023-12-01T15:44:01.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0ea9d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac06c370 0x7f0eac13f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eaa59c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0eac06ba50 0x7f0eac06be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0ea9d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac06c370 0x7f0eac13f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:56358/0 (socket says 172.21.15.63:56358) 2023-12-01T15:44:01.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0ea9d9b700 1 -- 172.21.15.63:0/3080714209 learned_addr learned my addr 172.21.15.63:0/3080714209 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:01.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eaad9d700 1 --1- 172.21.15.63:0/3080714209 >> v1:172.21.15.66:6789/0 conn(0x7f0eac13f590 0x7f0eac141980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:44324/0 (socket says 172.21.15.63:44324) 2023-12-01T15:44:01.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0ea9d9b700 1 -- 172.21.15.63:0/3080714209 >> v2:172.21.15.66:3300/0 conn(0x7f0eac06ba50 msgr2=0x7f0eac06be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:01.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0ea9d9b700 1 --2- 172.21.15.63:0/3080714209 >> v2:172.21.15.66:3300/0 conn(0x7f0eac06ba50 0x7f0eac06be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0ea9d9b700 1 -- 172.21.15.63:0/3080714209 >> v1:172.21.15.66:6789/0 conn(0x7f0eac13f590 legacy=0x7f0eac141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0ea9d9b700 1 -- 172.21.15.63:0/3080714209 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac09d1e0 con 0x7f0eac06c370 2023-12-01T15:44:01.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0ea9d9b700 1 --2- 172.21.15.63:0/3080714209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac06c370 0x7f0eac13f050 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009910 tx=0x7f0ea0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3159ddb0c06c5e16 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:01.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0ea959a700 1 -- 172.21.15.63:0/3080714209 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0005e50 con 0x7f0eac06c370 2023-12-01T15:44:01.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0ea959a700 1 -- 172.21.15.63:0/3080714209 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0006030 con 0x7f0eac06c370 2023-12-01T15:44:01.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0ea959a700 1 -- 172.21.15.63:0/3080714209 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea00063e0 con 0x7f0eac06c370 2023-12-01T15:44:01.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 -- 172.21.15.63:0/3080714209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac06c370 msgr2=0x7f0eac13f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 --2- 172.21.15.63:0/3080714209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac06c370 0x7f0eac13f050 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009910 tx=0x7f0ea0009c20 comp rx=0 tx=0).stop 2023-12-01T15:44:01.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 -- 172.21.15.63:0/3080714209 shutdown_connections 2023-12-01T15:44:01.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 --2- 172.21.15.63:0/3080714209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac06c370 0x7f0eac13f050 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 --2- 172.21.15.63:0/3080714209 >> v2:172.21.15.66:3300/0 conn(0x7f0eac06ba50 0x7f0eac06be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 -- 172.21.15.63:0/3080714209 >> 172.21.15.63:0/3080714209 conn(0x7f0eac0738c0 msgr2=0x7f0eac0aa840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:01.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 -- 172.21.15.63:0/3080714209 shutdown_connections 2023-12-01T15:44:01.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.540+0000 7f0eab59e700 1 -- 172.21.15.63:0/3080714209 wait complete. 2023-12-01T15:44:01.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eab59e700 1 Processor -- start 2023-12-01T15:44:01.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eab59e700 1 -- start start 2023-12-01T15:44:01.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eab59e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eac06ba50 0x7f0eac135fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eab59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac06c370 0x7f0eac136520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eab59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac13f590 0x7f0eac136a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eab59e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0a38e0 con 0x7f0eac06ba50 2023-12-01T15:44:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eab59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0a36b0 con 0x7f0eac06c370 2023-12-01T15:44:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eab59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac071bf0 con 0x7f0eac13f590 2023-12-01T15:44:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eaa59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eac06ba50 0x7f0eac135fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eaa59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eac06ba50 0x7f0eac135fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36224/0 (socket says 172.21.15.63:36224) 2023-12-01T15:44:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eaa59c700 1 -- 172.21.15.63:0/318218646 learned_addr learned my addr 172.21.15.63:0/318218646 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0ea9d9b700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac06c370 0x7f0eac136520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eaad9d700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac13f590 0x7f0eac136a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0ea9d9b700 1 -- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac13f590 msgr2=0x7f0eac136a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0ea9d9b700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac13f590 0x7f0eac136a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0ea9d9b700 1 -- 172.21.15.63:0/318218646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eac06ba50 msgr2=0x7f0eac135fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0ea9d9b700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eac06ba50 0x7f0eac135fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0ea9d9b700 1 -- 172.21.15.63:0/318218646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0009520 con 0x7f0eac06c370 2023-12-01T15:44:01.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.544+0000 7f0eaa59c700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eac06ba50 0x7f0eac135fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:44:01.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.548+0000 7f0ea9d9b700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac06c370 0x7f0eac136520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0015000 tx=0x7f0ea0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:01.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.548+0000 7f0e9affd700 1 -- 172.21.15.63:0/318218646 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0004050 con 0x7f0eac06c370 2023-12-01T15:44:01.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.548+0000 7f0e9affd700 1 -- 172.21.15.63:0/318218646 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea00041d0 con 0x7f0eac06c370 2023-12-01T15:44:01.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.548+0000 7f0eab59e700 1 -- 172.21.15.63:0/318218646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac13d8c0 con 0x7f0eac06c370 2023-12-01T15:44:01.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.548+0000 7f0e9affd700 1 -- 172.21.15.63:0/318218646 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0004580 con 0x7f0eac06c370 2023-12-01T15:44:01.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.548+0000 7f0eab59e700 1 -- 172.21.15.63:0/318218646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac0a42e0 con 0x7f0eac06c370 2023-12-01T15:44:01.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.548+0000 7f0eab59e700 1 -- 172.21.15.63:0/318218646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac065fb0 con 0x7f0eac06c370 2023-12-01T15:44:01.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.548+0000 7f0e9affd700 1 -- 172.21.15.63:0/318218646 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0ea0022070 con 0x7f0eac06c370 2023-12-01T15:44:01.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.548+0000 7f0e9affd700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0e8c065ad0 0x7f0e8c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.548+0000 7f0e9affd700 1 -- 172.21.15.63:0/318218646 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f0ea0084300 con 0x7f0eac06c370 2023-12-01T15:44:01.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.548+0000 7f0eaa59c700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0e8c065ad0 0x7f0e8c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.552+0000 7f0eaa59c700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0e8c065ad0 0x7f0e8c067f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0113d0 tx=0x7f0e9c009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:01.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.560+0000 7f0e9affd700 1 -- 172.21.15.63:0/318218646 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0ea0052210 con 0x7f0eac06c370 2023-12-01T15:44:01.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.720+0000 7f0eab59e700 1 -- 172.21.15.63:0/318218646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0eac09a520 con 0x7f0eac06c370 2023-12-01T15:44:01.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.724+0000 7f0e9affd700 1 -- 172.21.15.63:0/318218646 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ea0055830 con 0x7f0eac06c370 2023-12-01T15:44:01.727 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-01T15:44:01.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 -- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0e8c065ad0 msgr2=0x7f0e8c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0e8c065ad0 0x7f0e8c067f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0113d0 tx=0x7f0e9c009240 comp rx=0 tx=0).stop 2023-12-01T15:44:01.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 -- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac06c370 msgr2=0x7f0eac136520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac06c370 0x7f0eac136520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0015000 tx=0x7f0ea0004770 comp rx=0 tx=0).stop 2023-12-01T15:44:01.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 -- 172.21.15.63:0/318218646 shutdown_connections 2023-12-01T15:44:01.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0e8c065ad0 0x7f0e8c067f90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac13f590 0x7f0eac136a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac06c370 0x7f0eac136520 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 --2- 172.21.15.63:0/318218646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eac06ba50 0x7f0eac135fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 -- 172.21.15.63:0/318218646 >> 172.21.15.63:0/318218646 conn(0x7f0eac0738c0 msgr2=0x7f0eac0a95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 -- 172.21.15.63:0/318218646 shutdown_connections 2023-12-01T15:44:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.728+0000 7f0eab59e700 1 -- 172.21.15.63:0/318218646 wait complete. 2023-12-01T15:44:01.748 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T15:44:01.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9a43700 1 Processor -- start 2023-12-01T15:44:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9a43700 1 -- start start 2023-12-01T15:44:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9a43700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f55a4135760 0x7f55a413d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9a43700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55a4135bf0 0x7f55a413fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9a43700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a40a08e0 con 0x7f55a4136a10 2023-12-01T15:44:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9a43700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40a14b0 con 0x7f55a4135bf0 2023-12-01T15:44:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9a43700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40a11f0 con 0x7f55a4135760 2023-12-01T15:44:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9242700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55a4135bf0 0x7f55a413fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9242700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f55a4135bf0 0x7f55a413fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36230/0 (socket says 172.21.15.63:36230) 2023-12-01T15:44:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9242700 1 -- 172.21.15.63:0/905308980 learned_addr learned my addr 172.21.15.63:0/905308980 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:01.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a3fff700 1 --2- 172.21.15.63:0/905308980 >> v2:172.21.15.66:3300/0 conn(0x7f55a4135760 0x7f55a413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9242700 1 -- 172.21.15.63:0/905308980 >> v2:172.21.15.66:3300/0 conn(0x7f55a4135760 msgr2=0x7f55a413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9242700 1 --2- 172.21.15.63:0/905308980 >> v2:172.21.15.66:3300/0 conn(0x7f55a4135760 0x7f55a413d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9242700 1 -- 172.21.15.63:0/905308980 >> v1:172.21.15.66:6789/0 conn(0x7f55a4136a10 legacy=0x7f55a4135050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9242700 1 -- 172.21.15.63:0/905308980 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a4136170 con 0x7f55a4135bf0 2023-12-01T15:44:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a9242700 1 --2- 172.21.15.63:0/905308980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4135bf0 0x7f55a413fa60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f55a40a6bd0 tx=0x7f559c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55e123e7089f862 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a37fe700 1 -- 172.21.15.63:0/905308980 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c00e070 con 0x7f55a4135bf0 2023-12-01T15:44:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a37fe700 1 -- 172.21.15.63:0/905308980 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c00b910 con 0x7f55a4135bf0 2023-12-01T15:44:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.856+0000 7f55a37fe700 1 -- 172.21.15.63:0/905308980 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c00bcc0 con 0x7f55a4135bf0 2023-12-01T15:44:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 -- 172.21.15.63:0/905308980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4135bf0 msgr2=0x7f55a413fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 --2- 172.21.15.63:0/905308980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4135bf0 0x7f55a413fa60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f55a40a6bd0 tx=0x7f559c00b330 comp rx=0 tx=0).stop 2023-12-01T15:44:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 -- 172.21.15.63:0/905308980 shutdown_connections 2023-12-01T15:44:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 --2- 172.21.15.63:0/905308980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4135bf0 0x7f55a413fa60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 --2- 172.21.15.63:0/905308980 >> v2:172.21.15.66:3300/0 conn(0x7f55a4135760 0x7f55a413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 -- 172.21.15.63:0/905308980 >> 172.21.15.63:0/905308980 conn(0x7f55a40a9a90 msgr2=0x7f55a40a5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 -- 172.21.15.63:0/905308980 shutdown_connections 2023-12-01T15:44:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 -- 172.21.15.63:0/905308980 wait complete. 2023-12-01T15:44:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 Processor -- start 2023-12-01T15:44:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 -- start start 2023-12-01T15:44:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4135760 0x7f55a41cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4135bf0 0x7f55a41cf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55a4136a10 0x7f55a41cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4071340 con 0x7f55a4135bf0 2023-12-01T15:44:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a406ac60 con 0x7f55a4135760 2023-12-01T15:44:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9a43700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4134140 con 0x7f55a4136a10 2023-12-01T15:44:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4135bf0 0x7f55a41cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4135bf0 0x7f55a41cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36242/0 (socket says 172.21.15.63:36242) 2023-12-01T15:44:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a3fff700 1 -- 172.21.15.63:0/541468528 learned_addr learned my addr 172.21.15.63:0/541468528 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a9242700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55a4136a10 0x7f55a41cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a8a41700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4135760 0x7f55a41cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a3fff700 1 -- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55a4136a10 msgr2=0x7f55a41cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a3fff700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55a4136a10 0x7f55a41cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a3fff700 1 -- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4135760 msgr2=0x7f55a41cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a3fff700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4135760 0x7f55a41cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.860+0000 7f55a3fff700 1 -- 172.21.15.63:0/541468528 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c009b30 con 0x7f55a4135bf0 2023-12-01T15:44:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.864+0000 7f55a3fff700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4135bf0 0x7f55a41cf880 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f559400e9e0 tx=0x7f559400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.864+0000 7f55a17fa700 1 -- 172.21.15.63:0/541468528 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594009710 con 0x7f55a4135bf0 2023-12-01T15:44:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.864+0000 7f55a9a43700 1 -- 172.21.15.63:0/541468528 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a4134d40 con 0x7f55a4135bf0 2023-12-01T15:44:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.864+0000 7f55a17fa700 1 -- 172.21.15.63:0/541468528 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559400ee80 con 0x7f55a4135bf0 2023-12-01T15:44:01.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.864+0000 7f55a17fa700 1 -- 172.21.15.63:0/541468528 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559400ca50 con 0x7f55a4135bf0 2023-12-01T15:44:01.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.864+0000 7f55a9a43700 1 -- 172.21.15.63:0/541468528 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a4072170 con 0x7f55a4135bf0 2023-12-01T15:44:01.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.864+0000 7f55a9a43700 1 -- 172.21.15.63:0/541468528 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a4065fb0 con 0x7f55a4135bf0 2023-12-01T15:44:01.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.864+0000 7f55a17fa700 1 -- 172.21.15.63:0/541468528 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f559400cbb0 con 0x7f55a4135bf0 2023-12-01T15:44:01.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.864+0000 7f55a17fa700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f5590065ad0 0x7f5590067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:01.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.864+0000 7f55a17fa700 1 -- 172.21.15.63:0/541468528 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f5594082fc0 con 0x7f55a4135bf0 2023-12-01T15:44:01.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.868+0000 7f55a8a41700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f5590065ad0 0x7f5590067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:01.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.868+0000 7f55a8a41700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f5590065ad0 0x7f5590067f90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5598001800 tx=0x7f5598009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:01.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:01.872+0000 7f55a17fa700 1 -- 172.21.15.63:0/541468528 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f55940b4070 con 0x7f55a4135bf0 2023-12-01T15:44:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.072+0000 7f55a9a43700 1 -- 172.21.15.63:0/541468528 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55a4061d90 con 0x7f55a4135bf0 2023-12-01T15:44:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.072+0000 7f55a17fa700 1 -- 172.21.15.63:0/541468528 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3130 (secure 0 0 0) 0x7f5594021090 con 0x7f55a4135bf0 2023-12-01T15:44:02.078 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:44:02.078 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6817/2060518783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2060518783},{"type":"v1","addr":"172.21.15.63:6817","nonce":2060518783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T15:43:45.544844+0000","modified":"2023-12-01T15:43:48.562365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6819/2416365697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2416365697},{"type":"v1","addr":"172.21.15.66:6819","nonce":2416365697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T15:44:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 -- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f5590065ad0 msgr2=0x7f5590067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f5590065ad0 0x7f5590067f90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5598001800 tx=0x7f5598009040 comp rx=0 tx=0).stop 2023-12-01T15:44:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 -- 172.21.15.63:0/541468528 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4135bf0 msgr2=0x7f55a41cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4135bf0 0x7f55a41cf880 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f559400e9e0 tx=0x7f559400ecf0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 -- 172.21.15.63:0/541468528 shutdown_connections 2023-12-01T15:44:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f5590065ad0 0x7f5590067f90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55a4136a10 0x7f55a41cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55a4135bf0 0x7f55a41cf880 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 --2- 172.21.15.63:0/541468528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4135760 0x7f55a41cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 -- 172.21.15.63:0/541468528 >> 172.21.15.63:0/541468528 conn(0x7f55a40a9a90 msgr2=0x7f55a40a7360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 -- 172.21.15.63:0/541468528 shutdown_connections 2023-12-01T15:44:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.076+0000 7f55a9a43700 1 -- 172.21.15.63:0/541468528 wait complete. 2023-12-01T15:44:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2023-12-01T15:44:02.092 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:44:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa952193700 1 Processor -- start 2023-12-01T15:44:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa952193700 1 -- start start 2023-12-01T15:44:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa952193700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa94c13d990 0x7fa94c13fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa952193700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c06cde0 con 0x7fa94c137740 2023-12-01T15:44:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa952193700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c09d180 con 0x7fa94c1402c0 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa952193700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94c09cf90 con 0x7fa94c13d990 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa950990700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa94c13d990 0x7fa94c13fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa951191700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa94c137740 0x7fa94c137b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48502/0 (socket says 172.21.15.63:48502) 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa951191700 1 -- 172.21.15.63:0/203124129 learned_addr learned my addr 172.21.15.63:0/203124129 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa950990700 1 -- 172.21.15.63:0/203124129 >> v1:172.21.15.66:6789/0 conn(0x7fa94c1402c0 legacy=0x7fa94c1426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa950990700 1 -- 172.21.15.63:0/203124129 >> v1:172.21.15.63:6789/0 conn(0x7fa94c137740 legacy=0x7fa94c137b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa950990700 1 -- 172.21.15.63:0/203124129 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c06c400 con 0x7fa94c13d990 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa950990700 1 --2- 172.21.15.63:0/203124129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c13d990 0x7fa94c13fd80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa948009850 tx=0x7fa948009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902413e6209ed1e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.192+0000 7fa943fff700 1 -- 172.21.15.63:0/203124129 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa948004230 con 0x7fa94c13d990 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa943fff700 1 -- 172.21.15.63:0/203124129 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa948004390 con 0x7fa94c13d990 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa943fff700 1 -- 172.21.15.63:0/203124129 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9480036c0 con 0x7fa94c13d990 2023-12-01T15:44:02.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 -- 172.21.15.63:0/203124129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c13d990 msgr2=0x7fa94c13fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 --2- 172.21.15.63:0/203124129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c13d990 0x7fa94c13fd80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa948009850 tx=0x7fa948009b60 comp rx=0 tx=0).stop 2023-12-01T15:44:02.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 -- 172.21.15.63:0/203124129 shutdown_connections 2023-12-01T15:44:02.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 --2- 172.21.15.63:0/203124129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c13d990 0x7fa94c13fd80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 -- 172.21.15.63:0/203124129 >> 172.21.15.63:0/203124129 conn(0x7fa94c073990 msgr2=0x7fa94c0acad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:02.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 -- 172.21.15.63:0/203124129 shutdown_connections 2023-12-01T15:44:02.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 -- 172.21.15.63:0/203124129 wait complete. 2023-12-01T15:44:02.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 Processor -- start 2023-12-01T15:44:02.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 -- start start 2023-12-01T15:44:02.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c137740 0x7fa94c138580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c13d990 0x7fa94c138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c1402c0 0x7fa94c139000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c13aff0 con 0x7fa94c1402c0 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c13a3d0 con 0x7fa94c137740 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa952193700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c0a0bd0 con 0x7fa94c13d990 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa951992700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c1402c0 0x7fa94c139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa951992700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c1402c0 0x7fa94c139000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36252/0 (socket says 172.21.15.63:36252) 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa950990700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c13d990 0x7fa94c138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa951191700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c137740 0x7fa94c138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.196+0000 7fa951992700 1 -- 172.21.15.63:0/3065360784 learned_addr learned my addr 172.21.15.63:0/3065360784 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa951992700 1 -- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c13d990 msgr2=0x7fa94c138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa951992700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c13d990 0x7fa94c138ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa951992700 1 -- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c137740 msgr2=0x7fa94c138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa951992700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c137740 0x7fa94c138580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa951992700 1 -- 172.21.15.63:0/3065360784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9480094b0 con 0x7fa94c1402c0 2023-12-01T15:44:02.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa951992700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c1402c0 0x7fa94c139000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa94400cba0 tx=0x7fa94400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:02.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa941ffb700 1 -- 172.21.15.63:0/3065360784 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94400aaa0 con 0x7fa94c1402c0 2023-12-01T15:44:02.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa941ffb700 1 -- 172.21.15.63:0/3065360784 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94400ac00 con 0x7fa94c1402c0 2023-12-01T15:44:02.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa952193700 1 -- 172.21.15.63:0/3065360784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c13a610 con 0x7fa94c1402c0 2023-12-01T15:44:02.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa941ffb700 1 -- 172.21.15.63:0/3065360784 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944012420 con 0x7fa94c1402c0 2023-12-01T15:44:02.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa952193700 1 -- 172.21.15.63:0/3065360784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c0a12c0 con 0x7fa94c1402c0 2023-12-01T15:44:02.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa952193700 1 -- 172.21.15.63:0/3065360784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c065fb0 con 0x7fa94c1402c0 2023-12-01T15:44:02.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.200+0000 7fa941ffb700 1 -- 172.21.15.63:0/3065360784 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa944012580 con 0x7fa94c1402c0 2023-12-01T15:44:02.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.204+0000 7fa941ffb700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa930065ad0 0x7fa930067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:02.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.204+0000 7fa941ffb700 1 -- 172.21.15.63:0/3065360784 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fa944083270 con 0x7fa94c1402c0 2023-12-01T15:44:02.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.204+0000 7fa951191700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa930065ad0 0x7fa930067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:02.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.204+0000 7fa951191700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa930065ad0 0x7fa930067f90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa93c000f60 tx=0x7fa93c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:02.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.208+0000 7fa941ffb700 1 -- 172.21.15.63:0/3065360784 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa944051180 con 0x7fa94c1402c0 2023-12-01T15:44:02.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.364+0000 7fa952193700 1 -- 172.21.15.63:0/3065360784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa94c061d90 con 0x7fa94c1402c0 2023-12-01T15:44:02.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.368+0000 7fa941ffb700 1 -- 172.21.15.63:0/3065360784 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7fa944016020 con 0x7fa94c1402c0 2023-12-01T15:44:02.372 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:44:02.372 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:43:46.548806+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:44:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.368+0000 7fa952193700 1 -- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa930065ad0 msgr2=0x7fa930067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.372+0000 7fa952193700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa930065ad0 0x7fa930067f90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa93c000f60 tx=0x7fa93c009040 comp rx=0 tx=0).stop 2023-12-01T15:44:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.372+0000 7fa952193700 1 -- 172.21.15.63:0/3065360784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c1402c0 msgr2=0x7fa94c139000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.372+0000 7fa952193700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c1402c0 0x7fa94c139000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa94400cba0 tx=0x7fa94400ceb0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.372+0000 7fa952193700 1 -- 172.21.15.63:0/3065360784 shutdown_connections 2023-12-01T15:44:02.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.372+0000 7fa952193700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa930065ad0 0x7fa930067f90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.372+0000 7fa952193700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa94c13d990 0x7fa94c138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.372+0000 7fa952193700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa94c1402c0 0x7fa94c139000 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.372+0000 7fa952193700 1 --2- 172.21.15.63:0/3065360784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa94c137740 0x7fa94c138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.372+0000 7fa952193700 1 -- 172.21.15.63:0/3065360784 >> 172.21.15.63:0/3065360784 conn(0x7fa94c073990 msgr2=0x7fa94c09b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:02.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.372+0000 7fa952193700 1 -- 172.21.15.63:0/3065360784 shutdown_connections 2023-12-01T15:44:02.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.372+0000 7fa952193700 1 -- 172.21.15.63:0/3065360784 wait complete. 2023-12-01T15:44:02.387 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T15:44:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 Processor -- start 2023-12-01T15:44:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 -- start start 2023-12-01T15:44:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f800c13b330 0x7f800c137790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f800c137cd0 0x7f800c142970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800c0a4b20 con 0x7f800c13af50 2023-12-01T15:44:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c0a3540 con 0x7f800c137cd0 2023-12-01T15:44:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c0a3880 con 0x7f800c13b330 2023-12-01T15:44:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f801264f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f800c137cd0 0x7f800c142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8011e4e700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f800c13af50 0x7f800c137080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48508/0 (socket says 172.21.15.63:48508) 2023-12-01T15:44:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8011e4e700 1 -- 172.21.15.63:0/3653922693 learned_addr learned my addr 172.21.15.63:0/3653922693 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:44:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f801164d700 1 --2- 172.21.15.63:0/3653922693 >> v2:172.21.15.66:3300/0 conn(0x7f800c13b330 0x7f800c137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f801264f700 1 -- 172.21.15.63:0/3653922693 >> v2:172.21.15.66:3300/0 conn(0x7f800c13b330 msgr2=0x7f800c137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f801264f700 1 --2- 172.21.15.63:0/3653922693 >> v2:172.21.15.66:3300/0 conn(0x7f800c13b330 0x7f800c137790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f801264f700 1 -- 172.21.15.63:0/3653922693 >> v1:172.21.15.63:6789/0 conn(0x7f800c13af50 legacy=0x7f800c137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f801264f700 1 -- 172.21.15.63:0/3653922693 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c0a3270 con 0x7f800c137cd0 2023-12-01T15:44:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f801264f700 1 --2- 172.21.15.63:0/3653922693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c137cd0 0x7f800c142970 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8004009d90 tx=0x7f800400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45331a27275eac1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8010e4c700 1 -- 172.21.15.63:0/3653922693 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400e070 con 0x7f800c137cd0 2023-12-01T15:44:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8010e4c700 1 -- 172.21.15.63:0/3653922693 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800400bb90 con 0x7f800c137cd0 2023-12-01T15:44:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8010e4c700 1 -- 172.21.15.63:0/3653922693 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004012430 con 0x7f800c137cd0 2023-12-01T15:44:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 -- 172.21.15.63:0/3653922693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c137cd0 msgr2=0x7f800c142970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 --2- 172.21.15.63:0/3653922693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c137cd0 0x7f800c142970 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8004009d90 tx=0x7f800400b330 comp rx=0 tx=0).stop 2023-12-01T15:44:02.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 -- 172.21.15.63:0/3653922693 shutdown_connections 2023-12-01T15:44:02.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 --2- 172.21.15.63:0/3653922693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c137cd0 0x7f800c142970 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 --2- 172.21.15.63:0/3653922693 >> v2:172.21.15.66:3300/0 conn(0x7f800c13b330 0x7f800c137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 -- 172.21.15.63:0/3653922693 >> 172.21.15.63:0/3653922693 conn(0x7f800c0a8bd0 msgr2=0x7f800c098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:02.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 -- 172.21.15.63:0/3653922693 shutdown_connections 2023-12-01T15:44:02.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.492+0000 7f8012e50700 1 -- 172.21.15.63:0/3653922693 wait complete. 2023-12-01T15:44:02.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8012e50700 1 Processor -- start 2023-12-01T15:44:02.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8012e50700 1 -- start start 2023-12-01T15:44:02.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8012e50700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f800c137cd0 0x7f800c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:02.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8012e50700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f800c13af50 0x7f800c06f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8012e50700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c06fc30 0x7f800c133150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8012e50700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c11fd20 con 0x7f800c06fc30 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8012e50700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c11ee10 con 0x7f800c13af50 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8012e50700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c0710a0 con 0x7f800c137cd0 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f801264f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c06fc30 0x7f800c133150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f801264f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c06fc30 0x7f800c133150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36282/0 (socket says 172.21.15.63:36282) 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f801264f700 1 -- 172.21.15.63:0/3597391390 learned_addr learned my addr 172.21.15.63:0/3597391390 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f801164d700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f800c13af50 0x7f800c06f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8011e4e700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f800c137cd0 0x7f800c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f801264f700 1 -- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f800c137cd0 msgr2=0x7f800c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f801264f700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f800c137cd0 0x7f800c06f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f801264f700 1 -- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f800c13af50 msgr2=0x7f800c06f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f801264f700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f800c13af50 0x7f800c06f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f801264f700 1 -- 172.21.15.63:0/3597391390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004009a70 con 0x7f800c06fc30 2023-12-01T15:44:02.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f801264f700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c06fc30 0x7f800c133150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8004013000 tx=0x7f8004004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:02.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f80027fc700 1 -- 172.21.15.63:0/3597391390 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004012430 con 0x7f800c06fc30 2023-12-01T15:44:02.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f80027fc700 1 -- 172.21.15.63:0/3597391390 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8004020070 con 0x7f800c06fc30 2023-12-01T15:44:02.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8012e50700 1 -- 172.21.15.63:0/3597391390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c11f6a0 con 0x7f800c06fc30 2023-12-01T15:44:02.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f80027fc700 1 -- 172.21.15.63:0/3597391390 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004004280 con 0x7f800c06fc30 2023-12-01T15:44:02.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8012e50700 1 -- 172.21.15.63:0/3597391390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c070260 con 0x7f800c06fc30 2023-12-01T15:44:02.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.496+0000 7f8012e50700 1 -- 172.21.15.63:0/3597391390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c065fb0 con 0x7f800c06fc30 2023-12-01T15:44:02.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.500+0000 7f80027fc700 1 -- 172.21.15.63:0/3597391390 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f80040043e0 con 0x7f800c06fc30 2023-12-01T15:44:02.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.500+0000 7f80027fc700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7ff0065ad0 0x7f7ff0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:02.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.500+0000 7f80027fc700 1 -- 172.21.15.63:0/3597391390 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f8004022070 con 0x7f800c06fc30 2023-12-01T15:44:02.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.500+0000 7f8011e4e700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7ff0065ad0 0x7f7ff0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:02.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.500+0000 7f8011e4e700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7ff0065ad0 0x7f7ff0067f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc000f60 tx=0x7f7ffc007f30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:02.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.508+0000 7f80027fc700 1 -- 172.21.15.63:0/3597391390 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f8004052ba0 con 0x7f800c06fc30 2023-12-01T15:44:02.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.708+0000 7f8012e50700 1 -- 172.21.15.63:0/3597391390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f800c061d90 con 0x7f800c06fc30 2023-12-01T15:44:02.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.708+0000 7f80027fc700 1 -- 172.21.15.63:0/3597391390 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3130 (secure 0 0 0) 0x7f80040561c0 con 0x7f800c06fc30 2023-12-01T15:44:02.714 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:44:02.714 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6817/2060518783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2060518783},{"type":"v1","addr":"172.21.15.63:6817","nonce":2060518783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T15:43:45.544844+0000","modified":"2023-12-01T15:43:48.562365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6819/2416365697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2416365697},{"type":"v1","addr":"172.21.15.66:6819","nonce":2416365697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 -- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7ff0065ad0 msgr2=0x7f7ff0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7ff0065ad0 0x7f7ff0067f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc000f60 tx=0x7f7ffc007f30 comp rx=0 tx=0).stop 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 -- 172.21.15.63:0/3597391390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c06fc30 msgr2=0x7f800c133150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c06fc30 0x7f800c133150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8004013000 tx=0x7f8004004af0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 -- 172.21.15.63:0/3597391390 shutdown_connections 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7ff0065ad0 0x7f7ff0067f90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c06fc30 0x7f800c133150 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f800c13af50 0x7f800c06f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 --2- 172.21.15.63:0/3597391390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f800c137cd0 0x7f800c06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 -- 172.21.15.63:0/3597391390 >> 172.21.15.63:0/3597391390 conn(0x7f800c0a8bd0 msgr2=0x7f800c098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 -- 172.21.15.63:0/3597391390 shutdown_connections 2023-12-01T15:44:02.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:02.712+0000 7f8012e50700 1 -- 172.21.15.63:0/3597391390 wait complete. 2023-12-01T15:44:02.718 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2023-12-01T15:44:02.931 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-01T15:43:45.544844+0000', 'modified': '2023-12-01T15:43:48.562365+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4212}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4212': {'gid': 4212, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6819/2416365697', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6818', 'nonce': 2416365697}, {'type': 'v1', 'addr': '172.21.15.66:6819', 'nonce': 2416365697}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-01T15:44:02.931 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-01T15:44:02.931 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-01T15:44:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc3a49d6700 1 Processor -- start 2023-12-01T15:44:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc3a49d6700 1 -- start start 2023-12-01T15:44:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc3a49d6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3a0137ac0 0x7fc3a006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc3a49d6700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc3a01408b0 0x7fc3a0142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc3a49d6700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a009c240 con 0x7fc3a01376e0 2023-12-01T15:44:03.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc3a49d6700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a009bc90 con 0x7fc3a01408b0 2023-12-01T15:44:03.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc3a49d6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a009bf80 con 0x7fc3a0137ac0 2023-12-01T15:44:03.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc39f7fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc3a01376e0 0x7fc3a006ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48518/0 (socket says 172.21.15.63:48518) 2023-12-01T15:44:03.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc39f7fe700 1 -- 172.21.15.63:0/628475514 learned_addr learned my addr 172.21.15.63:0/628475514 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:44:03.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc39ffff700 1 --2- 172.21.15.63:0/628475514 >> v2:172.21.15.66:3300/0 conn(0x7fc3a01408b0 0x7fc3a0142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc39effd700 1 --2- 172.21.15.63:0/628475514 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3a0137ac0 0x7fc3a006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc39e7fc700 1 -- 172.21.15.63:0/628475514 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234830734 0 0) 0x7fc3a009c240 con 0x7fc3a01376e0 2023-12-01T15:44:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc39e7fc700 1 -- 172.21.15.63:0/628475514 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3800035d0 con 0x7fc3a01376e0 2023-12-01T15:44:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc39ffff700 1 -- 172.21.15.63:0/628475514 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3a0137ac0 msgr2=0x7fc3a006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc39ffff700 1 --2- 172.21.15.63:0/628475514 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3a0137ac0 0x7fc3a006c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc39ffff700 1 -- 172.21.15.63:0/628475514 >> v1:172.21.15.63:6789/0 conn(0x7fc3a01376e0 legacy=0x7fc3a006ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.052+0000 7fc39ffff700 1 -- 172.21.15.63:0/628475514 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a009ebd0 con 0x7fc3a01408b0 2023-12-01T15:44:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc39ffff700 1 --2- 172.21.15.63:0/628475514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a01408b0 0x7fc3a0142ca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc398009850 tx=0x7fc398009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbe0cad7f6ca8c0e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc39e7fc700 1 -- 172.21.15.63:0/628475514 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398011830 con 0x7fc3a01408b0 2023-12-01T15:44:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc39e7fc700 1 -- 172.21.15.63:0/628475514 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc398011990 con 0x7fc3a01408b0 2023-12-01T15:44:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc39e7fc700 1 -- 172.21.15.63:0/628475514 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398011d40 con 0x7fc3a01408b0 2023-12-01T15:44:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 -- 172.21.15.63:0/628475514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a01408b0 msgr2=0x7fc3a0142ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 --2- 172.21.15.63:0/628475514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a01408b0 0x7fc3a0142ca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc398009850 tx=0x7fc398009b60 comp rx=0 tx=0).stop 2023-12-01T15:44:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 -- 172.21.15.63:0/628475514 shutdown_connections 2023-12-01T15:44:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 --2- 172.21.15.63:0/628475514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a01408b0 0x7fc3a0142ca0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 --2- 172.21.15.63:0/628475514 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3a0137ac0 0x7fc3a006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 -- 172.21.15.63:0/628475514 >> 172.21.15.63:0/628475514 conn(0x7fc3a00737a0 msgr2=0x7fc3a00ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 -- 172.21.15.63:0/628475514 shutdown_connections 2023-12-01T15:44:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 -- 172.21.15.63:0/628475514 wait complete. 2023-12-01T15:44:03.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 Processor -- start 2023-12-01T15:44:03.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 -- start start 2023-12-01T15:44:03.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3a01376e0 0x7fc3a012e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a0137ac0 0x7fc3a012e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3a01408b0 0x7fc3a01cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0136a20 con 0x7fc3a01376e0 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a013a9b0 con 0x7fc3a0137ac0 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc3a49d6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0138650 con 0x7fc3a01408b0 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc39f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3a01376e0 0x7fc3a012e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc39f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3a01376e0 0x7fc3a012e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36290/0 (socket says 172.21.15.63:36290) 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc39f7fe700 1 -- 172.21.15.63:0/1581511063 learned_addr learned my addr 172.21.15.63:0/1581511063 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc39effd700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a0137ac0 0x7fc3a012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.056+0000 7fc39ffff700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3a01408b0 0x7fc3a01cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc39f7fe700 1 -- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3a01408b0 msgr2=0x7fc3a01cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3a01408b0 0x7fc3a01cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc39f7fe700 1 -- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a0137ac0 msgr2=0x7fc3a012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a0137ac0 0x7fc3a012e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc39f7fe700 1 -- 172.21.15.63:0/1581511063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3980094b0 con 0x7fc3a01376e0 2023-12-01T15:44:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc39effd700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a0137ac0 0x7fc3a012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:44:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3a01376e0 0x7fc3a012e420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c700 tx=0x7fc38800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc397fff700 1 -- 172.21.15.63:0/1581511063 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388005d90 con 0x7fc3a01376e0 2023-12-01T15:44:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc3a49d6700 1 -- 172.21.15.63:0/1581511063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a012eea0 con 0x7fc3a01376e0 2023-12-01T15:44:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc397fff700 1 -- 172.21.15.63:0/1581511063 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3880070d0 con 0x7fc3a01376e0 2023-12-01T15:44:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc397fff700 1 -- 172.21.15.63:0/1581511063 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388007440 con 0x7fc3a01376e0 2023-12-01T15:44:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.060+0000 7fc3a49d6700 1 -- 172.21.15.63:0/1581511063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a013bba0 con 0x7fc3a01376e0 2023-12-01T15:44:03.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc397fff700 1 -- 172.21.15.63:0/1581511063 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc3880075a0 con 0x7fc3a01376e0 2023-12-01T15:44:03.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc397fff700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc384065ad0 0x7fc384067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc3a8ec0740 1 Processor -- start 2023-12-01T15:44:03.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc397fff700 1 -- 172.21.15.63:0/1581511063 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fc388081f00 con 0x7fc3a01376e0 2023-12-01T15:44:03.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc3a8ec0740 1 -- start start 2023-12-01T15:44:03.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39effd700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc384065ad0 0x7fc384067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1f87920 0x2015180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1ff9730 0x2016cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x20171f0 0x20175d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f0bdd0 con 0x20171f0 2023-12-01T15:44:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f655b0 con 0x1ff9730 2023-12-01T15:44:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f62d40 con 0x1f87920 2023-12-01T15:44:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x20171f0 0x20175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x20171f0 0x20175d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36306/0 (socket says 172.21.15.63:36306) 2023-12-01T15:44:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39f7fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1f87920 0x2015180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39ffff700 1 -- 172.21.15.63:0/1280252521 learned_addr learned my addr 172.21.15.63:0/1280252521 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39effd700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc384065ad0 0x7fc384067f90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc3a006daa0 tx=0x7fc39000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39effd700 1 --2- 172.21.15.63:0/1280252521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1ff9730 0x2016cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39f7fe700 1 -- 172.21.15.63:0/1280252521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1ff9730 msgr2=0x2016cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/1280252521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1ff9730 0x2016cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39f7fe700 1 -- 172.21.15.63:0/1280252521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x20171f0 msgr2=0x20175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/1280252521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x20171f0 0x20175d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39f7fe700 1 -- 172.21.15.63:0/1280252521 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1dd1960 con 0x1f87920 2023-12-01T15:44:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39ffff700 1 --2- 172.21.15.63:0/1280252521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x20171f0 0x20175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:44:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.064+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/1280252521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1f87920 0x2015180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc388080a70 tx=0x7fc3880539f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=187f42c2b3f37026 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3957fa700 1 -- 172.21.15.63:0/1280252521 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388053ba0 con 0x1f87920 2023-12-01T15:44:03.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3957fa700 1 -- 172.21.15.63:0/1280252521 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc388057920 con 0x1f87920 2023-12-01T15:44:03.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3957fa700 1 -- 172.21.15.63:0/1280252521 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38805bad0 con 0x1f87920 2023-12-01T15:44:03.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/1280252521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1f87920 msgr2=0x2015180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/1280252521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1f87920 0x2015180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc388080a70 tx=0x7fc3880539f0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/1280252521 shutdown_connections 2023-12-01T15:44:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/1280252521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x20171f0 0x20175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/1280252521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1ff9730 0x2016cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/1280252521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1f87920 0x2015180 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/1280252521 >> 172.21.15.63:0/1280252521 conn(0x1d864d0 msgr2=0x2014a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/1280252521 shutdown_connections 2023-12-01T15:44:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.068+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/1280252521 wait complete. 2023-12-01T15:44:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 -- start start 2023-12-01T15:44:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 Processor -- start 2023-12-01T15:44:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x1ff3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1ff9730 0x2010160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x20171f0 0x20106a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f5e630 con 0x1f87920 2023-12-01T15:44:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f1bc80 con 0x1ff9730 2023-12-01T15:44:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f21b00 con 0x20171f0 2023-12-01T15:44:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 10 client.0 _ll_register_callbacks cb 0x1f66e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T15:44:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x1ff3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x1ff3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36308/0 (socket says 172.21.15.63:36308) 2023-12-01T15:44:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39f7fe700 1 -- 172.21.15.63:0/188069338 learned_addr learned my addr 172.21.15.63:0/188069338 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39effd700 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1ff9730 0x2010160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39ffff700 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x20171f0 0x20106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39f7fe700 1 -- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x20171f0 msgr2=0x20106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x20171f0 0x20106a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39f7fe700 1 -- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1ff9730 msgr2=0x2010160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1ff9730 0x2010160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39f7fe700 1 -- 172.21.15.63:0/188069338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a009ebd0 con 0x1f87920 2023-12-01T15:44:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39ffff700 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x20171f0 0x20106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x1ff3630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc388053ae0 tx=0x7fc38801e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa38ca2563df7224 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc38e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc38e7fc700 1 -- 172.21.15.63:0/188069338 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38805b840 con 0x1f87920 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc38e7fc700 1 -- 172.21.15.63:0/188069338 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fc38805bad0 con 0x1f87920 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/188069338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f576b0 con 0x1f87920 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc38e7fc700 1 -- 172.21.15.63:0/188069338 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc388053ba0 con 0x1f87920 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 10 client.4575 fetch_fsmap learned FSMap version 8 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/188069338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7fc3a013bba0 con 0x1f87920 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc38e7fc700 1 -- 172.21.15.63:0/188069338 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f576b0 con 0x1f87920 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc38e7fc700 1 -- 172.21.15.63:0/188069338 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 8) v1 ==== 2016+0+0 (secure 0 0 0) 0x7fc38805bd20 con 0x1f87920 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 10 client.4575 fetch_fsmap finished waiting for FSMap version 8 2023-12-01T15:44:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 10 client.4575 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-01T15:44:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 20 client.4575 populate_metadata read hostname 'smithi063' 2023-12-01T15:44:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:6818/2416365697,v1:172.21.15.66:6819/2416365697] conn(0x202beb0 0x202e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 4 client.4575 mds_command: new command op to 4212 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T15:44:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/188069338 --> [v2:172.21.15.66:6818/2416365697,v1:172.21.15.66:6819/2416365697] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f19a00 con 0x202beb0 2023-12-01T15:44:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39effd700 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:6818/2416365697,v1:172.21.15.66:6819/2416365697] conn(0x202beb0 0x202e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc38e7fc700 10 client.4575 ms_handle_connect on v2:172.21.15.66:6818/2416365697 2023-12-01T15:44:03.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.072+0000 7fc39effd700 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:6818/2416365697,v1:172.21.15.66:6819/2416365697] conn(0x202beb0 0x202e2a0 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7d2ec1f71cf18f1 server_cookie=5325ba52d741b0e1 in_seq=0 out_seq=0 2023-12-01T15:44:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc38e7fc700 1 -- 172.21.15.63:0/188069338 <== mds.0 v2:172.21.15.66:6818/2416365697 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x1f19a00 con 0x202beb0 2023-12-01T15:44:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc38e7fc700 10 client.4575 handle_command_reply: tid=0 2023-12-01T15:44:03.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 1 client.4575 shutdown 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/188069338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 msgr2=0x1ff3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x1ff3630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc388053ae0 tx=0x7fc38801e070 comp rx=0 tx=0).stop 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/188069338 shutdown_connections 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:6818/2416365697,v1:172.21.15.66:6819/2416365697] conn(0x202beb0 0x202e2a0 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x20171f0 0x20106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc38e7fc700 0 client.4575 ms_handle_reset on v2:172.21.15.66:6818/2416365697 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1ff9730 0x2010160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/188069338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x1ff3630 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/188069338 >> 172.21.15.63:0/188069338 conn(0x1d864d0 msgr2=0x2014a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/188069338 shutdown_connections 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/188069338 wait complete. 2023-12-01T15:44:03.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.076+0000 7fc3a8ec0740 20 client.4575 trim_cache size 0 max 16384 2023-12-01T15:44:03.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 Processor -- start 2023-12-01T15:44:03.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 -- start start 2023-12-01T15:44:03.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1f87920 0x2016bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1ff9730 0x2070620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x20171f0 0x2070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e0aaa0 con 0x1ff9730 2023-12-01T15:44:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f5be40 con 0x1f87920 2023-12-01T15:44:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f063d0 con 0x20171f0 2023-12-01T15:44:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1ff9730 0x2070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1ff9730 0x2070620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36320/0 (socket says 172.21.15.63:36320) 2023-12-01T15:44:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39effd700 1 -- 172.21.15.63:0/2102153034 learned_addr learned my addr 172.21.15.63:0/2102153034 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39ffff700 1 --2- 172.21.15.63:0/2102153034 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x20171f0 0x2070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/2102153034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1f87920 0x2016bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39effd700 1 -- 172.21.15.63:0/2102153034 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x20171f0 msgr2=0x2070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:03.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39effd700 1 --2- 172.21.15.63:0/2102153034 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x20171f0 0x2070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39effd700 1 -- 172.21.15.63:0/2102153034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1f87920 msgr2=0x2016bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:03.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39effd700 1 --2- 172.21.15.63:0/2102153034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1f87920 0x2016bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39effd700 1 -- 172.21.15.63:0/2102153034 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a009dd80 con 0x1ff9730 2023-12-01T15:44:03.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/2102153034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1f87920 0x2016bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:44:03.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc39effd700 1 --2- 172.21.15.63:0/2102153034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1ff9730 0x2070620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x1f1bce0 tx=0x7fc390014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3cb812c7c26f40 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:03.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc395ffb700 1 -- 172.21.15.63:0/2102153034 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390028070 con 0x1ff9730 2023-12-01T15:44:03.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc395ffb700 1 -- 172.21.15.63:0/2102153034 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39000f040 con 0x1ff9730 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc395ffb700 1 -- 172.21.15.63:0/2102153034 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390023730 con 0x1ff9730 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2102153034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1ff9730 msgr2=0x2070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/2102153034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1ff9730 0x2070620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x1f1bce0 tx=0x7fc390014000 comp rx=0 tx=0).stop 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2102153034 shutdown_connections 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/2102153034 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x20171f0 0x2070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/2102153034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1ff9730 0x2070620 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/2102153034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1f87920 0x2016bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.096+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2102153034 >> 172.21.15.63:0/2102153034 conn(0x1d864d0 msgr2=0x1ff8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2102153034 shutdown_connections 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2102153034 wait complete. 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 1 -- start start 2023-12-01T15:44:03.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 1 Processor -- start 2023-12-01T15:44:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x2055f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1ff9730 0x20764d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x20171f0 0x2076a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f5ba30 con 0x1f87920 2023-12-01T15:44:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f2c670 con 0x20171f0 2023-12-01T15:44:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f28a40 con 0x1ff9730 2023-12-01T15:44:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 10 client.0 _ll_register_callbacks cb 0x7fc388007850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T15:44:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc39f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x2055f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc39f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x2055f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36334/0 (socket says 172.21.15.63:36334) 2023-12-01T15:44:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc39f7fe700 1 -- 172.21.15.63:0/2607297400 learned_addr learned my addr 172.21.15.63:0/2607297400 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:03.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc39ffff700 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x20171f0 0x2076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc39effd700 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1ff9730 0x20764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc39f7fe700 1 -- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1ff9730 msgr2=0x20764d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1ff9730 0x20764d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc39f7fe700 1 -- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x20171f0 msgr2=0x2076a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x20171f0 0x2076a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc39f7fe700 1 -- 172.21.15.63:0/2607297400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a013bba0 con 0x1f87920 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc38e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc39f7fe700 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x2055f80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc38805b5a0 tx=0x7fc38800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44697afa406cc709 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc38e7fc700 1 -- 172.21.15.63:0/2607297400 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38805bad0 con 0x1f87920 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc38e7fc700 1 -- 172.21.15.63:0/2607297400 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fc388053ba0 con 0x1f87920 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.100+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2607297400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc388057920 con 0x1f87920 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc38e7fc700 1 -- 172.21.15.63:0/2607297400 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc388067120 con 0x1f87920 2023-12-01T15:44:03.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 10 client.4581 fetch_fsmap learned FSMap version 8 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2607297400 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7fc3900179e0 con 0x1f87920 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc38e7fc700 1 -- 172.21.15.63:0/2607297400 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc388057920 con 0x1f87920 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc38e7fc700 1 -- 172.21.15.63:0/2607297400 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 8) v1 ==== 2016+0+0 (secure 0 0 0) 0x7fc388053e00 con 0x1f87920 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 10 client.4581 fetch_fsmap finished waiting for FSMap version 8 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 10 client.4581 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 20 client.4581 populate_metadata read hostname 'smithi063' 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:6818/2416365697,v1:172.21.15.66:6819/2416365697] conn(0x20794c0 0x20798a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 4 client.4581 mds_command: new command op to 4212 tid=0[{"prefix": "status"}] 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2607297400 --> [v2:172.21.15.66:6818/2416365697,v1:172.21.15.66:6819/2416365697] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1ddd460 con 0x20794c0 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc39effd700 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:6818/2416365697,v1:172.21.15.66:6819/2416365697] conn(0x20794c0 0x20798a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc39effd700 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:6818/2416365697,v1:172.21.15.66:6819/2416365697] conn(0x20794c0 0x20798a0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27336e6aa65f15cb server_cookie=e5c2a9fe0745db3c in_seq=0 out_seq=0 2023-12-01T15:44:03.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc38e7fc700 10 client.4581 ms_handle_connect on v2:172.21.15.66:6818/2416365697 2023-12-01T15:44:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc38e7fc700 1 -- 172.21.15.63:0/2607297400 <== mds.0 v2:172.21.15.66:6818/2416365697 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x1ddd460 con 0x20794c0 2023-12-01T15:44:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc38e7fc700 10 client.4581 handle_command_reply: tid=0 2023-12-01T15:44:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 client.4581 shutdown 2023-12-01T15:44:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2607297400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 msgr2=0x2055f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x2055f80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc38805b5a0 tx=0x7fc38800cf90 comp rx=0 tx=0).stop 2023-12-01T15:44:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2607297400 shutdown_connections 2023-12-01T15:44:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:6818/2416365697,v1:172.21.15.66:6819/2416365697] conn(0x20794c0 0x20798a0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1ff9730 0x20764d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x20171f0 0x2076a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 --2- 172.21.15.63:0/2607297400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x1f87920 0x2055f80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc38e7fc700 0 client.4581 ms_handle_reset on v2:172.21.15.66:6818/2416365697 2023-12-01T15:44:03.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2607297400 >> 172.21.15.63:0/2607297400 conn(0x1d864d0 msgr2=0x2016a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:03.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2607297400 shutdown_connections 2023-12-01T15:44:03.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 1 -- 172.21.15.63:0/2607297400 wait complete. 2023-12-01T15:44:03.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a8ec0740 20 client.4581 trim_cache size 0 max 16384 2023-12-01T15:44:03.113 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-01T15:44:03.113 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9", 2023-12-01T15:44:03.113 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2023-12-01T15:44:03.114 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4212, 2023-12-01T15:44:03.114 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2023-12-01T15:44:03.114 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2023-12-01T15:44:03.114 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2023-12-01T15:44:03.114 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 17.557943629, 2023-12-01T15:44:03.114 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 8, 2023-12-01T15:44:03.114 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 19, 2023-12-01T15:44:03.114 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 19, 2023-12-01T15:44:03.114 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 21.957175188000001 2023-12-01T15:44:03.114 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-01T15:44:03.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a49d6700 1 -- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc384065ad0 msgr2=0x7fc384067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a49d6700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc384065ad0 0x7fc384067f90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc3a006daa0 tx=0x7fc39000b040 comp rx=0 tx=0).stop 2023-12-01T15:44:03.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a49d6700 1 -- 172.21.15.63:0/1581511063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3a01376e0 msgr2=0x7fc3a012e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.104+0000 7fc3a49d6700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3a01376e0 0x7fc3a012e420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c700 tx=0x7fc38800ca10 comp rx=0 tx=0).stop 2023-12-01T15:44:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.108+0000 7fc3a49d6700 1 -- 172.21.15.63:0/1581511063 shutdown_connections 2023-12-01T15:44:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.108+0000 7fc3a49d6700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fc384065ad0 0x7fc384067f90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.108+0000 7fc3a49d6700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3a01408b0 0x7fc3a01cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.108+0000 7fc3a49d6700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a0137ac0 0x7fc3a012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.108+0000 7fc3a49d6700 1 --2- 172.21.15.63:0/1581511063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3a01376e0 0x7fc3a012e420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.108+0000 7fc3a49d6700 1 -- 172.21.15.63:0/1581511063 >> 172.21.15.63:0/1581511063 conn(0x7fc3a00737a0 msgr2=0x7fc3a009d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.108+0000 7fc3a49d6700 1 -- 172.21.15.63:0/1581511063 shutdown_connections 2023-12-01T15:44:03.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.108+0000 7fc3a49d6700 1 -- 172.21.15.63:0/1581511063 wait complete. 2023-12-01T15:44:03.127 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-01T15:44:03.150 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-01T15:44:03.150 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-12-01T15:44:03.150 INFO:tasks.ceph_fuse:client.0 config is {} 2023-12-01T15:44:03.150 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-01T15:44:03.150 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-01T15:44:03.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.151 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-12-01T15:44:03.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.160 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-12-01T15:44:03.223 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2023-12-01T15:44:03.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T15:44:03.224 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-01T15:44:03.224 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-01T15:44:03.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 Processor -- start 2023-12-01T15:44:03.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 -- start start 2023-12-01T15:44:03.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43d806d360 0x7f43d813ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f43d813bf90 0x7f43d8098a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d806cbd0 con 0x7f43d8098fa0 2023-12-01T15:44:03.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d813b7b0 con 0x7f43d806d360 2023-12-01T15:44:03.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d80a5280 con 0x7f43d813bf90 2023-12-01T15:44:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43d806d360 0x7f43d813ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d7fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f43d8098fa0 0x7f43d8145e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48526/0 (socket says 172.21.15.63:48526) 2023-12-01T15:44:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d7fff700 1 -- 172.21.15.63:0/2849650852 learned_addr learned my addr 172.21.15.63:0/2849650852 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:44:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d6ffd700 1 --2- 172.21.15.63:0/2849650852 >> v2:172.21.15.66:3300/0 conn(0x7f43d813bf90 0x7f43d8098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d77fe700 1 -- 172.21.15.63:0/2849650852 >> v2:172.21.15.66:3300/0 conn(0x7f43d813bf90 msgr2=0x7f43d8098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:44:03.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d77fe700 1 --2- 172.21.15.63:0/2849650852 >> v2:172.21.15.66:3300/0 conn(0x7f43d813bf90 0x7f43d8098a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d77fe700 1 -- 172.21.15.63:0/2849650852 >> v1:172.21.15.63:6789/0 conn(0x7f43d8098fa0 legacy=0x7f43d8145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d77fe700 1 -- 172.21.15.63:0/2849650852 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d813c420 con 0x7f43d806d360 2023-12-01T15:44:03.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d77fe700 1 --2- 172.21.15.63:0/2849650852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d806d360 0x7f43d813ba50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f43d8099b80 tx=0x7f43c0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacbd0df8ad03006 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:03.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d67fc700 1 -- 172.21.15.63:0/2849650852 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011830 con 0x7f43d806d360 2023-12-01T15:44:03.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d67fc700 1 -- 172.21.15.63:0/2849650852 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0011990 con 0x7f43d806d360 2023-12-01T15:44:03.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43d67fc700 1 -- 172.21.15.63:0/2849650852 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011d20 con 0x7f43d806d360 2023-12-01T15:44:03.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 -- 172.21.15.63:0/2849650852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d806d360 msgr2=0x7f43d813ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 --2- 172.21.15.63:0/2849650852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d806d360 0x7f43d813ba50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f43d8099b80 tx=0x7f43c0009b30 comp rx=0 tx=0).stop 2023-12-01T15:44:03.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 -- 172.21.15.63:0/2849650852 shutdown_connections 2023-12-01T15:44:03.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 --2- 172.21.15.63:0/2849650852 >> v2:172.21.15.66:3300/0 conn(0x7f43d813bf90 0x7f43d8098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 --2- 172.21.15.63:0/2849650852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d806d360 0x7f43d813ba50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 -- 172.21.15.63:0/2849650852 >> 172.21.15.63:0/2849650852 conn(0x7f43d80a5cc0 msgr2=0x7f43d80a60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:03.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 -- 172.21.15.63:0/2849650852 shutdown_connections 2023-12-01T15:44:03.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.344+0000 7f43dcf12700 1 -- 172.21.15.63:0/2849650852 wait complete. 2023-12-01T15:44:03.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43dcf12700 1 Processor -- start 2023-12-01T15:44:03.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43dcf12700 1 -- start start 2023-12-01T15:44:03.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43dcf12700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d806d360 0x7f43d81d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43dcf12700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43d8098fa0 0x7f43d81d41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43dcf12700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43d813bf90 0x7f43d81d4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43dcf12700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d80a3040 con 0x7f43d806d360 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43dcf12700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d809b4c0 con 0x7f43d8098fa0 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43dcf12700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d81c8470 con 0x7f43d813bf90 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43d77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d806d360 0x7f43d81d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43d77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d806d360 0x7f43d81d3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36360/0 (socket says 172.21.15.63:36360) 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43d77fe700 1 -- 172.21.15.63:0/3559669543 learned_addr learned my addr 172.21.15.63:0/3559669543 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43d6ffd700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43d8098fa0 0x7f43d81d41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43d7fff700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43d813bf90 0x7f43d81d4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43d77fe700 1 -- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43d813bf90 msgr2=0x7f43d81d4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43d77fe700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43d813bf90 0x7f43d81d4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43d77fe700 1 -- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43d8098fa0 msgr2=0x7f43d81d41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43d77fe700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43d8098fa0 0x7f43d81d41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43d77fe700 1 -- 172.21.15.63:0/3559669543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c00094b0 con 0x7f43d806d360 2023-12-01T15:44:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43d77fe700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d806d360 0x7f43d81d3ca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009b70 tx=0x7f43c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43cffff700 1 -- 172.21.15.63:0/3559669543 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00043c0 con 0x7f43d806d360 2023-12-01T15:44:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43cffff700 1 -- 172.21.15.63:0/3559669543 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c001f070 con 0x7f43d806d360 2023-12-01T15:44:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43dcf12700 1 -- 172.21.15.63:0/3559669543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d80a2e10 con 0x7f43d806d360 2023-12-01T15:44:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43cffff700 1 -- 172.21.15.63:0/3559669543 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00036c0 con 0x7f43d806d360 2023-12-01T15:44:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.348+0000 7f43dcf12700 1 -- 172.21.15.63:0/3559669543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d809c380 con 0x7f43d806d360 2023-12-01T15:44:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.352+0000 7f43dcf12700 1 -- 172.21.15.63:0/3559669543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d8065fb0 con 0x7f43d806d360 2023-12-01T15:44:03.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.352+0000 7f43cffff700 1 -- 172.21.15.63:0/3559669543 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f43c0021030 con 0x7f43d806d360 2023-12-01T15:44:03.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.352+0000 7f43cffff700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f43b8065ad0 0x7f43b8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:44:03.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.352+0000 7f43cffff700 1 -- 172.21.15.63:0/3559669543 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f43c0083d90 con 0x7f43d806d360 2023-12-01T15:44:03.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.352+0000 7f43d6ffd700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f43b8065ad0 0x7f43b8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:44:03.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.356+0000 7f43d6ffd700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f43b8065ad0 0x7f43b8067f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43d81c7dd0 tx=0x7f43c8009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:44:03.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.364+0000 7f43cffff700 1 -- 172.21.15.63:0/3559669543 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f43c0051cc0 con 0x7f43d806d360 2023-12-01T15:44:03.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.568+0000 7f43dcf12700 1 -- 172.21.15.63:0/3559669543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f43d81c6b20 con 0x7f43d806d360 2023-12-01T15:44:03.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.568+0000 7f43cffff700 1 -- 172.21.15.63:0/3559669543 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f43c0015060 con 0x7f43d806d360 2023-12-01T15:44:03.572 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-01T15:44:03.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 -- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f43b8065ad0 msgr2=0x7f43b8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f43b8065ad0 0x7f43b8067f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43d81c7dd0 tx=0x7f43c8009240 comp rx=0 tx=0).stop 2023-12-01T15:44:03.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 -- 172.21.15.63:0/3559669543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d806d360 msgr2=0x7f43d81d3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:44:03.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d806d360 0x7f43d81d3ca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009b70 tx=0x7f43c0004770 comp rx=0 tx=0).stop 2023-12-01T15:44:03.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 -- 172.21.15.63:0/3559669543 shutdown_connections 2023-12-01T15:44:03.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f43b8065ad0 0x7f43b8067f90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43d813bf90 0x7f43d81d4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43d8098fa0 0x7f43d81d41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 --2- 172.21.15.63:0/3559669543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d806d360 0x7f43d81d3ca0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:44:03.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 -- 172.21.15.63:0/3559669543 >> 172.21.15.63:0/3559669543 conn(0x7f43d80a5cc0 msgr2=0x7f43d806fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:44:03.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 -- 172.21.15.63:0/3559669543 shutdown_connections 2023-12-01T15:44:03.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:44:03.572+0000 7f43dcf12700 1 -- 172.21.15.63:0/3559669543 wait complete. 2023-12-01T15:44:03.593 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-01T15:44:03.593 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-01T15:44:03.593 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-12-01T15:44:03.593 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-01T15:44:03.593 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-01T15:44:03.593 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-01T15:44:03.594 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-01T15:44:03.594 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-01T15:44:03.594 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-01T15:44:03.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.594 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-12-01T15:44:03.601 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-12-01T15:44:03.602 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-01T15:44:03.603 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-12-01T15:44:03.603 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-01T15:44:03.603 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42130sec preferred_lft 42130sec 2023-12-01T15:44:03.603 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-12-01T15:44:03.603 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-12-01T15:44:03.603 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-01T15:44:03.603 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:35:ee:ff:c5 brd ff:ff:ff:ff:ff:ff 2023-12-01T15:44:03.603 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-01T15:44:03.603 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-12-01T15:44:03.604 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-01T15:44:03.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.604 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-12-01T15:44:03.604 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-12-01T15:44:03.604 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2023-12-01T15:44:03.604 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2023-12-01T15:44:03.604 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2023-12-01T15:44:03.604 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-01T15:44:03.604 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-12-01T15:44:03.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.649 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-01T15:44:03.706 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-12-01T15:44:03.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.708 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-12-01T15:44:03.731 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-12-01T15:44:03.731 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-01T15:44:03.731 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-01T15:44:03.731 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-01T15:44:03.732 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-01T15:44:03.732 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-12-01T15:44:03.732 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-01T15:44:03.732 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-01T15:44:03.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.732 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-12-01T15:44:03.732 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-12-01T15:44:03.732 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-01T15:44:03.732 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-01T15:44:03.733 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-01T15:44:03.733 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-12-01T15:44:03.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.772 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-12-01T15:44:03.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.822 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2023-12-01T15:44:03.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.829 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-12-01T15:44:03.829 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-12-01T15:44:03.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T15:44:03.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-01T15:44:03.830 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-12-01T15:44:03.858 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-01T15:44:03.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.859 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-12-01T15:44:03.859 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-12-01T15:44:03.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-01T15:44:03.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-01T15:44:03.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-01T15:44:03.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-01T15:44:03.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-01T15:44:03.859 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-12-01T15:44:03.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:03.983 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-12-01T15:44:03.983 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-12-01T15:44:03.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-12-01T15:44:03.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2023-12-01T15:44:03.983 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-12-01T15:44:04.010 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-01T15:44:04.011 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-01T15:44:04.011 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-01T15:44:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-01T15:44:04.016 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-01T15:44:04.016 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-01T15:44:04.065 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-12-01T15:44:04.079 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-01T15:44:04.079 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-01T15:44:04.089 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-01T15:44:04.090 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-01T15:44:04.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:04.090 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-12-01T15:44:04.095 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-01T15:44:04.095 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-01T15:44:04.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-12-01T15:44:04.157 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-01T15:44:04.157 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-01T15:44:04.167 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-01T15:44:04.168 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-01T15:44:04.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:04.169 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-12-01T15:44:04.265 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-12-01T15:44:04.259+0000 7fa1e876f640 -1 init, newargv = 0x556a8378c230 newargc=15 2023-12-01T15:44:04.266 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[27328]: starting ceph client 2023-12-01T15:44:04.276 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[27328]: starting fuse 2023-12-01T15:44:05.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-12-01T15:44:05.293 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-01T15:44:05.294 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-01T15:44:05.350 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-01T15:44:05.351 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-01T15:44:05.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:05.352 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-12-01T15:44:05.358 INFO:teuthology.orchestra.run.smithi146.stdout:52 2023-12-01T15:44:05.358 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-12-01T15:44:05.359 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-01T15:44:05.359 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-12-01T15:44:05.359 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-12-01T15:44:05.359 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-12-01T15:44:05.359 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-12-01T15:44:05.360 DEBUG:teuthology.orchestra.run.smithi146:> 2023-12-01T15:44:05.360 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-12-01T15:44:05.360 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-01T15:44:05.360 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-12-01T15:44:05.360 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-01T15:44:05.361 DEBUG:teuthology.orchestra.run.smithi146:> 2023-12-01T15:44:05.361 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-12-01T15:44:05.361 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-12-01T15:44:05.361 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-12-01T15:44:05.362 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-12-01T15:44:05.362 DEBUG:teuthology.orchestra.run.smithi146:> 2023-12-01T15:44:05.362 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-12-01T15:44:05.362 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-01T15:44:05.362 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-01T15:44:05.363 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-01T15:44:05.363 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-12-01T15:44:05.363 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-12-01T15:44:05.363 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-12-01T15:44:05.363 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-01T15:44:05.363 DEBUG:teuthology.orchestra.run.smithi146:> 2023-12-01T15:44:05.364 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-12-01T15:44:05.364 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-12-01T15:44:05.447 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.27328.asok 2023-12-01T15:44:05.628 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.27328.asok 2023-12-01T15:44:05.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:05.629 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.27328.asok status 2023-12-01T15:44:05.728 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-12-01T15:44:05.728 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-12-01T15:44:05.728 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "a6f82997ac57b70a895455dfed6256360a1e4c32", 2023-12-01T15:44:05.729 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable)", 2023-12-01T15:44:05.729 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-12-01T15:44:05.729 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-12-01T15:44:05.729 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-01T15:44:05.729 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "27328", 2023-12-01T15:44:05.729 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-12-01T15:44:05.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4481, 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 4481 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-12-01T15:44:05.730 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 4262558122 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 4262558122 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.4481 172.21.15.146:0/4262558122", 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "172.21.15.146:0/4262558122", 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 8, 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 19, 2023-12-01T15:44:05.731 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-12-01T15:44:05.732 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-12-01T15:44:05.732 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-12-01T15:44:05.732 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-12-01T15:44:05.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:05.739 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-12-01T15:44:05.739 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-01T15:44:05.749 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-12-01T15:44:05.749 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-01T15:44:05.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:44:05.749 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-01T15:44:05.808 INFO:teuthology.run_tasks:Running task workunit... 2023-12-01T15:44:05.819 INFO:tasks.workunit:Pulling workunits from ref a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T15:44:05.820 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-01T15:44:05.820 DEBUG:teuthology.orchestra.run.smithi146:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-01T15:44:05.827 INFO:teuthology.orchestra.run.smithi146.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-01T15:44:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-12-01T15:44:05.828 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 34h/52d Inode: 1 Links: 2 2023-12-01T15:44:05.828 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T15:44:05.828 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-01T15:44:05.828 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-12-01 15:43:45.550647281 +0000 2023-12-01T15:44:05.828 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-12-01 15:44:05.803771909 +0000 2023-12-01T15:44:05.828 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-12-01T15:44:05.828 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-01T15:44:05.829 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-01T15:44:05.860 INFO:tasks.workunit:timeout=3h 2023-12-01T15:44:05.860 INFO:tasks.workunit:cleanup=True 2023-12-01T15:44:05.861 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T15:44:05.911 INFO:tasks.workunit.client.0.smithi146.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-01T15:44:30.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:44:30.094 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:44:30.097 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:45:00.170 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:45:05.586 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:45:05.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:45:06.227 INFO:tasks.workunit.client.0.smithi146.stderr:Note: switching to 'a6f82997ac57b70a895455dfed6256360a1e4c32'. 2023-12-01T15:45:06.227 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-12-01T15:45:06.227 INFO:tasks.workunit.client.0.smithi146.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-01T15:45:06.227 INFO:tasks.workunit.client.0.smithi146.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-01T15:45:06.227 INFO:tasks.workunit.client.0.smithi146.stderr:state without impacting any branches by switching back to a branch. 2023-12-01T15:45:06.227 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-12-01T15:45:06.227 INFO:tasks.workunit.client.0.smithi146.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-01T15:45:06.228 INFO:tasks.workunit.client.0.smithi146.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-01T15:45:06.228 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-12-01T15:45:06.228 INFO:tasks.workunit.client.0.smithi146.stderr: git switch -c 2023-12-01T15:45:06.228 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-12-01T15:45:06.228 INFO:tasks.workunit.client.0.smithi146.stderr:Or undo this operation with: 2023-12-01T15:45:06.228 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-12-01T15:45:06.228 INFO:tasks.workunit.client.0.smithi146.stderr: git switch - 2023-12-01T15:45:06.228 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-12-01T15:45:06.228 INFO:tasks.workunit.client.0.smithi146.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-01T15:45:06.228 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-12-01T15:45:06.229 INFO:tasks.workunit.client.0.smithi146.stderr:HEAD is now at a6f82997ac5 qa/cephfs: try usual umount if client blocklisting cannot be inferred 2023-12-01T15:45:06.232 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-01T15:45:06.261 INFO:tasks.workunit.client.0.smithi146.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-01T15:45:06.264 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-01T15:45:06.264 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-01T15:45:07.110 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-01T15:45:07.194 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-01T15:45:07.253 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-01T15:45:07.256 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-01T15:45:07.256 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-01T15:45:07.310 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-01T15:45:07.315 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:45:07.315 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-01T15:45:07.320 INFO:tasks.workunit:Running workunits matching libcephfs/test.sh on client.0... 2023-12-01T15:45:07.321 INFO:tasks.workunit:Running workunit libcephfs/test.sh... 2023-12-01T15:45:07.321 DEBUG:teuthology.orchestra.run.smithi146:workunit test libcephfs/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6f82997ac57b70a895455dfed6256360a1e4c32 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh 2023-12-01T15:45:07.403 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] Running 133 tests from 4 test suites. 2023-12-01T15:45:07.403 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment set-up. 2023-12-01T15:45:07.404 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 124 tests from LibCephFS 2023-12-01T15:45:07.404 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2023-12-01T15:45:07.517 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OpenEmptyComponent (115 ms) 2023-12-01T15:45:07.517 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2023-12-01T15:45:11.167 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OpenReadTruncate (3649 ms) 2023-12-01T15:45:12.553 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OpenReadWrite 2023-12-01T15:45:12.554 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OpenReadWrite (55 ms) 2023-12-01T15:45:12.554 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.MountNonExist 2023-12-01T15:45:12.554 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.MountNonExist (35 ms) 2023-12-01T15:45:12.554 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.MountDouble 2023-12-01T15:45:12.554 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.MountDouble (1029 ms) 2023-12-01T15:45:12.554 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.MountRemount 2023-12-01T15:45:14.329 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.MountRemount (2044 ms) 2023-12-01T15:45:14.329 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2023-12-01T15:45:14.346 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.UnmountUnmounted (16 ms) 2023-12-01T15:45:14.346 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2023-12-01T15:45:14.354 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ReleaseUnmounted (9 ms) 2023-12-01T15:45:14.355 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ReleaseMounted 2023-12-01T15:45:15.378 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ReleaseMounted (1023 ms) 2023-12-01T15:45:15.378 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.UnmountRelease 2023-12-01T15:45:15.412 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.UnmountRelease (35 ms) 2023-12-01T15:45:15.412 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Mount 2023-12-01T15:45:17.470 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Mount (2057 ms) 2023-12-01T15:45:17.470 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OpenLayout 2023-12-01T15:45:17.555 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OpenLayout (86 ms) 2023-12-01T15:45:17.555 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DirLs 2023-12-01T15:45:35.742 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:45:35.746 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:45:35.748 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:45:39.353 INFO:tasks.workunit.client.0.smithi146.stdout:rand: 3275 2023-12-01T15:45:39.354 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DirLs (21798 ms) 2023-12-01T15:45:39.354 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2023-12-01T15:45:40.194 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ManyNestedDirs (840 ms) 2023-12-01T15:45:40.194 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Xattrs 2023-12-01T15:45:40.281 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_a 2023-12-01T15:45:40.281 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_b 2023-12-01T15:45:40.281 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_c 2023-12-01T15:45:40.281 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_d 2023-12-01T15:45:40.281 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_e 2023-12-01T15:45:40.281 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_f 2023-12-01T15:45:40.283 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_g 2023-12-01T15:45:40.283 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_h 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_i 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_j 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_k 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_l 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_m 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_n 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_o 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_p 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_q 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_r 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_s 2023-12-01T15:45:40.284 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_t 2023-12-01T15:45:40.285 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_u 2023-12-01T15:45:40.285 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_v 2023-12-01T15:45:40.285 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_w 2023-12-01T15:45:40.285 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_x 2023-12-01T15:45:40.285 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_y 2023-12-01T15:45:40.285 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_z 2023-12-01T15:45:40.342 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Xattrs (149 ms) 2023-12-01T15:45:40.343 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Xattrs_ll 2023-12-01T15:45:40.385 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Xattrs_ll (42 ms) 2023-12-01T15:45:40.385 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LstatSlashdot 2023-12-01T15:45:40.421 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LstatSlashdot (36 ms) 2023-12-01T15:45:40.421 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.StatDirNlink 2023-12-01T15:45:40.502 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.StatDirNlink (82 ms) 2023-12-01T15:45:40.503 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DoubleChmod 2023-12-01T15:45:40.560 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DoubleChmod (57 ms) 2023-12-01T15:45:40.560 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Fchmod 2023-12-01T15:45:40.606 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Fchmod (46 ms) 2023-12-01T15:45:40.606 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Lchmod 2023-12-01T15:45:40.668 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Lchmod (62 ms) 2023-12-01T15:45:40.668 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Fchown 2023-12-01T15:45:40.714 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Fchown (47 ms) 2023-12-01T15:45:40.715 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.FlagO_PATH 2023-12-01T15:45:40.754 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.FlagO_PATH (39 ms) 2023-12-01T15:45:40.754 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Symlinks 2023-12-01T15:45:40.828 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Symlinks (74 ms) 2023-12-01T15:45:40.828 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DirSyms 2023-12-01T15:45:40.894 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DirSyms (66 ms) 2023-12-01T15:45:40.894 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LoopSyms 2023-12-01T15:45:40.964 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LoopSyms (71 ms) 2023-12-01T15:45:40.965 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2023-12-01T15:45:41.100 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (135 ms) 2023-12-01T15:45:41.100 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.BadArgument 2023-12-01T15:45:41.152 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.BadArgument (52 ms) 2023-12-01T15:45:41.152 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.BadFileDesc 2023-12-01T15:45:41.186 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.BadFileDesc (35 ms) 2023-12-01T15:45:41.187 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2023-12-01T15:45:41.235 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ReadEmptyFile (49 ms) 2023-12-01T15:45:41.235 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.PreadvPwritev 2023-12-01T15:45:41.285 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.PreadvPwritev (49 ms) 2023-12-01T15:45:41.285 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2023-12-01T15:45:41.336 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LlreadvLlwritev (51 ms) 2023-12-01T15:45:41.336 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.StripeUnitGran 2023-12-01T15:45:42.364 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.StripeUnitGran (1028 ms) 2023-12-01T15:45:42.364 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Rename 2023-12-01T15:45:42.430 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Rename (65 ms) 2023-12-01T15:45:42.430 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.UseUnmounted 2023-12-01T15:45:42.445 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.UseUnmounted (15 ms) 2023-12-01T15:45:42.445 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetPoolId 2023-12-01T15:45:42.474 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetPoolId (29 ms) 2023-12-01T15:45:42.474 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetPoolReplication 2023-12-01T15:45:43.505 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetPoolReplication (1031 ms) 2023-12-01T15:45:43.505 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetExtentOsds 2023-12-01T15:45:43.549 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetExtentOsds (45 ms) 2023-12-01T15:45:43.549 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2023-12-01T15:45:43.593 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (44 ms) 2023-12-01T15:45:43.594 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetOsdAddr 2023-12-01T15:45:44.623 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetOsdAddr (1030 ms) 2023-12-01T15:45:44.624 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OpenNoClose 2023-12-01T15:45:44.694 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OpenNoClose (70 ms) 2023-12-01T15:45:44.694 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Nlink 2023-12-01T15:45:44.762 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Nlink (68 ms) 2023-12-01T15:45:44.762 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SlashDotDot 2023-12-01T15:45:46.834 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SlashDotDot (2072 ms) 2023-12-01T15:45:46.834 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Btime 2023-12-01T15:45:47.888 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Btime (1054 ms) 2023-12-01T15:45:47.888 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SetBtime 2023-12-01T15:45:47.937 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SetBtime (49 ms) 2023-12-01T15:45:47.937 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LazyStatx 2023-12-01T15:45:49.022 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LazyStatx (1085 ms) 2023-12-01T15:45:49.022 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ChangeAttr 2023-12-01T15:45:49.083 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ChangeAttr (62 ms) 2023-12-01T15:45:49.084 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2023-12-01T15:45:49.162 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (79 ms) 2023-12-01T15:45:49.163 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2023-12-01T15:45:49.251 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (88 ms) 2023-12-01T15:45:49.251 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2023-12-01T15:45:49.337 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (87 ms) 2023-12-01T15:45:49.338 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SetSize 2023-12-01T15:45:49.407 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SetSize (69 ms) 2023-12-01T15:45:49.407 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2023-12-01T15:45:49.448 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OperationsOnRoot (41 ms) 2023-12-01T15:45:49.448 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ShutdownRace 2023-12-01T15:45:49.448 INFO:tasks.workunit.client.0.smithi146.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2023-12-01T15:46:05.796 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:46:05.799 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:46:05.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:46:22.950 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ShutdownRace (33502 ms) 2023-12-01T15:46:22.950 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.TestUtime 2023-12-01T15:46:23.004 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.TestUtime (54 ms) 2023-12-01T15:46:23.004 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.TestUtimes 2023-12-01T15:46:23.068 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.TestUtimes (64 ms) 2023-12-01T15:46:23.068 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.TestFutimens 2023-12-01T15:46:23.128 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.TestFutimens (60 ms) 2023-12-01T15:46:23.128 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2023-12-01T15:46:23.195 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OperationsOnDotDot (67 ms) 2023-12-01T15:46:23.195 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Caps_vxattr 2023-12-01T15:46:23.241 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Caps_vxattr (46 ms) 2023-12-01T15:46:23.241 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapXattrs 2023-12-01T15:46:24.272 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapXattrs (1031 ms) 2023-12-01T15:46:24.272 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Lseek 2023-12-01T15:46:24.329 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Lseek (57 ms) 2023-12-01T15:46:24.330 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2023-12-01T15:46:24.368 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (39 ms) 2023-12-01T15:46:24.368 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2023-12-01T15:46:25.398 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.EmptySnapInfo (1030 ms) 2023-12-01T15:46:25.398 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapInfo 2023-12-01T15:46:26.428 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapInfo (1030 ms) 2023-12-01T15:46:26.428 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2023-12-01T15:46:26.467 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LookupInoMDSDir (40 ms) 2023-12-01T15:46:26.468 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LookupVino 2023-12-01T15:46:28.547 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LookupVino (2079 ms) 2023-12-01T15:46:28.547 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Openat 2023-12-01T15:46:28.633 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Openat (86 ms) 2023-12-01T15:46:28.633 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Statxat 2023-12-01T15:46:28.737 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Statxat (104 ms) 2023-12-01T15:46:28.737 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2023-12-01T15:46:28.805 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.StatxatATFDCWD (68 ms) 2023-12-01T15:46:28.805 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Fdopendir 2023-12-01T15:46:28.892 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Fdopendir (87 ms) 2023-12-01T15:46:28.892 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2023-12-01T15:46:28.973 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (81 ms) 2023-12-01T15:46:28.973 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2023-12-01T15:46:29.069 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (96 ms) 2023-12-01T15:46:29.070 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2023-12-01T15:46:29.135 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (66 ms) 2023-12-01T15:46:29.135 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Mkdirat 2023-12-01T15:46:29.198 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Mkdirat (63 ms) 2023-12-01T15:46:29.198 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2023-12-01T15:46:29.258 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (60 ms) 2023-12-01T15:46:29.258 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Readlinkat 2023-12-01T15:46:29.343 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Readlinkat (85 ms) 2023-12-01T15:46:29.343 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2023-12-01T15:46:29.447 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (104 ms) 2023-12-01T15:46:29.447 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Symlinkat 2023-12-01T15:46:29.514 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Symlinkat (67 ms) 2023-12-01T15:46:29.514 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2023-12-01T15:46:29.592 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (79 ms) 2023-12-01T15:46:29.593 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Unlinkat 2023-12-01T15:46:29.684 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Unlinkat (91 ms) 2023-12-01T15:46:29.684 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2023-12-01T15:46:29.763 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (79 ms) 2023-12-01T15:46:29.763 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Chownat 2023-12-01T15:46:29.830 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Chownat (67 ms) 2023-12-01T15:46:29.830 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2023-12-01T15:46:29.910 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ChownatATFDCWD (80 ms) 2023-12-01T15:46:29.910 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Chmodat 2023-12-01T15:46:30.006 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Chmodat (96 ms) 2023-12-01T15:46:30.006 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2023-12-01T15:46:30.085 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (80 ms) 2023-12-01T15:46:30.086 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Utimensat 2023-12-01T15:46:31.188 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Utimensat (1102 ms) 2023-12-01T15:46:31.188 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2023-12-01T15:46:36.188 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (5000 ms) 2023-12-01T15:46:36.188 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2023-12-01T15:46:36.341 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:46:36.344 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:46:36.346 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:46:36.800 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (612 ms) 2023-12-01T15:46:36.800 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2023-12-01T15:46:36.831 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (31 ms) 2023-12-01T15:46:36.831 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SetMountTimeout 2023-12-01T15:46:36.867 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SetMountTimeout (36 ms) 2023-12-01T15:46:36.867 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.FsCrypt 2023-12-01T15:46:37.932 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.FsCrypt (1064 ms) 2023-12-01T15:46:37.932 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2023-12-01T15:46:38.964 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapdirAttrs (1032 ms) 2023-12-01T15:46:38.964 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapCreate 2023-12-01T15:46:39.994 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapCreate (1029 ms) 2023-12-01T15:46:39.994 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapDelete 2023-12-01T15:46:41.024 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapDelete (1031 ms) 2023-12-01T15:46:41.024 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapRename 2023-12-01T15:46:42.054 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapRename (1030 ms) 2023-12-01T15:46:42.054 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ReaddirRCB 2023-12-01T15:46:42.122 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ReaddirRCB (68 ms) 2023-12-01T15:46:42.123 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.MulticlientSimple 2023-12-01T15:46:42.343 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.MulticlientSimple (221 ms) 2023-12-01T15:46:42.343 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.MulticlientHoleEOF 2023-12-01T15:46:42.450 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.MulticlientHoleEOF (107 ms) 2023-12-01T15:46:42.450 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.MulticlientRevokeCaps 2023-12-01T15:47:06.426 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:47:09.387 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:47:09.392 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:47:39.446 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:47:39.450 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:47:39.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:47:42.517 INFO:tasks.workunit.client.0.smithi146.stdout: Will run test for 60 seconds! 2023-12-01T15:47:42.518 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.MulticlientRevokeCaps (60067 ms) 2023-12-01T15:47:42.518 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.BasicLocking 2023-12-01T15:47:42.589 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.BasicLocking (72 ms) 2023-12-01T15:47:42.589 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ConcurrentLocking 2023-12-01T15:47:42.682 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ConcurrentLocking (92 ms) 2023-12-01T15:47:42.682 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ThreesomeLocking 2023-12-01T15:47:42.791 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ThreesomeLocking (109 ms) 2023-12-01T15:47:42.791 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.BasicRecordLocking 2023-12-01T15:47:42.857 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.BasicRecordLocking (66 ms) 2023-12-01T15:47:42.857 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ConcurrentRecordLocking 2023-12-01T15:47:42.943 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ConcurrentRecordLocking (87 ms) 2023-12-01T15:47:42.943 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ThreesomeRecordLocking 2023-12-01T15:47:43.048 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ThreesomeRecordLocking (104 ms) 2023-12-01T15:47:43.048 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DelegMultiClient 2023-12-01T15:47:44.534 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DelegMultiClient (1486 ms) 2023-12-01T15:47:44.534 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DelegSingleClient 2023-12-01T15:47:44.732 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DelegSingleClient (199 ms) 2023-12-01T15:47:44.732 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DelegTimeout 2023-12-01T15:47:46.836 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DelegTimeout (2104 ms) 2023-12-01T15:47:46.836 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.RecalledGetattr 2023-12-01T15:47:46.957 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.RecalledGetattr (120 ms) 2023-12-01T15:47:46.957 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LayoutVerifyDefaultLayout 2023-12-01T15:47:46.995 INFO:tasks.workunit.client.0.smithi146.stderr:layout:{"stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@default"} 2023-12-01T15:47:47.031 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LayoutVerifyDefaultLayout (75 ms) 2023-12-01T15:47:47.031 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout 2023-12-01T15:47:47.082 INFO:tasks.workunit.client.0.smithi146.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@set"} 2023-12-01T15:47:47.082 INFO:tasks.workunit.client.0.smithi146.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@inherited"} 2023-12-01T15:47:47.117 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout (85 ms) 2023-12-01T15:47:47.117 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LayoutSetBadJSON 2023-12-01T15:47:47.195 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LayoutSetBadJSON (78 ms) 2023-12-01T15:47:47.195 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolName 2023-12-01T15:47:47.273 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LayoutSetBadPoolName (79 ms) 2023-12-01T15:47:47.274 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolId 2023-12-01T15:47:47.347 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LayoutSetBadPoolId (74 ms) 2023-12-01T15:47:47.348 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LayoutSetInvalidFieldName 2023-12-01T15:47:47.423 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LayoutSetInvalidFieldName (76 ms) 2023-12-01T15:47:47.423 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetAndSetDirPin 2023-12-01T15:47:47.496 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetAndSetDirPin (73 ms) 2023-12-01T15:47:47.496 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetAndSetDirDistribution 2023-12-01T15:47:47.570 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetAndSetDirDistribution (74 ms) 2023-12-01T15:47:47.571 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetAndSetDirRandom 2023-12-01T15:47:47.645 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetAndSetDirRandom (74 ms) 2023-12-01T15:47:47.645 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapDiffLib 2023-12-01T15:47:47.829 INFO:tasks.workunit.client.0.smithi146.stdout:16 vs. 17 2023-12-01T15:47:47.830 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 listing verification--------- 2023-12-01T15:47:51.180 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 listing verification--------- 2023-12-01T15:47:56.178 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing for / 2023-12-01T15:47:56.189 INFO:tasks.workunit.client.0.smithi146.stdout:dirB snap 17 2023-12-01T15:47:56.189 INFO:tasks.workunit.client.0.smithi146.stdout:fileB snap 17 2023-12-01T15:47:56.189 INFO:tasks.workunit.client.0.smithi146.stdout:fileC snap 16 2023-12-01T15:47:56.189 INFO:tasks.workunit.client.0.smithi146.stdout:fileA snap 17 2023-12-01T15:47:56.190 INFO:tasks.workunit.client.0.smithi146.stdout:dirC snap 16 2023-12-01T15:47:56.190 INFO:tasks.workunit.client.0.smithi146.stdout:dirD snap 17 2023-12-01T15:47:56.190 INFO:tasks.workunit.client.0.smithi146.stdout:dirA snap 17 2023-12-01T15:47:56.190 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-12-01T15:47:56.200 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2023-12-01T15:47:56.208 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2023-12-01T15:47:56.218 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap1 diff listing verification for /dirC 2023-12-01T15:47:56.228 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2023-12-01T15:47:56.237 INFO:tasks.workunit.client.0.smithi146.stdout:---------invalid snapdiff params, the same snaps--------- 2023-12-01T15:47:56.242 INFO:tasks.workunit.client.0.smithi146.stdout:---------invalid snapdiff params, no snap_other --------- 2023-12-01T15:47:56.242 INFO:tasks.workunit.client.0.smithi146.stdout:------------- closing ------------- 2023-12-01T15:47:56.242 INFO:tasks.workunit.client.0.smithi146.stderr: Failed to readdir snapdiff, ret:-22 , snap2 vs. snap2 2023-12-01T15:47:56.242 INFO:tasks.workunit.client.0.smithi146.stderr: Failed to open snapdiff, ret:-22 2023-12-01T15:47:56.721 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapDiffLib (9077 ms) 2023-12-01T15:47:56.722 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapDiffLib2 2023-12-01T15:47:56.997 INFO:tasks.workunit.client.0.smithi146.stdout:20 vs. 21 vs. 22 2023-12-01T15:47:56.997 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 listing verification--------- 2023-12-01T15:48:01.178 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 listing verification--------- 2023-12-01T15:48:06.178 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 listing verification--------- 2023-12-01T15:48:06.189 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 listing verification--------- 2023-12-01T15:48:06.204 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 listing verification--------- 2023-12-01T15:48:06.217 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 listing verification--------- 2023-12-01T15:48:06.228 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing for / 2023-12-01T15:48:06.240 INFO:tasks.workunit.client.0.smithi146.stdout:fileG snap 21 2023-12-01T15:48:06.241 INFO:tasks.workunit.client.0.smithi146.stdout:dirB snap 21 2023-12-01T15:48:06.241 INFO:tasks.workunit.client.0.smithi146.stdout:fileB snap 21 2023-12-01T15:48:06.241 INFO:tasks.workunit.client.0.smithi146.stdout:fileC snap 20 2023-12-01T15:48:06.241 INFO:tasks.workunit.client.0.smithi146.stdout:fileA snap 21 2023-12-01T15:48:06.242 INFO:tasks.workunit.client.0.smithi146.stdout:dirC snap 20 2023-12-01T15:48:06.244 INFO:tasks.workunit.client.0.smithi146.stdout:dirD snap 21 2023-12-01T15:48:06.244 INFO:tasks.workunit.client.0.smithi146.stdout:fileF snap 20 2023-12-01T15:48:06.244 INFO:tasks.workunit.client.0.smithi146.stdout:dirA snap 21 2023-12-01T15:48:06.245 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-12-01T15:48:06.261 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 listing verification--------- 2023-12-01T15:48:06.272 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 listing verification--------- 2023-12-01T15:48:06.284 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 listing verification--------- 2023-12-01T15:48:06.292 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap1 diff listing verification for / 2023-12-01T15:48:06.307 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 listing verification--------- 2023-12-01T15:48:06.318 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 listing verification--------- 2023-12-01T15:48:06.329 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 listing verification--------- 2023-12-01T15:48:06.337 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap3 diff listing verification for / 2023-12-01T15:48:06.352 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing verification for / 2023-12-01T15:48:06.367 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 listing verification--------- 2023-12-01T15:48:06.376 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 listing verification--------- 2023-12-01T15:48:06.388 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 listing verification--------- 2023-12-01T15:48:06.396 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing for /dirA 2023-12-01T15:48:06.406 INFO:tasks.workunit.client.0.smithi146.stdout:fileA snap 21 2023-12-01T15:48:06.406 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2023-12-01T15:48:06.415 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing for /dirB 2023-12-01T15:48:06.427 INFO:tasks.workunit.client.0.smithi146.stdout:fileb snap 21 2023-12-01T15:48:06.427 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2023-12-01T15:48:06.439 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing for /dirD 2023-12-01T15:48:06.449 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2023-12-01T15:48:06.459 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 listing verification--------- 2023-12-01T15:48:06.470 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 listing verification--------- 2023-12-01T15:48:06.480 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 listing verification--------- 2023-12-01T15:48:06.488 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-12-01T15:48:06.501 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 vs. snap2 diff listing verification for / 2023-12-01T15:48:06.515 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap3 diff listing verification for / 2023-12-01T15:48:06.529 INFO:tasks.workunit.client.0.smithi146.stdout:------------- closing ------------- 2023-12-01T15:48:06.788 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapDiffLib2 (10066 ms) 2023-12-01T15:48:06.788 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapDiffCases1_2 2023-12-01T15:48:07.530 INFO:tasks.workunit.client.0.smithi146.stdout:26 vs. 27 2023-12-01T15:48:07.530 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing for / 2023-12-01T15:48:07.540 INFO:tasks.workunit.client.0.smithi146.stdout:C snap 26 2023-12-01T15:48:07.541 INFO:tasks.workunit.client.0.smithi146.stdout:L snap 27 2023-12-01T15:48:07.544 INFO:tasks.workunit.client.0.smithi146.stdout:S snap 27 2023-12-01T15:48:07.545 INFO:tasks.workunit.client.0.smithi146.stdout:T snap 27 2023-12-01T15:48:07.545 INFO:tasks.workunit.client.0.smithi146.stdout:d snap 27 2023-12-01T15:48:07.547 INFO:tasks.workunit.client.0.smithi146.stdout:G snap 26 2023-12-01T15:48:07.547 INFO:tasks.workunit.client.0.smithi146.stdout:l snap 27 2023-12-01T15:48:07.547 INFO:tasks.workunit.client.0.smithi146.stdout:e snap 27 2023-12-01T15:48:07.547 INFO:tasks.workunit.client.0.smithi146.stdout:~e snap 27 2023-12-01T15:48:07.547 INFO:tasks.workunit.client.0.smithi146.stdout:g snap 26 2023-12-01T15:48:07.547 INFO:tasks.workunit.client.0.smithi146.stdout:c snap 26 2023-12-01T15:48:07.547 INFO:tasks.workunit.client.0.smithi146.stdout:b snap 27 2023-12-01T15:48:07.547 INFO:tasks.workunit.client.0.smithi146.stdout:f snap 27 2023-12-01T15:48:07.548 INFO:tasks.workunit.client.0.smithi146.stdout:I snap 27 2023-12-01T15:48:07.548 INFO:tasks.workunit.client.0.smithi146.stdout:K snap 27 2023-12-01T15:48:07.548 INFO:tasks.workunit.client.0.smithi146.stdout:k snap 27 2023-12-01T15:48:07.549 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-12-01T15:48:07.565 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /S 2023-12-01T15:48:07.575 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /T 2023-12-01T15:48:07.586 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap1 diff listing verification for /C 2023-12-01T15:48:07.602 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap1 diff listing verification for /C/CC 2023-12-01T15:48:07.614 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /I 2023-12-01T15:48:07.625 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /I/J 2023-12-01T15:48:07.638 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /L 2023-12-01T15:48:07.650 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /L/LL 2023-12-01T15:48:07.660 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /L/LN 2023-12-01T15:48:07.672 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for /L/LM 2023-12-01T15:48:07.686 INFO:tasks.workunit.client.0.smithi146.stdout:------------- 2023-12-01T15:48:08.862 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapDiffCases1_2 (2074 ms) 2023-12-01T15:48:08.862 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapDiffCases2_3 2023-12-01T15:48:09.621 INFO:tasks.workunit.client.0.smithi146.stdout:33 vs. 34 2023-12-01T15:48:09.621 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing for / 2023-12-01T15:48:09.630 INFO:tasks.workunit.client.0.smithi146.stdout:H snap 34 2023-12-01T15:48:09.631 INFO:tasks.workunit.client.0.smithi146.stdout:L snap 34 2023-12-01T15:48:09.632 INFO:tasks.workunit.client.0.smithi146.stdout:S snap 34 2023-12-01T15:48:09.632 INFO:tasks.workunit.client.0.smithi146.stdout:ff snap 33 2023-12-01T15:48:09.633 INFO:tasks.workunit.client.0.smithi146.stdout:T snap 34 2023-12-01T15:48:09.633 INFO:tasks.workunit.client.0.smithi146.stdout:d snap 34 2023-12-01T15:48:09.634 INFO:tasks.workunit.client.0.smithi146.stdout:G snap 34 2023-12-01T15:48:09.634 INFO:tasks.workunit.client.0.smithi146.stdout:e snap 33 2023-12-01T15:48:09.634 INFO:tasks.workunit.client.0.smithi146.stdout:~e snap 33 2023-12-01T15:48:09.634 INFO:tasks.workunit.client.0.smithi146.stdout:g snap 34 2023-12-01T15:48:09.635 INFO:tasks.workunit.client.0.smithi146.stdout:b snap 34 2023-12-01T15:48:09.635 INFO:tasks.workunit.client.0.smithi146.stdout:f snap 33 2023-12-01T15:48:09.635 INFO:tasks.workunit.client.0.smithi146.stdout:I snap 34 2023-12-01T15:48:09.636 INFO:tasks.workunit.client.0.smithi146.stdout:a snap 34 2023-12-01T15:48:09.636 INFO:tasks.workunit.client.0.smithi146.stdout:K snap 33 2023-12-01T15:48:09.636 INFO:tasks.workunit.client.0.smithi146.stdout:k snap 33 2023-12-01T15:48:09.636 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing verification for / 2023-12-01T15:48:09.651 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing verification for /S 2023-12-01T15:48:09.659 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing verification for /T 2023-12-01T15:48:09.669 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing verification for /G 2023-12-01T15:48:09.682 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 vs. snap2 diff listing verification for /K 2023-12-01T15:48:09.695 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing verification for /H 2023-12-01T15:48:09.707 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing verification for /I 2023-12-01T15:48:09.719 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing verification for /I/J 2023-12-01T15:48:09.731 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing verification for /L 2023-12-01T15:48:09.744 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing verification for /L/LL 2023-12-01T15:48:09.755 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 vs. snap2 diff listing verification for /L/LM 2023-12-01T15:48:09.770 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap2 vs. snap3 diff listing verification for /L/LN 2023-12-01T15:48:09.984 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:48:09.987 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:48:09.990 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:48:10.915 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapDiffCases2_3 (2053 ms) 2023-12-01T15:48:10.915 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapDiffCases1_3 2023-12-01T15:48:11.598 INFO:tasks.workunit.client.0.smithi146.stdout:38 vs. 40 2023-12-01T15:48:11.598 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap3 diff listing for / 2023-12-01T15:48:11.609 INFO:tasks.workunit.client.0.smithi146.stdout:C snap 38 2023-12-01T15:48:11.611 INFO:tasks.workunit.client.0.smithi146.stdout:H snap 40 2023-12-01T15:48:11.612 INFO:tasks.workunit.client.0.smithi146.stdout:L snap 40 2023-12-01T15:48:11.613 INFO:tasks.workunit.client.0.smithi146.stdout:S snap 40 2023-12-01T15:48:11.613 INFO:tasks.workunit.client.0.smithi146.stdout:ff snap 38 2023-12-01T15:48:11.614 INFO:tasks.workunit.client.0.smithi146.stdout:T snap 40 2023-12-01T15:48:11.614 INFO:tasks.workunit.client.0.smithi146.stdout:d snap 40 2023-12-01T15:48:11.615 INFO:tasks.workunit.client.0.smithi146.stdout:G snap 38 2023-12-01T15:48:11.617 INFO:tasks.workunit.client.0.smithi146.stdout:G snap 40 2023-12-01T15:48:11.617 INFO:tasks.workunit.client.0.smithi146.stdout:l snap 40 2023-12-01T15:48:11.617 INFO:tasks.workunit.client.0.smithi146.stdout:e snap 38 2023-12-01T15:48:11.617 INFO:tasks.workunit.client.0.smithi146.stdout:~e snap 38 2023-12-01T15:48:11.617 INFO:tasks.workunit.client.0.smithi146.stdout:g snap 40 2023-12-01T15:48:11.617 INFO:tasks.workunit.client.0.smithi146.stdout:c snap 38 2023-12-01T15:48:11.617 INFO:tasks.workunit.client.0.smithi146.stdout:b snap 40 2023-12-01T15:48:11.617 INFO:tasks.workunit.client.0.smithi146.stdout:f snap 38 2023-12-01T15:48:11.618 INFO:tasks.workunit.client.0.smithi146.stdout:I snap 40 2023-12-01T15:48:11.618 INFO:tasks.workunit.client.0.smithi146.stdout:a snap 40 2023-12-01T15:48:11.618 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 vs. snap1 diff listing verification for / 2023-12-01T15:48:11.634 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 vs. snap1 diff listing verification for /S 2023-12-01T15:48:11.645 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 vs. snap1 diff listing verification for /T 2023-12-01T15:48:11.656 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 vs. snap1 diff listing verification for /C 2023-12-01T15:48:11.670 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 vs. snap1 diff listing verification for /C/CC 2023-12-01T15:48:11.684 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap3 diff listing verification for /G 2023-12-01T15:48:11.693 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap3 vs. snap1 diff listing verification for /G 2023-12-01T15:48:11.702 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap3 diff listing verification for /H 2023-12-01T15:48:11.714 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap3 diff listing verification for /I 2023-12-01T15:48:11.726 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap3 diff listing verification for /I/J 2023-12-01T15:48:11.740 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap3 diff listing verification for /L 2023-12-01T15:48:11.752 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap3 diff listing verification for /L/LL 2023-12-01T15:48:11.764 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap3 diff listing verification for /L/LN 2023-12-01T15:48:11.777 INFO:tasks.workunit.client.0.smithi146.stdout:------------- 2023-12-01T15:48:12.968 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapDiffCases1_3 (2053 ms) 2023-12-01T15:48:12.968 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.HugeSnapDiffSmallDelta 2023-12-01T15:48:40.057 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:48:40.060 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:48:40.062 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:49:10.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:49:14.562 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:49:14.572 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:49:44.644 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:49:44.646 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:49:44.649 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:49:45.574 INFO:tasks.workunit.client.0.smithi146.stdout:Seeding 10000 files... 2023-12-01T15:49:45.575 INFO:tasks.workunit.client.0.smithi146.stdout:44 vs. 45 2023-12-01T15:49:45.575 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-12-01T15:49:45.619 INFO:tasks.workunit.client.0.smithi146.stdout:------------- closing ------------- 2023-12-01T15:50:15.134 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:50:15.137 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:50:15.139 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:50:45.190 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:50:45.472 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:50:45.475 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:50:47.360 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.HugeSnapDiffSmallDelta (154392 ms) 2023-12-01T15:50:47.360 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.HugeSnapDiffLargeDelta 2023-12-01T15:51:15.529 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:51:15.532 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:51:15.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:51:45.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:51:45.600 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:51:45.602 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:52:15.925 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:52:15.928 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:52:15.930 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:52:45.979 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:52:45.982 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:52:45.984 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:53:16.059 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:53:16.062 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:53:16.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:53:46.127 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:53:46.130 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:53:46.132 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:54:16.192 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:54:16.194 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:54:16.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:54:46.249 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:54:46.251 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:54:46.253 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:55:16.636 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:55:16.638 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:55:16.641 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:55:46.701 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:55:46.704 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:55:46.705 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:56:17.226 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:56:17.229 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:56:17.231 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:56:47.307 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:56:47.310 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:56:47.313 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:56:53.656 INFO:tasks.workunit.client.0.smithi146.stdout:Seeding 15100 files... 2023-12-01T15:56:53.657 INFO:tasks.workunit.client.0.smithi146.stdout:48 vs. 49 2023-12-01T15:56:53.660 INFO:tasks.workunit.client.0.smithi146.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-12-01T15:56:55.442 INFO:tasks.workunit.client.0.smithi146.stdout:------------- closing ------------- 2023-12-01T15:57:17.393 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:57:17.396 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:57:17.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:57:47.445 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:57:47.448 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:57:47.450 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T15:57:47.469 INFO:tasks.ceph.mds.b.smithi066.stderr:2023-12-01T15:57:47.460+0000 7f32b7685700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32918) UID: 0 2023-12-01T15:58:04.115 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.HugeSnapDiffLargeDelta (436755 ms) 2023-12-01T15:58:04.116 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 124 tests from LibCephFS (776711 ms total) 2023-12-01T15:58:04.116 INFO:tasks.workunit.client.0.smithi146.stdout: 2023-12-01T15:58:04.116 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 1 test from Caps 2023-12-01T15:58:04.116 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] Caps.ReadZero 2023-12-01T15:58:04.978 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] Caps.ReadZero (862 ms) 2023-12-01T15:58:04.978 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 1 test from Caps (862 ms total) 2023-12-01T15:58:04.978 INFO:tasks.workunit.client.0.smithi146.stdout: 2023-12-01T15:58:04.978 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 5 tests from ACL 2023-12-01T15:58:04.978 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ACL.SetACL 2023-12-01T15:58:05.043 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ACL.SetACL (66 ms) 2023-12-01T15:58:05.043 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ACL.Chmod 2023-12-01T15:58:05.148 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ACL.Chmod (104 ms) 2023-12-01T15:58:05.148 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ACL.DefaultACL 2023-12-01T15:58:05.251 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ACL.DefaultACL (104 ms) 2023-12-01T15:58:05.252 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ACL.Disabled 2023-12-01T15:58:05.339 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ACL.Disabled (88 ms) 2023-12-01T15:58:05.339 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ACL.SnapdirACL 2023-12-01T15:58:06.367 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ACL.SnapdirACL (1028 ms) 2023-12-01T15:58:06.367 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 5 tests from ACL (1390 ms total) 2023-12-01T15:58:06.367 INFO:tasks.workunit.client.0.smithi146.stdout: 2023-12-01T15:58:06.368 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 3 tests from MonConfig 2023-12-01T15:58:06.368 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] MonConfig.MonAddrsMissing 2023-12-01T15:58:06.384 INFO:tasks.workunit.client.0.smithi146.stderr:failed to get an address for mon.a: error -2 2023-12-01T15:58:06.384 INFO:tasks.workunit.client.0.smithi146.stderr:failed to get an address for mon.b: error -2 2023-12-01T15:58:06.384 INFO:tasks.workunit.client.0.smithi146.stderr:failed to get an address for mon.c: error -2 2023-12-01T15:58:06.388 INFO:tasks.workunit.client.0.smithi146.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2023-12-01T15:58:06.388 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] MonConfig.MonAddrsMissing (21 ms) 2023-12-01T15:58:06.388 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] MonConfig.MonAddrsInConfigProxy 2023-12-01T15:58:07.414 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] MonConfig.MonAddrsInConfigProxy (1025 ms) 2023-12-01T15:58:07.414 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] MonConfig.MonAddrsInCct 2023-12-01T15:58:08.469 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] MonConfig.MonAddrsInCct (1055 ms) 2023-12-01T15:58:08.469 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 3 tests from MonConfig (2101 ms total) 2023-12-01T15:58:08.469 INFO:tasks.workunit.client.0.smithi146.stdout: 2023-12-01T15:58:08.469 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment tear-down 2023-12-01T15:58:08.469 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] 133 tests from 4 test suites ran. (781064 ms total) 2023-12-01T15:58:08.469 INFO:tasks.workunit.client.0.smithi146.stdout:[ PASSED ] 133 tests. 2023-12-01T15:58:08.469 INFO:tasks.workunit.client.0.smithi146.stdout: 2023-12-01T15:58:08.469 INFO:tasks.workunit.client.0.smithi146.stdout: YOU HAVE 4 DISABLED TESTS 2023-12-01T15:58:08.470 INFO:tasks.workunit.client.0.smithi146.stdout: 2023-12-01T15:58:08.569 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] Running 98 tests from 2 test suites. 2023-12-01T15:58:08.569 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment set-up. 2023-12-01T15:58:08.569 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 94 tests from LibCephFS 2023-12-01T15:58:08.569 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2023-12-01T15:58:08.760 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OpenEmptyComponent (191 ms) 2023-12-01T15:58:08.761 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2023-12-01T15:58:11.234 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OpenReadTruncate (2473 ms) 2023-12-01T15:58:11.234 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OpenReadWrite 2023-12-01T15:58:12.267 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OpenReadWrite (1033 ms) 2023-12-01T15:58:12.267 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.MountNonExist 2023-12-01T15:58:12.304 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.MountNonExist (38 ms) 2023-12-01T15:58:12.304 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.MountDouble 2023-12-01T15:58:13.332 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.MountDouble (1028 ms) 2023-12-01T15:58:13.332 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.MountRemount 2023-12-01T15:58:15.377 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.MountRemount (2045 ms) 2023-12-01T15:58:15.378 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2023-12-01T15:58:15.394 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.UnmountUnmounted (16 ms) 2023-12-01T15:58:15.394 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2023-12-01T15:58:15.403 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ReleaseUnmounted (9 ms) 2023-12-01T15:58:15.403 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ReleaseMounted 2023-12-01T15:58:16.425 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ReleaseMounted (1022 ms) 2023-12-01T15:58:16.425 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.UnmountRelease 2023-12-01T15:58:16.464 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.UnmountRelease (39 ms) 2023-12-01T15:58:16.464 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Mount 2023-12-01T15:58:18.529 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Mount (2066 ms) 2023-12-01T15:58:18.530 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OpenLayout 2023-12-01T15:58:18.612 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OpenLayout (82 ms) 2023-12-01T15:58:18.612 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DirLs 2023-12-01T15:58:25.348 INFO:tasks.workunit.client.0.smithi146.stdout:rand: 918 2023-12-01T15:58:25.348 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DirLs (6735 ms) 2023-12-01T15:58:25.349 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2023-12-01T15:58:26.289 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ManyNestedDirs (942 ms) 2023-12-01T15:58:26.289 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Xattrs 2023-12-01T15:58:26.421 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_a 2023-12-01T15:58:26.421 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_b 2023-12-01T15:58:26.421 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_c 2023-12-01T15:58:26.421 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_d 2023-12-01T15:58:26.421 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_e 2023-12-01T15:58:26.421 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_f 2023-12-01T15:58:26.421 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_g 2023-12-01T15:58:26.422 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_h 2023-12-01T15:58:26.422 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_i 2023-12-01T15:58:26.422 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_j 2023-12-01T15:58:26.422 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_k 2023-12-01T15:58:26.422 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_l 2023-12-01T15:58:26.422 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_m 2023-12-01T15:58:26.423 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_n 2023-12-01T15:58:26.423 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_o 2023-12-01T15:58:26.423 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_p 2023-12-01T15:58:26.423 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_q 2023-12-01T15:58:26.423 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_r 2023-12-01T15:58:26.423 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_s 2023-12-01T15:58:26.423 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_t 2023-12-01T15:58:26.424 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_u 2023-12-01T15:58:26.424 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_v 2023-12-01T15:58:26.424 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_w 2023-12-01T15:58:26.424 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_x 2023-12-01T15:58:26.424 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_y 2023-12-01T15:58:26.424 INFO:tasks.workunit.client.0.smithi146.stdout:getting attr user.test_xattr_z 2023-12-01T15:58:26.540 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Xattrs (252 ms) 2023-12-01T15:58:26.541 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Xattrs_ll 2023-12-01T15:58:26.593 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Xattrs_ll (52 ms) 2023-12-01T15:58:26.593 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LstatSlashdot 2023-12-01T15:58:26.640 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LstatSlashdot (47 ms) 2023-12-01T15:58:26.640 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.StatDirNlink 2023-12-01T15:58:26.747 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.StatDirNlink (107 ms) 2023-12-01T15:58:26.747 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DoubleChmod 2023-12-01T15:58:26.814 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DoubleChmod (67 ms) 2023-12-01T15:58:26.814 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Fchmod 2023-12-01T15:58:26.886 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Fchmod (72 ms) 2023-12-01T15:58:26.886 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Lchmod 2023-12-01T15:58:26.951 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Lchmod (66 ms) 2023-12-01T15:58:26.951 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Fchown 2023-12-01T15:58:26.998 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Fchown (46 ms) 2023-12-01T15:58:26.998 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.FlagO_PATH 2023-12-01T15:58:27.044 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.FlagO_PATH (46 ms) 2023-12-01T15:58:27.044 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Symlinks 2023-12-01T15:58:27.124 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Symlinks (81 ms) 2023-12-01T15:58:27.124 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DirSyms 2023-12-01T15:58:27.286 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DirSyms (162 ms) 2023-12-01T15:58:27.287 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LoopSyms 2023-12-01T15:58:27.480 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LoopSyms (194 ms) 2023-12-01T15:58:27.481 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2023-12-01T15:58:27.726 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (246 ms) 2023-12-01T15:58:27.727 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.BadArgument 2023-12-01T15:58:28.753 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.BadArgument (1026 ms) 2023-12-01T15:58:28.753 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.BadFileDesc 2023-12-01T15:58:28.789 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.BadFileDesc (37 ms) 2023-12-01T15:58:28.789 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2023-12-01T15:58:28.838 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ReadEmptyFile (48 ms) 2023-12-01T15:58:28.838 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.PreadvPwritev 2023-12-01T15:58:29.211 INFO:tasks.ceph.mgr.y.smithi066.stderr:2023-12-01T15:58:29.200+0000 7f2add206700 -1 calc_pg_upmaps abort due to max <= 0 2023-12-01T15:58:29.884 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.PreadvPwritev (1047 ms) 2023-12-01T15:58:29.885 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2023-12-01T15:58:29.966 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LlreadvLlwritev (81 ms) 2023-12-01T15:58:29.966 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.StripeUnitGran 2023-12-01T15:58:30.998 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.StripeUnitGran (1032 ms) 2023-12-01T15:58:30.998 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Rename 2023-12-01T15:58:31.080 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Rename (82 ms) 2023-12-01T15:58:31.080 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.UseUnmounted 2023-12-01T15:58:31.094 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.UseUnmounted (15 ms) 2023-12-01T15:58:31.095 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetPoolId 2023-12-01T15:58:31.132 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetPoolId (38 ms) 2023-12-01T15:58:31.132 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetPoolReplication 2023-12-01T15:58:31.183 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetPoolReplication (51 ms) 2023-12-01T15:58:31.184 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetExtentOsds 2023-12-01T15:58:31.248 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetExtentOsds (64 ms) 2023-12-01T15:58:31.248 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2023-12-01T15:58:31.337 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (90 ms) 2023-12-01T15:58:31.337 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.GetOsdAddr 2023-12-01T15:58:31.386 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.GetOsdAddr (49 ms) 2023-12-01T15:58:31.386 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OpenNoClose 2023-12-01T15:58:31.454 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OpenNoClose (68 ms) 2023-12-01T15:58:31.455 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Nlink 2023-12-01T15:58:31.733 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Nlink (279 ms) 2023-12-01T15:58:31.734 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SlashDotDot 2023-12-01T15:58:34.004 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SlashDotDot (2271 ms) 2023-12-01T15:58:34.004 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Btime 2023-12-01T15:58:35.126 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Btime (1121 ms) 2023-12-01T15:58:35.126 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SetBtime 2023-12-01T15:58:35.217 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SetBtime (92 ms) 2023-12-01T15:58:35.218 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LazyStatx 2023-12-01T15:58:36.367 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LazyStatx (1150 ms) 2023-12-01T15:58:36.367 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ChangeAttr 2023-12-01T15:58:36.452 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ChangeAttr (84 ms) 2023-12-01T15:58:36.452 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2023-12-01T15:58:36.562 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (110 ms) 2023-12-01T15:58:36.562 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2023-12-01T15:58:36.868 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (307 ms) 2023-12-01T15:58:36.868 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2023-12-01T15:58:37.117 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (248 ms) 2023-12-01T15:58:37.117 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SetSize 2023-12-01T15:58:37.323 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SetSize (206 ms) 2023-12-01T15:58:37.323 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2023-12-01T15:58:37.397 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OperationsOnRoot (74 ms) 2023-12-01T15:58:37.397 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ShutdownRace 2023-12-01T15:58:37.397 INFO:tasks.workunit.client.0.smithi146.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2023-12-01T15:59:12.352 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ShutdownRace (34955 ms) 2023-12-01T15:59:12.353 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.TestUtime 2023-12-01T15:59:12.416 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.TestUtime (64 ms) 2023-12-01T15:59:12.416 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.TestUtimes 2023-12-01T15:59:12.486 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.TestUtimes (71 ms) 2023-12-01T15:59:12.487 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.TestFutimens 2023-12-01T15:59:12.547 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.TestFutimens (60 ms) 2023-12-01T15:59:12.547 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2023-12-01T15:59:12.613 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.OperationsOnDotDot (66 ms) 2023-12-01T15:59:12.613 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Caps_vxattr 2023-12-01T15:59:12.660 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Caps_vxattr (46 ms) 2023-12-01T15:59:12.660 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapXattrs 2023-12-01T15:59:13.690 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapXattrs (1030 ms) 2023-12-01T15:59:13.690 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Lseek 2023-12-01T15:59:13.751 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Lseek (61 ms) 2023-12-01T15:59:13.751 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2023-12-01T15:59:14.779 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (1029 ms) 2023-12-01T15:59:14.780 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2023-12-01T15:59:15.809 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.EmptySnapInfo (1030 ms) 2023-12-01T15:59:15.809 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapInfo 2023-12-01T15:59:16.841 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapInfo (1031 ms) 2023-12-01T15:59:16.841 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2023-12-01T15:59:16.875 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LookupInoMDSDir (35 ms) 2023-12-01T15:59:16.876 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LookupVino 2023-12-01T15:59:18.942 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LookupVino (2066 ms) 2023-12-01T15:59:18.942 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Openat 2023-12-01T15:59:19.039 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Openat (97 ms) 2023-12-01T15:59:19.039 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Statxat 2023-12-01T15:59:19.284 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Statxat (245 ms) 2023-12-01T15:59:19.284 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2023-12-01T15:59:19.421 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.StatxatATFDCWD (137 ms) 2023-12-01T15:59:19.421 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Fdopendir 2023-12-01T15:59:19.606 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Fdopendir (185 ms) 2023-12-01T15:59:19.606 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2023-12-01T15:59:19.798 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (192 ms) 2023-12-01T15:59:19.798 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2023-12-01T15:59:19.988 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (190 ms) 2023-12-01T15:59:19.988 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2023-12-01T15:59:20.157 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (170 ms) 2023-12-01T15:59:20.158 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Mkdirat 2023-12-01T15:59:20.341 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Mkdirat (184 ms) 2023-12-01T15:59:20.342 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2023-12-01T15:59:20.405 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (64 ms) 2023-12-01T15:59:20.405 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Readlinkat 2023-12-01T15:59:20.560 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Readlinkat (154 ms) 2023-12-01T15:59:20.560 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2023-12-01T15:59:20.728 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (168 ms) 2023-12-01T15:59:20.728 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Symlinkat 2023-12-01T15:59:20.898 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Symlinkat (170 ms) 2023-12-01T15:59:20.898 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2023-12-01T15:59:21.125 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (226 ms) 2023-12-01T15:59:21.125 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Unlinkat 2023-12-01T15:59:21.272 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Unlinkat (147 ms) 2023-12-01T15:59:21.272 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2023-12-01T15:59:21.500 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (228 ms) 2023-12-01T15:59:21.500 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Chownat 2023-12-01T15:59:21.688 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Chownat (188 ms) 2023-12-01T15:59:21.688 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2023-12-01T15:59:21.867 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ChownatATFDCWD (179 ms) 2023-12-01T15:59:21.867 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Chmodat 2023-12-01T15:59:22.056 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Chmodat (189 ms) 2023-12-01T15:59:22.056 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2023-12-01T15:59:22.299 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (243 ms) 2023-12-01T15:59:22.299 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.Utimensat 2023-12-01T15:59:26.252 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.Utimensat (3952 ms) 2023-12-01T15:59:26.253 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2023-12-01T15:59:26.492 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (240 ms) 2023-12-01T15:59:26.492 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2023-12-01T15:59:27.171 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (678 ms) 2023-12-01T15:59:27.171 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2023-12-01T15:59:28.200 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (1030 ms) 2023-12-01T15:59:28.200 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SetMountTimeout 2023-12-01T15:59:29.230 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SetMountTimeout (1030 ms) 2023-12-01T15:59:29.231 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.FsCrypt 2023-12-01T15:59:30.304 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.FsCrypt (1072 ms) 2023-12-01T15:59:30.304 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2023-12-01T15:59:31.329 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapdirAttrs (1026 ms) 2023-12-01T15:59:31.329 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapCreate 2023-12-01T15:59:32.359 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapCreate (1030 ms) 2023-12-01T15:59:32.359 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapDelete 2023-12-01T15:59:33.390 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapDelete (1031 ms) 2023-12-01T15:59:33.390 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapRename 2023-12-01T15:59:34.420 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapRename (1031 ms) 2023-12-01T15:59:34.421 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 94 tests from LibCephFS (85851 ms total) 2023-12-01T15:59:34.421 INFO:tasks.workunit.client.0.smithi146.stdout: 2023-12-01T15:59:34.421 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 4 tests from AccessTest 2023-12-01T15:59:34.421 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] AccessTest.Foo 2023-12-01T15:59:34.464 INFO:tasks.workunit.client.0.smithi146.stdout:out: [{"entity":"client.libcephfs_foo_test.822409173","key":"AQDmAmplPDKkGhAARDR6C5ZnCm+Y2YcomSOF5g==","caps":{"mds":"allow rw","mon":"allow *","osd":"allow rw"}}] 2023-12-01T15:59:34.464 INFO:tasks.workunit.client.0.smithi146.stdout:key: AQDmAmplPDKkGhAARDR6C5ZnCm+Y2YcomSOF5g== 2023-12-01T15:59:35.508 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] AccessTest.Foo (1087 ms) 2023-12-01T15:59:35.508 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] AccessTest.Path 2023-12-01T15:59:35.570 INFO:tasks.workunit.client.0.smithi146.stdout:out: [{"entity":"client.libcephfs_path_test.456837771","key":"AQDnAmpl9/fqIBAA+VIsfrlxTlMKU3GdN85Czg==","caps":{"mds":"allow r, allow rw path=/ceph_test_libcephfs_access.1073172133","mon":"allow r","osd":"allow rwx"}}] 2023-12-01T15:59:35.570 INFO:tasks.workunit.client.0.smithi146.stdout:key: AQDnAmpl9/fqIBAA+VIsfrlxTlMKU3GdN85Czg== 2023-12-01T15:59:36.743 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] AccessTest.Path (1236 ms) 2023-12-01T15:59:36.744 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] AccessTest.ReadOnly 2023-12-01T15:59:36.949 INFO:tasks.workunit.client.0.smithi146.stdout:out: [{"entity":"client.libcephfs_readonly_test.110872905","key":"AQDoAmplY3S4NxAAwxuuOj6jrDgtUUtAHTnRsA==","caps":{"mds":"allow r","mon":"allow r","osd":"allow rw"}}] 2023-12-01T15:59:36.949 INFO:tasks.workunit.client.0.smithi146.stdout:key: AQDoAmplY3S4NxAAwxuuOj6jrDgtUUtAHTnRsA== 2023-12-01T15:59:37.049 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] AccessTest.ReadOnly (305 ms) 2023-12-01T15:59:37.049 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] AccessTest.User 2023-12-01T15:59:37.127 INFO:tasks.workunit.client.0.smithi146.stdout:out: [{"entity":"client.libcephfs_user_test.298734478","key":"AQDpAmplse6sBhAAkGGXgyP+QQ6swE6grLVydg==","caps":{"mds":"allow rw uid=123 gids=456,789","mon":"allow *","osd":"allow rw"}}] 2023-12-01T15:59:37.127 INFO:tasks.workunit.client.0.smithi146.stdout:key: AQDpAmplse6sBhAAkGGXgyP+QQ6swE6grLVydg== 2023-12-01T15:59:37.333 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] AccessTest.User (285 ms) 2023-12-01T15:59:37.334 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 4 tests from AccessTest (2913 ms total) 2023-12-01T15:59:37.334 INFO:tasks.workunit.client.0.smithi146.stdout: 2023-12-01T15:59:37.334 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment tear-down 2023-12-01T15:59:37.334 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] 98 tests from 2 test suites ran. (88764 ms total) 2023-12-01T15:59:37.334 INFO:tasks.workunit.client.0.smithi146.stdout:[ PASSED ] 98 tests. 2023-12-01T15:59:37.376 DEBUG:teuthology.orchestra.run:got remote process result: 139 2023-12-01T15:59:37.377 INFO:tasks.workunit.client.0.smithi146.stderr:Segmentation fault (core dumped) 2023-12-01T15:59:37.377 INFO:tasks.workunit:Stopping ['libcephfs/test.sh'] on client.0... 2023-12-01T15:59:37.377 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-01T15:59:37.634 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi146 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6f82997ac57b70a895455dfed6256360a1e4c32 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2023-12-01T15:59:37.714 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=da0bbe0e30e14a748d40208492c77710 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi146 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6f82997ac57b70a895455dfed6256360a1e4c32 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2023-12-01T15:59:37.717 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-01T15:59:37.727 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-01T15:59:37.727 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:59:37.727 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T15:59:37.752 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:59:37.752 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T15:59:37.801 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:59:37.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.900+0000 7fa3a7fff700 1 Processor -- start 2023-12-01T15:59:37.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.900+0000 7fa3a7fff700 1 -- start start 2023-12-01T15:59:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.900+0000 7fa3a7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa3a8135760 0x7fa3a813d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.900+0000 7fa3a7fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a80a08e0 con 0x7fa3a8135bf0 2023-12-01T15:59:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.900+0000 7fa3a7fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a80a11f0 con 0x7fa3a8136a10 2023-12-01T15:59:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.900+0000 7fa3a7fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a80a14b0 con 0x7fa3a8135760 2023-12-01T15:59:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.900+0000 7fa3a77fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa3a8135bf0 0x7fa3a813fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45106/0 (socket says 172.21.15.63:45106) 2023-12-01T15:59:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.900+0000 7fa3a67fc700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa3a8135760 0x7fa3a813d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:37.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.900+0000 7fa3a77fe700 1 -- 172.21.15.63:0/1010096087 learned_addr learned my addr 172.21.15.63:0/1010096087 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:37.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.900+0000 7fa3a5ffb700 1 -- 172.21.15.63:0/1010096087 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440071150 0 0) 0x7fa3a80a11f0 con 0x7fa3a8136a10 2023-12-01T15:59:37.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a5ffb700 1 -- 172.21.15.63:0/1010096087 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3940035d0 con 0x7fa3a8136a10 2023-12-01T15:59:37.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a5ffb700 1 -- 172.21.15.63:0/1010096087 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971131921 0 0) 0x7fa3a80a08e0 con 0x7fa3a8135bf0 2023-12-01T15:59:37.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a5ffb700 1 -- 172.21.15.63:0/1010096087 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3a80a11f0 con 0x7fa3a8135bf0 2023-12-01T15:59:37.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a67fc700 1 -- 172.21.15.63:0/1010096087 >> v1:172.21.15.66:6789/0 conn(0x7fa3a8136a10 legacy=0x7fa3a8135050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a67fc700 1 -- 172.21.15.63:0/1010096087 >> v1:172.21.15.63:6789/0 conn(0x7fa3a8135bf0 legacy=0x7fa3a813fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a67fc700 1 -- 172.21.15.63:0/1010096087 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8136170 con 0x7fa3a8135760 2023-12-01T15:59:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a67fc700 1 --2- 172.21.15.63:0/1010096087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3a8135760 0x7fa3a813d510 secure :-1 s=READY pgs=2906 cs=0 l=1 rev1=1 crypto rx=0x7fa390009840 tx=0x7fa390009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717ffe364e171bec server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a5ffb700 1 -- 172.21.15.63:0/1010096087 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390005e50 con 0x7fa3a8135760 2023-12-01T15:59:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a5ffb700 1 -- 172.21.15.63:0/1010096087 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa390006030 con 0x7fa3a8135760 2023-12-01T15:59:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a5ffb700 1 -- 172.21.15.63:0/1010096087 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3900063c0 con 0x7fa3a8135760 2023-12-01T15:59:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a7fff700 1 -- 172.21.15.63:0/1010096087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3a8135760 msgr2=0x7fa3a813d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a7fff700 1 --2- 172.21.15.63:0/1010096087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3a8135760 0x7fa3a813d510 secure :-1 s=READY pgs=2906 cs=0 l=1 rev1=1 crypto rx=0x7fa390009840 tx=0x7fa390009b50 comp rx=0 tx=0).stop 2023-12-01T15:59:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a7fff700 1 -- 172.21.15.63:0/1010096087 shutdown_connections 2023-12-01T15:59:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a7fff700 1 --2- 172.21.15.63:0/1010096087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3a8135760 0x7fa3a813d510 unknown :-1 s=CLOSED pgs=2906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a7fff700 1 -- 172.21.15.63:0/1010096087 >> 172.21.15.63:0/1010096087 conn(0x7fa3a80a9a90 msgr2=0x7fa3a80a5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a7fff700 1 -- 172.21.15.63:0/1010096087 shutdown_connections 2023-12-01T15:59:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a7fff700 1 -- 172.21.15.63:0/1010096087 wait complete. 2023-12-01T15:59:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a7fff700 1 Processor -- start 2023-12-01T15:59:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.904+0000 7fa3a7fff700 1 -- start start 2023-12-01T15:59:37.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a7fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3a8135760 0x7fa3a81338b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:37.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a7fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3a8135bf0 0x7fa3a8133df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:37.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a7fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3a8136a10 0x7fa3a81cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:37.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a7fff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80a0c50 con 0x7fa3a8135bf0 2023-12-01T15:59:37.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a7fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a809e650 con 0x7fa3a8136a10 2023-12-01T15:59:37.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a7fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a809ef00 con 0x7fa3a8135760 2023-12-01T15:59:37.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a67fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3a8135bf0 0x7fa3a8133df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:37.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a67fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3a8135bf0 0x7fa3a8133df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38352/0 (socket says 172.21.15.63:38352) 2023-12-01T15:59:37.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a67fc700 1 -- 172.21.15.63:0/2048524964 learned_addr learned my addr 172.21.15.63:0/2048524964 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:37.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a77fe700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3a8136a10 0x7fa3a81cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a6ffd700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3a8135760 0x7fa3a81338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a67fc700 1 -- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3a8135760 msgr2=0x7fa3a81338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a67fc700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3a8135760 0x7fa3a81338b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a67fc700 1 -- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3a8136a10 msgr2=0x7fa3a81cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a67fc700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3a8136a10 0x7fa3a81cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a67fc700 1 -- 172.21.15.63:0/2048524964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa390009450 con 0x7fa3a8135bf0 2023-12-01T15:59:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a67fc700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3a8135bf0 0x7fa3a8133df0 secure :-1 s=READY pgs=2907 cs=0 l=1 rev1=1 crypto rx=0x7fa390013040 tx=0x7fa390004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:37.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa39f7fe700 1 -- 172.21.15.63:0/2048524964 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3900068c0 con 0x7fa3a8135bf0 2023-12-01T15:59:37.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa39f7fe700 1 -- 172.21.15.63:0/2048524964 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa390020070 con 0x7fa3a8135bf0 2023-12-01T15:59:37.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a7fff700 1 -- 172.21.15.63:0/2048524964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a81346f0 con 0x7fa3a8135bf0 2023-12-01T15:59:37.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa39f7fe700 1 -- 172.21.15.63:0/2048524964 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390025670 con 0x7fa3a8135bf0 2023-12-01T15:59:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a7fff700 1 -- 172.21.15.63:0/2048524964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a8134d40 con 0x7fa3a8135bf0 2023-12-01T15:59:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa3a7fff700 1 -- 172.21.15.63:0/2048524964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a8065fb0 con 0x7fa3a8135bf0 2023-12-01T15:59:37.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.908+0000 7fa39f7fe700 1 -- 172.21.15.63:0/2048524964 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa390022030 con 0x7fa3a8135bf0 2023-12-01T15:59:37.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.912+0000 7fa39f7fe700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa388065ad0 0x7fa388067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:37.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.912+0000 7fa39f7fe700 1 -- 172.21.15.63:0/2048524964 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7fa390084280 con 0x7fa3a8135bf0 2023-12-01T15:59:37.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.912+0000 7fa3a6ffd700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa388065ad0 0x7fa388067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:37.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.912+0000 7fa3a6ffd700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa388065ad0 0x7fa388067f90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0001560 tx=0x7fa3a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:37.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:37.916+0000 7fa39f7fe700 1 -- 172.21.15.63:0/2048524964 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa3900522f0 con 0x7fa3a8135bf0 2023-12-01T15:59:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.080+0000 7fa3a7fff700 1 -- 172.21.15.63:0/2048524964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3a8061d90 con 0x7fa3a8135bf0 2023-12-01T15:59:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa39f7fe700 1 -- 172.21.15.63:0/2048524964 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+13340 (secure 0 0 0) 0x7fa390055910 con 0x7fa3a8135bf0 2023-12-01T15:59:38.098 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:59:38.099 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":43,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:59:36.778737+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"new_removed_snaps":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:59:38.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 -- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa388065ad0 msgr2=0x7fa388067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa388065ad0 0x7fa388067f90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0001560 tx=0x7fa3a0009040 comp rx=0 tx=0).stop 2023-12-01T15:59:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 -- 172.21.15.63:0/2048524964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3a8135bf0 msgr2=0x7fa3a8133df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3a8135bf0 0x7fa3a8133df0 secure :-1 s=READY pgs=2907 cs=0 l=1 rev1=1 crypto rx=0x7fa390013040 tx=0x7fa390004770 comp rx=0 tx=0).stop 2023-12-01T15:59:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 -- 172.21.15.63:0/2048524964 shutdown_connections 2023-12-01T15:59:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa388065ad0 0x7fa388067f90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3a8136a10 0x7fa3a81cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3a8135bf0 0x7fa3a8133df0 unknown :-1 s=CLOSED pgs=2907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 --2- 172.21.15.63:0/2048524964 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3a8135760 0x7fa3a81338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 -- 172.21.15.63:0/2048524964 >> 172.21.15.63:0/2048524964 conn(0x7fa3a80a9a90 msgr2=0x7fa3a80a7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 -- 172.21.15.63:0/2048524964 shutdown_connections 2023-12-01T15:59:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.084+0000 7fa3a7fff700 1 -- 172.21.15.63:0/2048524964 wait complete. 2023-12-01T15:59:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T15:43:34.432064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-01T15:43:39.868591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T15:43:43.988414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T15:43:44.550416+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 65, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T15:59:38.113 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T15:59:38.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.212+0000 7f9c6b59e700 1 Processor -- start 2023-12-01T15:59:38.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.212+0000 7f9c6b59e700 1 -- start start 2023-12-01T15:59:38.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6c0a0390 0x7f9c6c1374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6b59e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0a47d0 con 0x7f9c6c1370e0 2023-12-01T15:59:38.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6b59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c137a00 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0a3b80 con 0x7f9c6c0a0390 2023-12-01T15:59:38.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6a59c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c6c1370e0 0x7f9c6c0a2d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45118/0 (socket says 172.21.15.63:45118) 2023-12-01T15:59:38.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6a59c700 1 -- 172.21.15.63:0/3108680388 learned_addr learned my addr 172.21.15.63:0/3108680388 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:38.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c69d9b700 1 --2- 172.21.15.63:0/3108680388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6c0a0390 0x7f9c6c1374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6959a700 1 -- 172.21.15.63:0/3108680388 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942494124 0 0) 0x7f9c6c0a47d0 con 0x7f9c6c1370e0 2023-12-01T15:59:38.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6959a700 1 -- 172.21.15.63:0/3108680388 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c540035d0 con 0x7f9c6c1370e0 2023-12-01T15:59:38.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6959a700 1 -- 172.21.15.63:0/3108680388 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360140964 0 0) 0x7f9c60001160 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c69d9b700 1 -- 172.21.15.63:0/3108680388 >> v1:172.21.15.66:6789/0 conn(0x7f9c6c0a1b20 legacy=0x7f9c6c0a3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c69d9b700 1 -- 172.21.15.63:0/3108680388 >> v1:172.21.15.63:6789/0 conn(0x7f9c6c1370e0 legacy=0x7f9c6c0a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c69d9b700 1 -- 172.21.15.63:0/3108680388 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0a09a0 con 0x7f9c6c0a0390 2023-12-01T15:59:38.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c69d9b700 1 --2- 172.21.15.63:0/3108680388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6c0a0390 0x7f9c6c1374c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00af00 tx=0x7f9c5c00c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55b33b23fd13e2e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:38.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6959a700 1 -- 172.21.15.63:0/3108680388 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00f070 con 0x7f9c6c0a0390 2023-12-01T15:59:38.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6959a700 1 -- 172.21.15.63:0/3108680388 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c00a2e0 con 0x7f9c6c0a0390 2023-12-01T15:59:38.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6959a700 1 -- 172.21.15.63:0/3108680388 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00cbb0 con 0x7f9c6c0a0390 2023-12-01T15:59:38.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6b59e700 1 -- 172.21.15.63:0/3108680388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6c0a0390 msgr2=0x7f9c6c1374c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6b59e700 1 --2- 172.21.15.63:0/3108680388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6c0a0390 0x7f9c6c1374c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00af00 tx=0x7f9c5c00c330 comp rx=0 tx=0).stop 2023-12-01T15:59:38.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6b59e700 1 -- 172.21.15.63:0/3108680388 shutdown_connections 2023-12-01T15:59:38.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6b59e700 1 --2- 172.21.15.63:0/3108680388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6c0a0390 0x7f9c6c1374c0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6b59e700 1 -- 172.21.15.63:0/3108680388 >> 172.21.15.63:0/3108680388 conn(0x7f9c6c0a8a70 msgr2=0x7f9c6c0a4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:38.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6b59e700 1 -- 172.21.15.63:0/3108680388 shutdown_connections 2023-12-01T15:59:38.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.216+0000 7f9c6b59e700 1 -- 172.21.15.63:0/3108680388 wait complete. 2023-12-01T15:59:38.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6b59e700 1 Processor -- start 2023-12-01T15:59:38.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6b59e700 1 -- start start 2023-12-01T15:59:38.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6b59e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0a0390 0x7f9c6c072100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6b59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c6c0a1b20 0x7f9c6c06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6c1370e0 0x7f9c6c06ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6b59e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c09e630 con 0x7f9c6c0a0390 2023-12-01T15:59:38.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6b59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c06f680 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c09fdb0 con 0x7f9c6c1370e0 2023-12-01T15:59:38.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0a0390 0x7f9c6c072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0a0390 0x7f9c6c072100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38356/0 (socket says 172.21.15.63:38356) 2023-12-01T15:59:38.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c69d9b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c6c0a1b20 0x7f9c6c06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6a59c700 1 -- 172.21.15.63:0/1904568148 learned_addr learned my addr 172.21.15.63:0/1904568148 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:38.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6ad9d700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6c1370e0 0x7f9c6c06ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c69d9b700 1 -- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6c1370e0 msgr2=0x7f9c6c06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c69d9b700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6c1370e0 0x7f9c6c06ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c69d9b700 1 -- 172.21.15.63:0/1904568148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0a0390 msgr2=0x7f9c6c072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c69d9b700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0a0390 0x7f9c6c072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c69d9b700 1 -- 172.21.15.63:0/1904568148 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c00ab80 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c69d9b700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c6c0a1b20 0x7f9c6c06c4d0 secure :-1 s=READY pgs=2918 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c016000 tx=0x7f9c5c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:38.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c5affd700 1 -- 172.21.15.63:0/1904568148 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c01c620 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6b59e700 1 -- 172.21.15.63:0/1904568148 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c134620 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c5affd700 1 -- 172.21.15.63:0/1904568148 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c00cba0 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c6b59e700 1 -- 172.21.15.63:0/1904568148 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c06f3c0 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.220+0000 7f9c5affd700 1 -- 172.21.15.63:0/1904568148 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c01c780 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.224+0000 7f9c6b59e700 1 -- 172.21.15.63:0/1904568148 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c065fb0 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.224+0000 7f9c5affd700 1 -- 172.21.15.63:0/1904568148 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9c5c01c8e0 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.224+0000 7f9c5affd700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9c4c065ad0 0x7f9c4c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.224+0000 7f9c5affd700 1 -- 172.21.15.63:0/1904568148 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f9c5c084390 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.224+0000 7f9c6a59c700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9c4c065ad0 0x7f9c4c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.224+0000 7f9c6a59c700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9c4c065ad0 0x7f9c4c067f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c64005930 tx=0x7f9c64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:38.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.236+0000 7f9c5affd700 1 -- 172.21.15.63:0/1904568148 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f9c5c052380 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.400+0000 7f9c6b59e700 1 -- 172.21.15.63:0/1904568148 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c6c061d90 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.400+0000 7f9c5affd700 1 -- 172.21.15.63:0/1904568148 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c5c0559a0 con 0x7f9c6c0a1b20 2023-12-01T15:59:38.416 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-01T15:59:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 -- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9c4c065ad0 msgr2=0x7f9c4c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9c4c065ad0 0x7f9c4c067f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c64005930 tx=0x7f9c64009040 comp rx=0 tx=0).stop 2023-12-01T15:59:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 -- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c6c0a1b20 msgr2=0x7f9c6c06c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c6c0a1b20 0x7f9c6c06c4d0 secure :-1 s=READY pgs=2918 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c016000 tx=0x7f9c5c004af0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 -- 172.21.15.63:0/1904568148 shutdown_connections 2023-12-01T15:59:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9c4c065ad0 0x7f9c4c067f90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6c1370e0 0x7f9c6c06ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c6c0a1b20 0x7f9c6c06c4d0 unknown :-1 s=CLOSED pgs=2918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 --2- 172.21.15.63:0/1904568148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c6c0a0390 0x7f9c6c072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 -- 172.21.15.63:0/1904568148 >> 172.21.15.63:0/1904568148 conn(0x7f9c6c0a8a70 msgr2=0x7f9c6c1bea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 -- 172.21.15.63:0/1904568148 shutdown_connections 2023-12-01T15:59:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.404+0000 7f9c6b59e700 1 -- 172.21.15.63:0/1904568148 wait complete. 2023-12-01T15:59:38.429 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-01T15:59:38.541 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2359e700 1 Processor -- start 2023-12-01T15:59:38.541 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2359e700 1 -- start start 2023-12-01T15:59:38.543 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7e2406c540 0x7f7e24140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.543 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e241405a0 0x7f7e24142990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.543 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2409c320 con 0x7f7e2406ba50 2023-12-01T15:59:38.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e24072830 con 0x7f7e2406c540 2023-12-01T15:59:38.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2409b150 con 0x7f7e241405a0 2023-12-01T15:59:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2259c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7e2406ba50 0x7f7e2406be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45120/0 (socket says 172.21.15.63:45120) 2023-12-01T15:59:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2259c700 1 -- 172.21.15.63:0/2022899883 learned_addr learned my addr 172.21.15.63:0/2022899883 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e22d9d700 1 --2- 172.21.15.63:0/2022899883 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e241405a0 0x7f7e24142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e21d9b700 1 --2- 172.21.15.63:0/2022899883 >> v2:172.21.15.66:3300/0 conn(0x7f7e2406c540 0x7f7e24140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2159a700 1 -- 172.21.15.63:0/2022899883 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966494166 0 0) 0x7f7e2409c320 con 0x7f7e2406ba50 2023-12-01T15:59:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2159a700 1 -- 172.21.15.63:0/2022899883 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e0c0035d0 con 0x7f7e2406ba50 2023-12-01T15:59:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e21d9b700 1 -- 172.21.15.63:0/2022899883 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e241405a0 msgr2=0x7f7e24142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e21d9b700 1 --2- 172.21.15.63:0/2022899883 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e241405a0 0x7f7e24142990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2159a700 1 -- 172.21.15.63:0/2022899883 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 183125004 0 0) 0x7f7e0c0035d0 con 0x7f7e2406ba50 2023-12-01T15:59:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e21d9b700 1 -- 172.21.15.63:0/2022899883 >> v1:172.21.15.63:6789/0 conn(0x7f7e2406ba50 legacy=0x7f7e2406be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e21d9b700 1 -- 172.21.15.63:0/2022899883 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2409d1e0 con 0x7f7e2406c540 2023-12-01T15:59:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e21d9b700 1 --2- 172.21.15.63:0/2022899883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e2406c540 0x7f7e24140060 secure :-1 s=READY pgs=2919 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009840 tx=0x7f7e18009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11435abf74e88d37 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:38.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2159a700 1 -- 172.21.15.63:0/2022899883 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14001670 con 0x7f7e2406c540 2023-12-01T15:59:38.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2159a700 1 -- 172.21.15.63:0/2022899883 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18004030 con 0x7f7e2406c540 2023-12-01T15:59:38.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2159a700 1 -- 172.21.15.63:0/2022899883 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e180043a0 con 0x7f7e2406c540 2023-12-01T15:59:38.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2359e700 1 -- 172.21.15.63:0/2022899883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e2406c540 msgr2=0x7f7e24140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.528+0000 7f7e2359e700 1 --2- 172.21.15.63:0/2022899883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e2406c540 0x7f7e24140060 secure :-1 s=READY pgs=2919 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009840 tx=0x7f7e18009b50 comp rx=0 tx=0).stop 2023-12-01T15:59:38.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 -- 172.21.15.63:0/2022899883 shutdown_connections 2023-12-01T15:59:38.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 --2- 172.21.15.63:0/2022899883 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e241405a0 0x7f7e24142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 --2- 172.21.15.63:0/2022899883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e2406c540 0x7f7e24140060 unknown :-1 s=CLOSED pgs=2919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 -- 172.21.15.63:0/2022899883 >> 172.21.15.63:0/2022899883 conn(0x7f7e240738c0 msgr2=0x7f7e240aa840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 -- 172.21.15.63:0/2022899883 shutdown_connections 2023-12-01T15:59:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 -- 172.21.15.63:0/2022899883 wait complete. 2023-12-01T15:59:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 Processor -- start 2023-12-01T15:59:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 -- start start 2023-12-01T15:59:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e2406ba50 0x7f7e241398f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e2406c540 0x7f7e240a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e241405a0 0x7f7e241cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240a3400 con 0x7f7e2406ba50 2023-12-01T15:59:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e24139e30 con 0x7f7e2406c540 2023-12-01T15:59:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240a3d60 con 0x7f7e241405a0 2023-12-01T15:59:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e2406ba50 0x7f7e241398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e2406ba50 0x7f7e241398f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38368/0 (socket says 172.21.15.63:38368) 2023-12-01T15:59:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2259c700 1 -- 172.21.15.63:0/3378577537 learned_addr learned my addr 172.21.15.63:0/3378577537 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e21d9b700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e2406c540 0x7f7e240a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e22d9d700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e241405a0 0x7f7e241cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2259c700 1 -- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e241405a0 msgr2=0x7f7e241cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2259c700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e241405a0 0x7f7e241cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2259c700 1 -- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e2406c540 msgr2=0x7f7e240a3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2259c700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e2406c540 0x7f7e240a3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2259c700 1 -- 172.21.15.63:0/3378577537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e18009450 con 0x7f7e2406ba50 2023-12-01T15:59:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e2259c700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e2406ba50 0x7f7e241398f0 secure :-1 s=READY pgs=2910 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c540 tx=0x7f7e1400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e12ffd700 1 -- 172.21.15.63:0/3378577537 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14004ca0 con 0x7f7e2406ba50 2023-12-01T15:59:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.532+0000 7f7e12ffd700 1 -- 172.21.15.63:0/3378577537 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e14004e00 con 0x7f7e2406ba50 2023-12-01T15:59:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.536+0000 7f7e2359e700 1 -- 172.21.15.63:0/3378577537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e240a2df0 con 0x7f7e2406ba50 2023-12-01T15:59:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.536+0000 7f7e12ffd700 1 -- 172.21.15.63:0/3378577537 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14007310 con 0x7f7e2406ba50 2023-12-01T15:59:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.536+0000 7f7e2359e700 1 -- 172.21.15.63:0/3378577537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e240a30b0 con 0x7f7e2406ba50 2023-12-01T15:59:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.536+0000 7f7e2359e700 1 -- 172.21.15.63:0/3378577537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e24065fb0 con 0x7f7e2406ba50 2023-12-01T15:59:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.536+0000 7f7e12ffd700 1 -- 172.21.15.63:0/3378577537 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e14007470 con 0x7f7e2406ba50 2023-12-01T15:59:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.536+0000 7f7e12ffd700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e04065ad0 0x7f7e04067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.536+0000 7f7e12ffd700 1 -- 172.21.15.63:0/3378577537 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f7e140828d0 con 0x7f7e2406ba50 2023-12-01T15:59:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.536+0000 7f7e21d9b700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e04065ad0 0x7f7e04067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.536+0000 7f7e21d9b700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e04065ad0 0x7f7e04067f90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800a010 tx=0x7f7e18008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.540+0000 7f7e12ffd700 1 -- 172.21.15.63:0/3378577537 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f7e14050780 con 0x7f7e2406ba50 2023-12-01T15:59:38.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.704+0000 7f7e2359e700 1 -- 172.21.15.63:0/3378577537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7e24061d90 con 0x7f7e2406ba50 2023-12-01T15:59:38.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.704+0000 7f7e12ffd700 1 -- 172.21.15.63:0/3378577537 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e14007720 con 0x7f7e2406ba50 2023-12-01T15:59:38.721 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2023-12-01T15:59:38.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 -- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e04065ad0 msgr2=0x7f7e04067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e04065ad0 0x7f7e04067f90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800a010 tx=0x7f7e18008030 comp rx=0 tx=0).stop 2023-12-01T15:59:38.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 -- 172.21.15.63:0/3378577537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e2406ba50 msgr2=0x7f7e241398f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e2406ba50 0x7f7e241398f0 secure :-1 s=READY pgs=2910 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c540 tx=0x7f7e1400c850 comp rx=0 tx=0).stop 2023-12-01T15:59:38.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 -- 172.21.15.63:0/3378577537 shutdown_connections 2023-12-01T15:59:38.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7e04065ad0 0x7f7e04067f90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e241405a0 0x7f7e241cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e2406c540 0x7f7e240a3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 --2- 172.21.15.63:0/3378577537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e2406ba50 0x7f7e241398f0 unknown :-1 s=CLOSED pgs=2910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 -- 172.21.15.63:0/3378577537 >> 172.21.15.63:0/3378577537 conn(0x7f7e240738c0 msgr2=0x7f7e2413fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:38.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 -- 172.21.15.63:0/3378577537 shutdown_connections 2023-12-01T15:59:38.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.708+0000 7f7e2359e700 1 -- 172.21.15.63:0/3378577537 wait complete. 2023-12-01T15:59:38.735 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T15:59:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.840+0000 7f682359e700 1 Processor -- start 2023-12-01T15:59:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.840+0000 7f682359e700 1 -- start start 2023-12-01T15:59:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.840+0000 7f682359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241311b0 0x7f6824131590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.840+0000 7f682359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68240a49b0 con 0x7f6824137240 2023-12-01T15:59:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.840+0000 7f682359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68240a2780 con 0x7f6824137d90 2023-12-01T15:59:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.840+0000 7f682359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68240a1230 con 0x7f68241311b0 2023-12-01T15:59:38.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6821d9b700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6824137240 0x7f6824137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45124/0 (socket says 172.21.15.63:45124) 2023-12-01T15:59:38.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6821d9b700 1 -- 172.21.15.63:0/2584718269 learned_addr learned my addr 172.21.15.63:0/2584718269 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:38.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682259c700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241311b0 0x7f6824131590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276432929 0 0) 0x7f68240a49b0 con 0x7f6824137240 2023-12-01T15:59:38.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68100035d0 con 0x7f6824137240 2023-12-01T15:59:38.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038195072 0 0) 0x7f68240a2780 con 0x7f6824137d90 2023-12-01T15:59:38.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68240a49b0 con 0x7f6824137d90 2023-12-01T15:59:38.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 770247021 0 0) 0x7f68100035d0 con 0x7f6824137240 2023-12-01T15:59:38.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241311b0 msgr2=0x7f6824131590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:38.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241311b0 0x7f6824131590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 >> v1:172.21.15.66:6789/0 conn(0x7f6824137d90 legacy=0x7f682413f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68240a4610 con 0x7f6824137240 2023-12-01T15:59:38.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3363315130 0 0) 0x7f680c001670 con 0x7f6824137240 2023-12-01T15:59:38.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 >> v1:172.21.15.63:6789/0 conn(0x7f6824137240 legacy=0x7f6824137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6810003c50 0x7f6810004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 0x7f6810004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241311b0 0x7f68100052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68240a1230 con 0x7f6810004870 2023-12-01T15:59:38.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681000bbc0 con 0x7f6810003c50 2023-12-01T15:59:38.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681000df90 con 0x7f68241311b0 2023-12-01T15:59:38.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6821d9b700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 0x7f6810004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682259c700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6810003c50 0x7f6810004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6822d9d700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241311b0 0x7f68100052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6821d9b700 1 -- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241311b0 msgr2=0x7f68100052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:38.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6821d9b700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241311b0 0x7f68100052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6821d9b700 1 -- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6810003c50 msgr2=0x7f6810004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:38.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6821d9b700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6810003c50 0x7f6810004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6821d9b700 1 -- 172.21.15.63:0/2584718269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68100035d0 con 0x7f6810004870 2023-12-01T15:59:38.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6822d9d700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241311b0 0x7f68100052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:59:38.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6821d9b700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 0x7f6810004cf0 secure :-1 s=READY pgs=2912 cs=0 l=1 rev1=1 crypto rx=0x7f680c00c240 tx=0x7f68100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5cab169e58a595 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:38.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c00cde0 con 0x7f6810004870 2023-12-01T15:59:38.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c005980 con 0x7f6810004870 2023-12-01T15:59:38.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682159a700 1 -- 172.21.15.63:0/2584718269 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c005d30 con 0x7f6810004870 2023-12-01T15:59:38.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682359e700 1 -- 172.21.15.63:0/2584718269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 msgr2=0x7f6810004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682359e700 1 --2- 172.21.15.63:0/2584718269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 0x7f6810004cf0 secure :-1 s=READY pgs=2912 cs=0 l=1 rev1=1 crypto rx=0x7f680c00c240 tx=0x7f68100058a0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f6822d9d700 1 -- 172.21.15.63:0/2584718269 reap_dead start 2023-12-01T15:59:38.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682359e700 1 -- 172.21.15.63:0/2584718269 shutdown_connections 2023-12-01T15:59:38.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682359e700 1 -- 172.21.15.63:0/2584718269 >> 172.21.15.63:0/2584718269 conn(0x7f68240a8a70 msgr2=0x7f68240a4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:38.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682359e700 1 -- 172.21.15.63:0/2584718269 shutdown_connections 2023-12-01T15:59:38.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.844+0000 7f682359e700 1 -- 172.21.15.63:0/2584718269 wait complete. 2023-12-01T15:59:38.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682359e700 1 Processor -- start 2023-12-01T15:59:38.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682359e700 1 -- start start 2023-12-01T15:59:38.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682359e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 0x7f682412fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68241303b0 0x7f68241cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241cb8e0 0x7f68241cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682359e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824134ec0 con 0x7f6810004870 2023-12-01T15:59:38.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682406c650 con 0x7f68241303b0 2023-12-01T15:59:38.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6824071d60 con 0x7f68241cb8e0 2023-12-01T15:59:38.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 0x7f682412fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 0x7f682412fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38396/0 (socket says 172.21.15.63:38396) 2023-12-01T15:59:38.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682259c700 1 -- 172.21.15.63:0/722030603 learned_addr learned my addr 172.21.15.63:0/722030603 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:38.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f6821d9b700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68241303b0 0x7f68241cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f6822d9d700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241cb8e0 0x7f68241cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682259c700 1 -- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241cb8e0 msgr2=0x7f68241cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682259c700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241cb8e0 0x7f68241cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682259c700 1 -- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68241303b0 msgr2=0x7f68241cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:38.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682259c700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68241303b0 0x7f68241cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:38.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682259c700 1 -- 172.21.15.63:0/722030603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68240722a0 con 0x7f6810004870 2023-12-01T15:59:38.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682259c700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 0x7f682412fe70 secure :-1 s=READY pgs=2913 cs=0 l=1 rev1=1 crypto rx=0x7f681c011a50 tx=0x7f681c011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:38.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f681affd700 1 -- 172.21.15.63:0/722030603 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c00f8e0 con 0x7f6810004870 2023-12-01T15:59:38.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f681affd700 1 -- 172.21.15.63:0/722030603 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c00fa40 con 0x7f6810004870 2023-12-01T15:59:38.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f681affd700 1 -- 172.21.15.63:0/722030603 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c00fdf0 con 0x7f6810004870 2023-12-01T15:59:38.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682359e700 1 -- 172.21.15.63:0/722030603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682406e5e0 con 0x7f6810004870 2023-12-01T15:59:38.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682359e700 1 -- 172.21.15.63:0/722030603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682406c860 con 0x7f6810004870 2023-12-01T15:59:38.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f682359e700 1 -- 172.21.15.63:0/722030603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6824134b20 con 0x7f6810004870 2023-12-01T15:59:38.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.848+0000 7f681affd700 1 -- 172.21.15.63:0/722030603 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f681c014440 con 0x7f6810004870 2023-12-01T15:59:38.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.852+0000 7f681affd700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6804065ad0 0x7f6804067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:38.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.852+0000 7f681affd700 1 -- 172.21.15.63:0/722030603 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f681c0830d0 con 0x7f6810004870 2023-12-01T15:59:38.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.852+0000 7f6821d9b700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6804065ad0 0x7f6804067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:38.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.852+0000 7f6821d9b700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6804065ad0 0x7f6804067f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f682409d2e0 tx=0x7f680c00a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:38.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:38.856+0000 7f681affd700 1 -- 172.21.15.63:0/722030603 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f681c0510e0 con 0x7f6810004870 2023-12-01T15:59:39.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.020+0000 7f682359e700 1 -- 172.21.15.63:0/722030603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6824065fb0 con 0x7f6810004870 2023-12-01T15:59:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f681affd700 1 -- 172.21.15.63:0/722030603 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f681c054700 con 0x7f6810004870 2023-12-01T15:59:39.037 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-01T15:59:39.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 -- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6804065ad0 msgr2=0x7f6804067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6804065ad0 0x7f6804067f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f682409d2e0 tx=0x7f680c00a000 comp rx=0 tx=0).stop 2023-12-01T15:59:39.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 -- 172.21.15.63:0/722030603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 msgr2=0x7f682412fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 0x7f682412fe70 secure :-1 s=READY pgs=2913 cs=0 l=1 rev1=1 crypto rx=0x7f681c011a50 tx=0x7f681c011d60 comp rx=0 tx=0).stop 2023-12-01T15:59:39.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 -- 172.21.15.63:0/722030603 shutdown_connections 2023-12-01T15:59:39.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6804065ad0 0x7f6804067f90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68241cb8e0 0x7f68241cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68241303b0 0x7f68241cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 --2- 172.21.15.63:0/722030603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6810004870 0x7f682412fe70 unknown :-1 s=CLOSED pgs=2913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 -- 172.21.15.63:0/722030603 >> 172.21.15.63:0/722030603 conn(0x7f68240a8a70 msgr2=0x7f6824131c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:39.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 -- 172.21.15.63:0/722030603 shutdown_connections 2023-12-01T15:59:39.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.024+0000 7f682359e700 1 -- 172.21.15.63:0/722030603 wait complete. 2023-12-01T15:59:39.052 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T15:59:39.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.156+0000 7f95f26ac700 1 Processor -- start 2023-12-01T15:59:39.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.156+0000 7f95f26ac700 1 -- start start 2023-12-01T15:59:39.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95ec13b3b0 0x7f95ec099170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f95ec0a3e10 0x7f95ec142a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec13a660 con 0x7f95ec13afd0 2023-12-01T15:59:39.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ec0a0090 con 0x7f95ec0a3e10 2023-12-01T15:59:39.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec13a8c0 con 0x7f95ec13b3b0 2023-12-01T15:59:39.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95ebfff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f95ec13afd0 0x7f95ec098a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45136/0 (socket says 172.21.15.63:45136) 2023-12-01T15:59:39.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95ebfff700 1 -- 172.21.15.63:0/3630820886 learned_addr learned my addr 172.21.15.63:0/3630820886 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:39.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f0c49700 1 --2- 172.21.15.63:0/3630820886 >> v2:172.21.15.63:3300/0 conn(0x7f95ec0a3e10 0x7f95ec142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95eb7fe700 1 --2- 172.21.15.63:0/3630820886 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95ec13b3b0 0x7f95ec099170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95eaffd700 1 -- 172.21.15.63:0/3630820886 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452980592 0 0) 0x7f95ec13a660 con 0x7f95ec13afd0 2023-12-01T15:59:39.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95eaffd700 1 -- 172.21.15.63:0/3630820886 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d40035d0 con 0x7f95ec13afd0 2023-12-01T15:59:39.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95eb7fe700 1 -- 172.21.15.63:0/3630820886 >> v2:172.21.15.63:3300/0 conn(0x7f95ec0a3e10 msgr2=0x7f95ec142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:39.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95eb7fe700 1 --2- 172.21.15.63:0/3630820886 >> v2:172.21.15.63:3300/0 conn(0x7f95ec0a3e10 0x7f95ec142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95eb7fe700 1 -- 172.21.15.63:0/3630820886 >> v1:172.21.15.63:6789/0 conn(0x7f95ec13afd0 legacy=0x7f95ec098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95eb7fe700 1 -- 172.21.15.63:0/3630820886 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec0a46e0 con 0x7f95ec13b3b0 2023-12-01T15:59:39.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95eb7fe700 1 --2- 172.21.15.63:0/3630820886 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95ec13b3b0 0x7f95ec099170 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009850 tx=0x7f95e0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe63fd9eb3b54fa server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:39.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95eaffd700 1 -- 172.21.15.63:0/3630820886 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0011830 con 0x7f95ec13b3b0 2023-12-01T15:59:39.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95eaffd700 1 -- 172.21.15.63:0/3630820886 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0011990 con 0x7f95ec13b3b0 2023-12-01T15:59:39.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95eaffd700 1 -- 172.21.15.63:0/3630820886 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0011d40 con 0x7f95ec13b3b0 2023-12-01T15:59:39.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 -- 172.21.15.63:0/3630820886 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95ec13b3b0 msgr2=0x7f95ec099170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 --2- 172.21.15.63:0/3630820886 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95ec13b3b0 0x7f95ec099170 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009850 tx=0x7f95e0009b60 comp rx=0 tx=0).stop 2023-12-01T15:59:39.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 -- 172.21.15.63:0/3630820886 shutdown_connections 2023-12-01T15:59:39.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 --2- 172.21.15.63:0/3630820886 >> v2:172.21.15.63:3300/0 conn(0x7f95ec0a3e10 0x7f95ec142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 --2- 172.21.15.63:0/3630820886 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95ec13b3b0 0x7f95ec099170 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 -- 172.21.15.63:0/3630820886 >> 172.21.15.63:0/3630820886 conn(0x7f95ec0a8ea0 msgr2=0x7f95ec0a92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:39.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 -- 172.21.15.63:0/3630820886 shutdown_connections 2023-12-01T15:59:39.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.160+0000 7f95f26ac700 1 -- 172.21.15.63:0/3630820886 wait complete. 2023-12-01T15:59:39.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f26ac700 1 Processor -- start 2023-12-01T15:59:39.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f26ac700 1 -- start start 2023-12-01T15:59:39.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f26ac700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95ec0a3e10 0x7f95ec1cf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f26ac700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95ec13afd0 0x7f95ec1cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f26ac700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec13b3b0 0x7f95ec1d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f26ac700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec06dc50 con 0x7f95ec13b3b0 2023-12-01T15:59:39.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f26ac700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec06d1f0 con 0x7f95ec13afd0 2023-12-01T15:59:39.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f26ac700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0702e0 con 0x7f95ec0a3e10 2023-12-01T15:59:39.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f0c49700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec13b3b0 0x7f95ec1d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f0c49700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec13b3b0 0x7f95ec1d01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38414/0 (socket says 172.21.15.63:38414) 2023-12-01T15:59:39.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f0c49700 1 -- 172.21.15.63:0/2430242915 learned_addr learned my addr 172.21.15.63:0/2430242915 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:39.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95eb7fe700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95ec13afd0 0x7f95ec1cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95ebfff700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95ec0a3e10 0x7f95ec1cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f0c49700 1 -- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95ec0a3e10 msgr2=0x7f95ec1cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f0c49700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95ec0a3e10 0x7f95ec1cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f0c49700 1 -- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95ec13afd0 msgr2=0x7f95ec1cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f0c49700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95ec13afd0 0x7f95ec1cfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f0c49700 1 -- 172.21.15.63:0/2430242915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e00094b0 con 0x7f95ec13b3b0 2023-12-01T15:59:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f0c49700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec13b3b0 0x7f95ec1d01f0 secure :-1 s=READY pgs=2915 cs=0 l=1 rev1=1 crypto rx=0x7f95e400efc0 tx=0x7f95e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95e8ff9700 1 -- 172.21.15.63:0/2430242915 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4009ea0 con 0x7f95ec13b3b0 2023-12-01T15:59:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95e8ff9700 1 -- 172.21.15.63:0/2430242915 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400f040 con 0x7f95ec13b3b0 2023-12-01T15:59:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95e8ff9700 1 -- 172.21.15.63:0/2430242915 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400ced0 con 0x7f95ec13b3b0 2023-12-01T15:59:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f26ac700 1 -- 172.21.15.63:0/2430242915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ec06f200 con 0x7f95ec13b3b0 2023-12-01T15:59:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.164+0000 7f95f26ac700 1 -- 172.21.15.63:0/2430242915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ec134cd0 con 0x7f95ec13b3b0 2023-12-01T15:59:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.168+0000 7f95f26ac700 1 -- 172.21.15.63:0/2430242915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec134b40 con 0x7f95ec13b3b0 2023-12-01T15:59:39.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.168+0000 7f95e8ff9700 1 -- 172.21.15.63:0/2430242915 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f95e4014480 con 0x7f95ec13b3b0 2023-12-01T15:59:39.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.168+0000 7f95e8ff9700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95d8065ad0 0x7f95d8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.168+0000 7f95e8ff9700 1 -- 172.21.15.63:0/2430242915 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f95e40834a0 con 0x7f95ec13b3b0 2023-12-01T15:59:39.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.168+0000 7f95ebfff700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95d8065ad0 0x7f95d8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.172+0000 7f95ebfff700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95d8065ad0 0x7f95d8067f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f95dc007fd0 tx=0x7f95dc007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:39.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.180+0000 7f95e8ff9700 1 -- 172.21.15.63:0/2430242915 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f95e4051400 con 0x7f95ec13b3b0 2023-12-01T15:59:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.344+0000 7f95f26ac700 1 -- 172.21.15.63:0/2430242915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95ec065fb0 con 0x7f95ec13b3b0 2023-12-01T15:59:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.348+0000 7f95e8ff9700 1 -- 172.21.15.63:0/2430242915 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95e40180a0 con 0x7f95ec13b3b0 2023-12-01T15:59:39.361 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-01T15:59:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.348+0000 7f95f26ac700 1 -- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95d8065ad0 msgr2=0x7f95d8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.348+0000 7f95f26ac700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95d8065ad0 0x7f95d8067f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f95dc007fd0 tx=0x7f95dc007de0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.348+0000 7f95f26ac700 1 -- 172.21.15.63:0/2430242915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec13b3b0 msgr2=0x7f95ec1d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.348+0000 7f95f26ac700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec13b3b0 0x7f95ec1d01f0 secure :-1 s=READY pgs=2915 cs=0 l=1 rev1=1 crypto rx=0x7f95e400efc0 tx=0x7f95e400c3a0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.348+0000 7f95f26ac700 1 -- 172.21.15.63:0/2430242915 shutdown_connections 2023-12-01T15:59:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.348+0000 7f95f26ac700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f95d8065ad0 0x7f95d8067f90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.348+0000 7f95f26ac700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95ec13b3b0 0x7f95ec1d01f0 unknown :-1 s=CLOSED pgs=2915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.348+0000 7f95f26ac700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95ec13afd0 0x7f95ec1cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.348+0000 7f95f26ac700 1 --2- 172.21.15.63:0/2430242915 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95ec0a3e10 0x7f95ec1cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.352+0000 7f95f26ac700 1 -- 172.21.15.63:0/2430242915 >> 172.21.15.63:0/2430242915 conn(0x7f95ec0a8ea0 msgr2=0x7f95ec0a2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.352+0000 7f95f26ac700 1 -- 172.21.15.63:0/2430242915 shutdown_connections 2023-12-01T15:59:39.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.352+0000 7f95f26ac700 1 -- 172.21.15.63:0/2430242915 wait complete. 2023-12-01T15:59:39.380 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-01T15:59:39.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecbfff700 1 Processor -- start 2023-12-01T15:59:39.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecbfff700 1 -- start start 2023-12-01T15:59:39.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecbfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7ecc13e6f0 0x7f7ecc140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecbfff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc0705e0 con 0x7f7ecc131390 2023-12-01T15:59:39.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecbfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc06ea10 con 0x7f7ecc131770 2023-12-01T15:59:39.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecbfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc131bd0 con 0x7f7ecc13e6f0 2023-12-01T15:59:39.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecaffd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7ecc131390 0x7f7ecc06dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45150/0 (socket says 172.21.15.63:45150) 2023-12-01T15:59:39.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecaffd700 1 -- 172.21.15.63:0/1582371428 learned_addr learned my addr 172.21.15.63:0/1582371428 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:39.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecb7fe700 1 --2- 172.21.15.63:0/1582371428 >> v2:172.21.15.66:3300/0 conn(0x7f7ecc13e6f0 0x7f7ecc140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ec9ffb700 1 -- 172.21.15.63:0/1582371428 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305200175 0 0) 0x7f7ecc0705e0 con 0x7f7ecc131390 2023-12-01T15:59:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ec9ffb700 1 -- 172.21.15.63:0/1582371428 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb80035d0 con 0x7f7ecc131390 2023-12-01T15:59:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ec9ffb700 1 -- 172.21.15.63:0/1582371428 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3856381417 0 0) 0x7f7eb80035d0 con 0x7f7ecc131390 2023-12-01T15:59:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecb7fe700 1 -- 172.21.15.63:0/1582371428 >> v1:172.21.15.66:6789/0 conn(0x7f7ecc131770 legacy=0x7f7ecc06e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecb7fe700 1 -- 172.21.15.63:0/1582371428 >> v1:172.21.15.63:6789/0 conn(0x7f7ecc131390 legacy=0x7f7ecc06dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.476+0000 7f7ecb7fe700 1 -- 172.21.15.63:0/1582371428 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc071d90 con 0x7f7ecc13e6f0 2023-12-01T15:59:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecb7fe700 1 --2- 172.21.15.63:0/1582371428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ecc13e6f0 0x7f7ecc140ae0 secure :-1 s=READY pgs=2922 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009d90 tx=0x7f7ec400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8848d348ac663a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ec9ffb700 1 -- 172.21.15.63:0/1582371428 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec400e070 con 0x7f7ecc13e6f0 2023-12-01T15:59:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ec9ffb700 1 -- 172.21.15.63:0/1582371428 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec4003a40 con 0x7f7ecc13e6f0 2023-12-01T15:59:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ec9ffb700 1 -- 172.21.15.63:0/1582371428 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4001670 con 0x7f7ecc13e6f0 2023-12-01T15:59:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 -- 172.21.15.63:0/1582371428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ecc13e6f0 msgr2=0x7f7ecc140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 --2- 172.21.15.63:0/1582371428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ecc13e6f0 0x7f7ecc140ae0 secure :-1 s=READY pgs=2922 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009d90 tx=0x7f7ec400b330 comp rx=0 tx=0).stop 2023-12-01T15:59:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 -- 172.21.15.63:0/1582371428 shutdown_connections 2023-12-01T15:59:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 --2- 172.21.15.63:0/1582371428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ecc13e6f0 0x7f7ecc140ae0 unknown :-1 s=CLOSED pgs=2922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 -- 172.21.15.63:0/1582371428 >> 172.21.15.63:0/1582371428 conn(0x7f7ecc0a8bd0 msgr2=0x7f7ecc098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 -- 172.21.15.63:0/1582371428 shutdown_connections 2023-12-01T15:59:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 -- 172.21.15.63:0/1582371428 wait complete. 2023-12-01T15:59:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 Processor -- start 2023-12-01T15:59:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 -- start start 2023-12-01T15:59:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ecc131390 0x7f7ecc12c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ecc131770 0x7f7ecc12c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ecc13e6f0 0x7f7ecc1cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc13df30 con 0x7f7ecc131390 2023-12-01T15:59:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc13cdc0 con 0x7f7ecc13e6f0 2023-12-01T15:59:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecbfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc09c5c0 con 0x7f7ecc131770 2023-12-01T15:59:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecaffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ecc131390 0x7f7ecc12c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecaffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ecc131390 0x7f7ecc12c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38416/0 (socket says 172.21.15.63:38416) 2023-12-01T15:59:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecaffd700 1 -- 172.21.15.63:0/2951708290 learned_addr learned my addr 172.21.15.63:0/2951708290 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7eca7fc700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ecc131770 0x7f7ecc12c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.480+0000 7f7ecb7fe700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ecc13e6f0 0x7f7ecc1cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7eca7fc700 1 -- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ecc13e6f0 msgr2=0x7f7ecc1cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7eca7fc700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ecc13e6f0 0x7f7ecc1cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7eca7fc700 1 -- 172.21.15.63:0/2951708290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ecc131390 msgr2=0x7f7ecc12c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7eca7fc700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ecc131390 0x7f7ecc12c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7eca7fc700 1 -- 172.21.15.63:0/2951708290 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec4009a70 con 0x7f7ecc131770 2023-12-01T15:59:39.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7ecaffd700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ecc131390 0x7f7ecc12c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:59:39.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7eca7fc700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ecc131770 0x7f7ecc12c550 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00c480 tx=0x7f7ebc00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:39.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7ec37fe700 1 -- 172.21.15.63:0/2951708290 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc0052d0 con 0x7f7ecc131770 2023-12-01T15:59:39.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7ecbfff700 1 -- 172.21.15.63:0/2951708290 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc0a5e40 con 0x7f7ecc131770 2023-12-01T15:59:39.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7ec37fe700 1 -- 172.21.15.63:0/2951708290 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc005430 con 0x7f7ecc131770 2023-12-01T15:59:39.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7ec37fe700 1 -- 172.21.15.63:0/2951708290 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc0055a0 con 0x7f7ecc131770 2023-12-01T15:59:39.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7ecbfff700 1 -- 172.21.15.63:0/2951708290 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc13dc70 con 0x7f7ecc131770 2023-12-01T15:59:39.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7ecbfff700 1 -- 172.21.15.63:0/2951708290 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc065fb0 con 0x7f7ecc131770 2023-12-01T15:59:39.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7ec37fe700 1 -- 172.21.15.63:0/2951708290 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7ebc0038a0 con 0x7f7ecc131770 2023-12-01T15:59:39.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.484+0000 7f7ec37fe700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7eac065ad0 0x7f7eac067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.488+0000 7f7ec37fe700 1 -- 172.21.15.63:0/2951708290 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f7ebc081ee0 con 0x7f7ecc131770 2023-12-01T15:59:39.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.488+0000 7f7ecaffd700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7eac065ad0 0x7f7eac067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.488+0000 7f7ecaffd700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7eac065ad0 0x7f7eac067f90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40011e0 tx=0x7f7eb4001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:39.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.496+0000 7f7ec37fe700 1 -- 172.21.15.63:0/2951708290 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f7ebc04fee0 con 0x7f7ecc131770 2023-12-01T15:59:39.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.672+0000 7f7ecbfff700 1 -- 172.21.15.63:0/2951708290 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7ecc12caf0 con 0x7f7ecc131770 2023-12-01T15:59:39.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.672+0000 7f7ec37fe700 1 -- 172.21.15.63:0/2951708290 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7ebc017080 con 0x7f7ecc131770 2023-12-01T15:59:39.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 -- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7eac065ad0 msgr2=0x7f7eac067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7eac065ad0 0x7f7eac067f90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40011e0 tx=0x7f7eb4001230 comp rx=0 tx=0).stop 2023-12-01T15:59:39.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 -- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ecc131770 msgr2=0x7f7ecc12c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ecc131770 0x7f7ecc12c550 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00c480 tx=0x7f7ebc00c790 comp rx=0 tx=0).stop 2023-12-01T15:59:39.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 -- 172.21.15.63:0/2951708290 shutdown_connections 2023-12-01T15:59:39.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7eac065ad0 0x7f7eac067f90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ecc131770 0x7f7ecc12c550 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ecc13e6f0 0x7f7ecc1cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 --2- 172.21.15.63:0/2951708290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ecc131390 0x7f7ecc12c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 -- 172.21.15.63:0/2951708290 >> 172.21.15.63:0/2951708290 conn(0x7f7ecc0a8bd0 msgr2=0x7f7ecc06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:39.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 -- 172.21.15.63:0/2951708290 shutdown_connections 2023-12-01T15:59:39.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.676+0000 7f7ecbfff700 1 -- 172.21.15.63:0/2951708290 wait complete. 2023-12-01T15:59:39.694 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2023-12-01T15:59:39.707 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-01T15:59:39.707 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T15:59:39.715 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:59:39.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 Processor -- start 2023-12-01T15:59:39.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 -- start start 2023-12-01T15:59:39.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013b7e0 0x7f89c013dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f89c013e110 0x7f89c0140500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c0071470 con 0x7f89c01384d0 2023-12-01T15:59:39.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c0071d10 con 0x7f89c013e110 2023-12-01T15:59:39.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c0070ca0 con 0x7f89c013b7e0 2023-12-01T15:59:39.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c4efd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f89c013e110 0x7f89c0140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c4efd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f89c013e110 0x7f89c0140500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:38558/0 (socket says 172.21.15.63:38558) 2023-12-01T15:59:39.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c4efd700 1 -- 172.21.15.63:0/1711006443 learned_addr learned my addr 172.21.15.63:0/1711006443 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:39.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89b7fff700 1 --2- 172.21.15.63:0/1711006443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013b7e0 0x7f89c013dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89bffff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f89c01384d0 0x7f89c0138d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:44246/0 (socket says 172.21.15.63:44246) 2023-12-01T15:59:39.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c4efd700 1 -- 172.21.15.63:0/1711006443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013b7e0 msgr2=0x7f89c013dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:39.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c4efd700 1 --2- 172.21.15.63:0/1711006443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013b7e0 0x7f89c013dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c4efd700 1 -- 172.21.15.63:0/1711006443 >> v1:172.21.15.66:6789/0 conn(0x7f89c01384d0 legacy=0x7f89c0138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c4efd700 1 -- 172.21.15.63:0/1711006443 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c0139430 con 0x7f89c013e110 2023-12-01T15:59:39.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c4efd700 1 --2- 172.21.15.63:0/1711006443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89c013e110 0x7f89c0140500 secure :-1 s=READY pgs=2924 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009e50 tx=0x7f89b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=565a401124e327a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:39.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89bf7fe700 1 -- 172.21.15.63:0/1711006443 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b800e070 con 0x7f89c013e110 2023-12-01T15:59:39.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89bf7fe700 1 -- 172.21.15.63:0/1711006443 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b800b910 con 0x7f89c013e110 2023-12-01T15:59:39.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89bf7fe700 1 -- 172.21.15.63:0/1711006443 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b800bcc0 con 0x7f89c013e110 2023-12-01T15:59:39.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 -- 172.21.15.63:0/1711006443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89c013e110 msgr2=0x7f89c0140500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 --2- 172.21.15.63:0/1711006443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89c013e110 0x7f89c0140500 secure :-1 s=READY pgs=2924 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009e50 tx=0x7f89b800b330 comp rx=0 tx=0).stop 2023-12-01T15:59:39.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 -- 172.21.15.63:0/1711006443 shutdown_connections 2023-12-01T15:59:39.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 --2- 172.21.15.63:0/1711006443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89c013e110 0x7f89c0140500 unknown :-1 s=CLOSED pgs=2924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 --2- 172.21.15.63:0/1711006443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013b7e0 0x7f89c013dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 -- 172.21.15.63:0/1711006443 >> 172.21.15.63:0/1711006443 conn(0x7f89c00a8bd0 msgr2=0x7f89c0098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:39.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 -- 172.21.15.63:0/1711006443 shutdown_connections 2023-12-01T15:59:39.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.816+0000 7f89c56fe700 1 -- 172.21.15.63:0/1711006443 wait complete. 2023-12-01T15:59:39.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c56fe700 1 Processor -- start 2023-12-01T15:59:39.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c56fe700 1 -- start start 2023-12-01T15:59:39.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c56fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89c01384d0 0x7f89c0134d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c56fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89c013b7e0 0x7f89c0135290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c56fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013e110 0x7f89c01357d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c56fe700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00a2720 con 0x7f89c01384d0 2023-12-01T15:59:39.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c56fe700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00a2130 con 0x7f89c013b7e0 2023-12-01T15:59:39.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c56fe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00a1500 con 0x7f89c013e110 2023-12-01T15:59:39.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c4efd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013e110 0x7f89c01357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c4efd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013e110 0x7f89c01357d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:34926/0 (socket says 172.21.15.63:34926) 2023-12-01T15:59:39.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89b7fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89c013b7e0 0x7f89c0135290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c4efd700 1 -- 172.21.15.63:0/3951420640 learned_addr learned my addr 172.21.15.63:0/3951420640 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:39.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89bffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89c01384d0 0x7f89c0134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c4efd700 1 -- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89c013b7e0 msgr2=0x7f89c0135290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c4efd700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89c013b7e0 0x7f89c0135290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c4efd700 1 -- 172.21.15.63:0/3951420640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89c01384d0 msgr2=0x7f89c0134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:39.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c4efd700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89c01384d0 0x7f89c0134d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:39.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c4efd700 1 -- 172.21.15.63:0/3951420640 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b8009b30 con 0x7f89c013e110 2023-12-01T15:59:39.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c4efd700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013e110 0x7f89c01357d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f89b8012000 tx=0x7f89b8004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:39.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89bd7fa700 1 -- 172.21.15.63:0/3951420640 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b80099b0 con 0x7f89c013e110 2023-12-01T15:59:39.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89bd7fa700 1 -- 172.21.15.63:0/3951420640 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b8004970 con 0x7f89c013e110 2023-12-01T15:59:39.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c56fe700 1 -- 172.21.15.63:0/3951420640 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c00a0350 con 0x7f89c013e110 2023-12-01T15:59:39.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89bd7fa700 1 -- 172.21.15.63:0/3951420640 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b801c680 con 0x7f89c013e110 2023-12-01T15:59:39.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.820+0000 7f89c56fe700 1 -- 172.21.15.63:0/3951420640 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c00a0f30 con 0x7f89c013e110 2023-12-01T15:59:39.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.824+0000 7f89c56fe700 1 -- 172.21.15.63:0/3951420640 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c00a2480 con 0x7f89c013e110 2023-12-01T15:59:39.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.824+0000 7f89bd7fa700 1 -- 172.21.15.63:0/3951420640 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f89b801c7e0 con 0x7f89c013e110 2023-12-01T15:59:39.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.824+0000 7f89bd7fa700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f89a0065ad0 0x7f89a0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:39.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.824+0000 7f89bd7fa700 1 -- 172.21.15.63:0/3951420640 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f89b80844a0 con 0x7f89c013e110 2023-12-01T15:59:39.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.824+0000 7f89bffff700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f89a0065ad0 0x7f89a0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:39.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.824+0000 7f89bffff700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f89a0065ad0 0x7f89a0067f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89b0000f60 tx=0x7f89b0007d90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:39.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:39.836+0000 7f89bd7fa700 1 -- 172.21.15.63:0/3951420640 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f89c00a2480 con 0x7f89c013e110 2023-12-01T15:59:40.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.000+0000 7f89c56fe700 1 -- 172.21.15.63:0/3951420640 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89c0065fb0 con 0x7f89c013e110 2023-12-01T15:59:40.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.004+0000 7f89bd7fa700 1 -- 172.21.15.63:0/3951420640 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+13340 (secure 0 0 0) 0x7f89b80523f0 con 0x7f89c013e110 2023-12-01T15:59:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:59:40.017 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":43,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:59:36.778737+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"new_removed_snaps":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:59:40.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.004+0000 7f89c56fe700 1 -- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f89a0065ad0 msgr2=0x7f89a0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.004+0000 7f89c56fe700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f89a0065ad0 0x7f89a0067f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89b0000f60 tx=0x7f89b0007d90 comp rx=0 tx=0).stop 2023-12-01T15:59:40.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.004+0000 7f89c56fe700 1 -- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013e110 msgr2=0x7f89c01357d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.004+0000 7f89c56fe700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013e110 0x7f89c01357d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f89b8012000 tx=0x7f89b8004af0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.008+0000 7f89c56fe700 1 -- 172.21.15.63:0/3951420640 shutdown_connections 2023-12-01T15:59:40.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.008+0000 7f89c56fe700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f89a0065ad0 0x7f89a0067f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.008+0000 7f89c56fe700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89c013e110 0x7f89c01357d0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.008+0000 7f89c56fe700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89c013b7e0 0x7f89c0135290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.008+0000 7f89c56fe700 1 --2- 172.21.15.63:0/3951420640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89c01384d0 0x7f89c0134d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.008+0000 7f89c56fe700 1 -- 172.21.15.63:0/3951420640 >> 172.21.15.63:0/3951420640 conn(0x7f89c00a8bd0 msgr2=0x7f89c0136760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:40.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.008+0000 7f89c56fe700 1 -- 172.21.15.63:0/3951420640 shutdown_connections 2023-12-01T15:59:40.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.008+0000 7f89c56fe700 1 -- 172.21.15.63:0/3951420640 wait complete. 2023-12-01T15:59:40.036 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T15:43:34.432064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-01T15:43:39.868591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T15:43:43.988414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T15:43:44.550416+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 65, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T15:59:40.036 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T15:59:40.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.136+0000 7f1f49de1700 1 Processor -- start 2023-12-01T15:59:40.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.136+0000 7f1f49de1700 1 -- start start 2023-12-01T15:59:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1f3c0ba5a0 0x7f1f3c01d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0bade0 0x7f1f3c01bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c01cdc0 con 0x7f1f3c0ba980 2023-12-01T15:59:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c020e20 con 0x7f1f3c0ba5a0 2023-12-01T15:59:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c01e7f0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f48ddf700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1f3c0ba5a0 0x7f1f3c01d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f495e0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0bade0 0x7f1f3c01bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f495e0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0bade0 0x7f1f3c01bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:34940/0 (socket says 172.21.15.63:34940) 2023-12-01T15:59:40.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f495e0700 1 -- 172.21.15.63:0/2606419368 learned_addr learned my addr 172.21.15.63:0/2606419368 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:40.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f495e0700 1 -- 172.21.15.63:0/2606419368 >> v2:172.21.15.63:3300/0 conn(0x7f1f3c0ba5a0 msgr2=0x7f1f3c01d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:40.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f495e0700 1 --2- 172.21.15.63:0/2606419368 >> v2:172.21.15.63:3300/0 conn(0x7f1f3c0ba5a0 0x7f1f3c01d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f495e0700 1 -- 172.21.15.63:0/2606419368 >> v1:172.21.15.66:6789/0 conn(0x7f1f3c0ba980 legacy=0x7f1f3c01b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f495e0700 1 -- 172.21.15.63:0/2606419368 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c01eab0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f495e0700 1 --2- 172.21.15.63:0/2606419368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0bade0 0x7f1f3c01bcc0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f1f440641e0 tx=0x7f1f440684f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f87ea6eca7d054 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:40.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f437fe700 1 -- 172.21.15.63:0/2606419368 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4409a380 con 0x7f1f3c0bade0 2023-12-01T15:59:40.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f437fe700 1 -- 172.21.15.63:0/2606419368 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f440008d0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f437fe700 1 -- 172.21.15.63:0/2606419368 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4406b040 con 0x7f1f3c0bade0 2023-12-01T15:59:40.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 -- 172.21.15.63:0/2606419368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0bade0 msgr2=0x7f1f3c01bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 --2- 172.21.15.63:0/2606419368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0bade0 0x7f1f3c01bcc0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f1f440641e0 tx=0x7f1f440684f0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 -- 172.21.15.63:0/2606419368 shutdown_connections 2023-12-01T15:59:40.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 --2- 172.21.15.63:0/2606419368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0bade0 0x7f1f3c01bcc0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 --2- 172.21.15.63:0/2606419368 >> v2:172.21.15.63:3300/0 conn(0x7f1f3c0ba5a0 0x7f1f3c01d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 -- 172.21.15.63:0/2606419368 >> 172.21.15.63:0/2606419368 conn(0x7f1f3c008940 msgr2=0x7f1f3c0309f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:40.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 -- 172.21.15.63:0/2606419368 shutdown_connections 2023-12-01T15:59:40.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.140+0000 7f1f49de1700 1 -- 172.21.15.63:0/2606419368 wait complete. 2023-12-01T15:59:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f49de1700 1 Processor -- start 2023-12-01T15:59:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f49de1700 1 -- start start 2023-12-01T15:59:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f49de1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0ba5a0 0x7f1f3c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f49de1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c0ba980 0x7f1f3c156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f49de1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f3c0bade0 0x7f1f3c157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f49de1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0bd5b0 con 0x7f1f3c0ba980 2023-12-01T15:59:40.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f49de1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0be2a0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f49de1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c02b290 con 0x7f1f3c0ba5a0 2023-12-01T15:59:40.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f43fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c0ba980 0x7f1f3c156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f495e0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f3c0bade0 0x7f1f3c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f43fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c0ba980 0x7f1f3c156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38436/0 (socket says 172.21.15.63:38436) 2023-12-01T15:59:40.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f43fff700 1 -- 172.21.15.63:0/1764811165 learned_addr learned my addr 172.21.15.63:0/1764811165 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:40.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f48ddf700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0ba5a0 0x7f1f3c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f495e0700 1 -- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0ba5a0 msgr2=0x7f1f3c1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f495e0700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0ba5a0 0x7f1f3c1566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f495e0700 1 -- 172.21.15.63:0/1764811165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c0ba980 msgr2=0x7f1f3c156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f495e0700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c0ba980 0x7f1f3c156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f495e0700 1 -- 172.21.15.63:0/1764811165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4406b8a0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f43fff700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c0ba980 0x7f1f3c156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:59:40.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f495e0700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f3c0bade0 0x7f1f3c157170 secure :-1 s=READY pgs=2926 cs=0 l=1 rev1=1 crypto rx=0x7f1f4404fe00 tx=0x7f1f44069110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f417fa700 1 -- 172.21.15.63:0/1764811165 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4406bea0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f417fa700 1 -- 172.21.15.63:0/1764811165 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4404f3f0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f49de1700 1 -- 172.21.15.63:0/1764811165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c0bd7e0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f417fa700 1 -- 172.21.15.63:0/1764811165 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440661b0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.144+0000 7f1f49de1700 1 -- 172.21.15.63:0/1764811165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c02b550 con 0x7f1f3c0bade0 2023-12-01T15:59:40.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.148+0000 7f1f49de1700 1 -- 172.21.15.63:0/1764811165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c0058c0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.148+0000 7f1f417fa700 1 -- 172.21.15.63:0/1764811165 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1f440678b0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.148+0000 7f1f417fa700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1f30065ad0 0x7f1f30067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.148+0000 7f1f417fa700 1 -- 172.21.15.63:0/1764811165 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f1f440fc330 con 0x7f1f3c0bade0 2023-12-01T15:59:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.148+0000 7f1f48ddf700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1f30065ad0 0x7f1f30067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.148+0000 7f1f48ddf700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1f30065ad0 0x7f1f30067f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009bf0 tx=0x7f1f34009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:40.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.160+0000 7f1f417fa700 1 -- 172.21.15.63:0/1764811165 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1f440ca1e0 con 0x7f1f3c0bade0 2023-12-01T15:59:40.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.324+0000 7f1f49de1700 1 -- 172.21.15.63:0/1764811165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f3c020400 con 0x7f1f3c0bade0 2023-12-01T15:59:40.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.328+0000 7f1f417fa700 1 -- 172.21.15.63:0/1764811165 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f4409f020 con 0x7f1f3c0bade0 2023-12-01T15:59:40.341 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-01T15:59:40.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 -- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1f30065ad0 msgr2=0x7f1f30067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1f30065ad0 0x7f1f30067f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009bf0 tx=0x7f1f34009240 comp rx=0 tx=0).stop 2023-12-01T15:59:40.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 -- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f3c0bade0 msgr2=0x7f1f3c157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f3c0bade0 0x7f1f3c157170 secure :-1 s=READY pgs=2926 cs=0 l=1 rev1=1 crypto rx=0x7f1f4404fe00 tx=0x7f1f44069110 comp rx=0 tx=0).stop 2023-12-01T15:59:40.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 -- 172.21.15.63:0/1764811165 shutdown_connections 2023-12-01T15:59:40.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1f30065ad0 0x7f1f30067f90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f3c0bade0 0x7f1f3c157170 unknown :-1 s=CLOSED pgs=2926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c0ba980 0x7f1f3c156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 --2- 172.21.15.63:0/1764811165 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f3c0ba5a0 0x7f1f3c1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 -- 172.21.15.63:0/1764811165 >> 172.21.15.63:0/1764811165 conn(0x7f1f3c008940 msgr2=0x7f1f3c0be760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:40.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 -- 172.21.15.63:0/1764811165 shutdown_connections 2023-12-01T15:59:40.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.332+0000 7f1f49de1700 1 -- 172.21.15.63:0/1764811165 wait complete. 2023-12-01T15:59:40.363 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-01T15:59:40.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f462215b700 1 Processor -- start 2023-12-01T15:59:40.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f462215b700 1 -- start start 2023-12-01T15:59:40.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f462215b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f461c141760 0x7f461c143b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f462215b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c137fa0 con 0x7f461c1377b0 2023-12-01T15:59:40.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f462215b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c0ab9c0 con 0x7f461c137b90 2023-12-01T15:59:40.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f462215b700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c13b200 con 0x7f461c141760 2023-12-01T15:59:40.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f462195a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f461c141760 0x7f461c143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f4621159700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f461c1377b0 0x7f461c13a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45156/0 (socket says 172.21.15.63:45156) 2023-12-01T15:59:40.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f4621159700 1 -- 172.21.15.63:0/170251410 learned_addr learned my addr 172.21.15.63:0/170251410 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:40.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f462195a700 1 -- 172.21.15.63:0/170251410 >> v1:172.21.15.66:6789/0 conn(0x7f461c137b90 legacy=0x7f461c13aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f462195a700 1 -- 172.21.15.63:0/170251410 >> v1:172.21.15.63:6789/0 conn(0x7f461c1377b0 legacy=0x7f461c13a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f462195a700 1 -- 172.21.15.63:0/170251410 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0aafc0 con 0x7f461c141760 2023-12-01T15:59:40.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f462195a700 1 --2- 172.21.15.63:0/170251410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461c141760 0x7f461c143b50 secure :-1 s=READY pgs=2918 cs=0 l=1 rev1=1 crypto rx=0x7f4614009d90 tx=0x7f461400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a477bab6d26494 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:40.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f4613fff700 1 -- 172.21.15.63:0/170251410 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461400e070 con 0x7f461c141760 2023-12-01T15:59:40.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f4613fff700 1 -- 172.21.15.63:0/170251410 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461400bbd0 con 0x7f461c141760 2023-12-01T15:59:40.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.472+0000 7f4613fff700 1 -- 172.21.15.63:0/170251410 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614012430 con 0x7f461c141760 2023-12-01T15:59:40.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.476+0000 7f462215b700 1 -- 172.21.15.63:0/170251410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461c141760 msgr2=0x7f461c143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.476+0000 7f462215b700 1 --2- 172.21.15.63:0/170251410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461c141760 0x7f461c143b50 secure :-1 s=READY pgs=2918 cs=0 l=1 rev1=1 crypto rx=0x7f4614009d90 tx=0x7f461400b330 comp rx=0 tx=0).stop 2023-12-01T15:59:40.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.476+0000 7f462215b700 1 -- 172.21.15.63:0/170251410 shutdown_connections 2023-12-01T15:59:40.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.476+0000 7f462215b700 1 --2- 172.21.15.63:0/170251410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461c141760 0x7f461c143b50 unknown :-1 s=CLOSED pgs=2918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.476+0000 7f462215b700 1 -- 172.21.15.63:0/170251410 >> 172.21.15.63:0/170251410 conn(0x7f461c073710 msgr2=0x7f461c0ac9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:40.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.476+0000 7f462215b700 1 -- 172.21.15.63:0/170251410 shutdown_connections 2023-12-01T15:59:40.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.476+0000 7f462215b700 1 -- 172.21.15.63:0/170251410 wait complete. 2023-12-01T15:59:40.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.476+0000 7f462215b700 1 Processor -- start 2023-12-01T15:59:40.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.476+0000 7f462215b700 1 -- start start 2023-12-01T15:59:40.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f462215b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461c1377b0 0x7f461c1cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f462215b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f461c137b90 0x7f461c1cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f462215b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f461c141760 0x7f461c1cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f462215b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c09dac0 con 0x7f461c1377b0 2023-12-01T15:59:40.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f462215b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c09cce0 con 0x7f461c141760 2023-12-01T15:59:40.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f462215b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c09e730 con 0x7f461c137b90 2023-12-01T15:59:40.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4621159700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461c1377b0 0x7f461c1cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4621159700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461c1377b0 0x7f461c1cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38452/0 (socket says 172.21.15.63:38452) 2023-12-01T15:59:40.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4621159700 1 -- 172.21.15.63:0/2138889544 learned_addr learned my addr 172.21.15.63:0/2138889544 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:40.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f462195a700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f461c141760 0x7f461c1cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4620958700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f461c137b90 0x7f461c1cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4621159700 1 -- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f461c137b90 msgr2=0x7f461c1cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4621159700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f461c137b90 0x7f461c1cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4621159700 1 -- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f461c141760 msgr2=0x7f461c1cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4621159700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f461c141760 0x7f461c1cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4621159700 1 -- 172.21.15.63:0/2138889544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614009a70 con 0x7f461c1377b0 2023-12-01T15:59:40.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4621159700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461c1377b0 0x7f461c1cf200 secure :-1 s=READY pgs=2919 cs=0 l=1 rev1=1 crypto rx=0x7f460c001eb0 tx=0x7f460c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:40.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4611ffb700 1 -- 172.21.15.63:0/2138889544 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c005d90 con 0x7f461c1377b0 2023-12-01T15:59:40.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4611ffb700 1 -- 172.21.15.63:0/2138889544 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c0070d0 con 0x7f461c1377b0 2023-12-01T15:59:40.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f462215b700 1 -- 172.21.15.63:0/2138889544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c09ed40 con 0x7f461c1377b0 2023-12-01T15:59:40.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4611ffb700 1 -- 172.21.15.63:0/2138889544 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c007440 con 0x7f461c1377b0 2023-12-01T15:59:40.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f462215b700 1 -- 172.21.15.63:0/2138889544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c09fc00 con 0x7f461c1377b0 2023-12-01T15:59:40.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f462215b700 1 -- 172.21.15.63:0/2138889544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c09d610 con 0x7f461c1377b0 2023-12-01T15:59:40.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.480+0000 7f4611ffb700 1 -- 172.21.15.63:0/2138889544 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f460c0075a0 con 0x7f461c1377b0 2023-12-01T15:59:40.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.484+0000 7f4611ffb700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4600065ad0 0x7f4600067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.484+0000 7f4611ffb700 1 -- 172.21.15.63:0/2138889544 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f460c082400 con 0x7f461c1377b0 2023-12-01T15:59:40.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.484+0000 7f4620958700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4600065ad0 0x7f4600067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.484+0000 7f4620958700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4600065ad0 0x7f4600067f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f461c13a2a0 tx=0x7f4618009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:40.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.488+0000 7f4611ffb700 1 -- 172.21.15.63:0/2138889544 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f460c050450 con 0x7f461c1377b0 2023-12-01T15:59:40.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.652+0000 7f462215b700 1 -- 172.21.15.63:0/2138889544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f461c137fa0 con 0x7f461c1377b0 2023-12-01T15:59:40.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f4611ffb700 1 -- 172.21.15.63:0/2138889544 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f461c137fa0 con 0x7f461c1377b0 2023-12-01T15:59:40.669 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 8 2023-12-01T15:59:40.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 -- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4600065ad0 msgr2=0x7f4600067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4600065ad0 0x7f4600067f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f461c13a2a0 tx=0x7f4618009040 comp rx=0 tx=0).stop 2023-12-01T15:59:40.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 -- 172.21.15.63:0/2138889544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461c1377b0 msgr2=0x7f461c1cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461c1377b0 0x7f461c1cf200 secure :-1 s=READY pgs=2919 cs=0 l=1 rev1=1 crypto rx=0x7f460c001eb0 tx=0x7f460c00c7b0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 -- 172.21.15.63:0/2138889544 shutdown_connections 2023-12-01T15:59:40.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4600065ad0 0x7f4600067f90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f461c137b90 0x7f461c1cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f461c141760 0x7f461c1cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 --2- 172.21.15.63:0/2138889544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f461c1377b0 0x7f461c1cf200 unknown :-1 s=CLOSED pgs=2919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 -- 172.21.15.63:0/2138889544 >> 172.21.15.63:0/2138889544 conn(0x7f461c073710 msgr2=0x7f461c1391e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:40.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 -- 172.21.15.63:0/2138889544 shutdown_connections 2023-12-01T15:59:40.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.656+0000 7f462215b700 1 -- 172.21.15.63:0/2138889544 wait complete. 2023-12-01T15:59:40.684 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T15:59:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.784+0000 7fb4bc9b0700 1 Processor -- start 2023-12-01T15:59:40.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.784+0000 7fb4bc9b0700 1 -- start start 2023-12-01T15:59:40.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4b81370e0 0x7fb4b81374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb4b80a1b20 0x7fb4b80a3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b80a47d0 con 0x7fb4b80a0390 2023-12-01T15:59:40.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b8137a00 con 0x7fb4b80a1b20 2023-12-01T15:59:40.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b80a09a0 con 0x7fb4b81370e0 2023-12-01T15:59:40.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb4b80a1b20 0x7fb4b80a3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb4b80a1b20 0x7fb4b80a3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38462/0 (socket says 172.21.15.63:38462) 2023-12-01T15:59:40.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b7fff700 1 -- 172.21.15.63:0/1426738132 learned_addr learned my addr 172.21.15.63:0/1426738132 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:40.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b77fe700 1 --2- 172.21.15.63:0/1426738132 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4b81370e0 0x7fb4b81374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b67fc700 1 -- 172.21.15.63:0/1426738132 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874936973 0 0) 0x7fb4b80a47d0 con 0x7fb4b80a0390 2023-12-01T15:59:40.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b7fff700 1 -- 172.21.15.63:0/1426738132 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4b81370e0 msgr2=0x7fb4b81374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:40.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b7fff700 1 --2- 172.21.15.63:0/1426738132 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4b81370e0 0x7fb4b81374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b7fff700 1 -- 172.21.15.63:0/1426738132 >> v1:172.21.15.66:6789/0 conn(0x7fb4b80a0390 legacy=0x7fb4b80a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b7fff700 1 -- 172.21.15.63:0/1426738132 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b80a2060 con 0x7fb4b80a1b20 2023-12-01T15:59:40.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b7fff700 1 --2- 172.21.15.63:0/1426738132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b80a1b20 0x7fb4b80a3470 secure :-1 s=READY pgs=2920 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000d180 tx=0x7fb4b000d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7005e79be73b823f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:40.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b67fc700 1 -- 172.21.15.63:0/1426738132 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0010070 con 0x7fb4b80a1b20 2023-12-01T15:59:40.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b67fc700 1 -- 172.21.15.63:0/1426738132 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b000daf0 con 0x7fb4b80a1b20 2023-12-01T15:59:40.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4b67fc700 1 -- 172.21.15.63:0/1426738132 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b000dea0 con 0x7fb4b80a1b20 2023-12-01T15:59:40.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/1426738132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b80a1b20 msgr2=0x7fb4b80a3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 --2- 172.21.15.63:0/1426738132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b80a1b20 0x7fb4b80a3470 secure :-1 s=READY pgs=2920 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000d180 tx=0x7fb4b000d490 comp rx=0 tx=0).stop 2023-12-01T15:59:40.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/1426738132 shutdown_connections 2023-12-01T15:59:40.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 --2- 172.21.15.63:0/1426738132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b80a1b20 0x7fb4b80a3470 unknown :-1 s=CLOSED pgs=2920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 --2- 172.21.15.63:0/1426738132 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4b81370e0 0x7fb4b81374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/1426738132 >> 172.21.15.63:0/1426738132 conn(0x7fb4b80a8a70 msgr2=0x7fb4b80a4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:40.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.788+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/1426738132 shutdown_connections 2023-12-01T15:59:40.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/1426738132 wait complete. 2023-12-01T15:59:40.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4bc9b0700 1 Processor -- start 2023-12-01T15:59:40.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4bc9b0700 1 -- start start 2023-12-01T15:59:40.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4bc9b0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4b80a0390 0x7fb4b8133eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4bc9b0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4b80a1b20 0x7fb4b81343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4bc9b0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b81370e0 0x7fb4b81cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4bc9b0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b806e350 con 0x7fb4b81370e0 2023-12-01T15:59:40.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4bc9b0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b81374c0 con 0x7fb4b80a1b20 2023-12-01T15:59:40.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4bc9b0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b809fdb0 con 0x7fb4b80a0390 2023-12-01T15:59:40.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4b7fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b81370e0 0x7fb4b81cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4b7fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b81370e0 0x7fb4b81cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38464/0 (socket says 172.21.15.63:38464) 2023-12-01T15:59:40.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4b7fff700 1 -- 172.21.15.63:0/2972477961 learned_addr learned my addr 172.21.15.63:0/2972477961 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:40.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4b77fe700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4b80a0390 0x7fb4b8133eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4b6ffd700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4b80a1b20 0x7fb4b81343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4b7fff700 1 -- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4b80a0390 msgr2=0x7fb4b8133eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4b7fff700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4b80a0390 0x7fb4b8133eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4b7fff700 1 -- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4b80a1b20 msgr2=0x7fb4b81343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4b7fff700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4b80a1b20 0x7fb4b81343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4b7fff700 1 -- 172.21.15.63:0/2972477961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b000bd40 con 0x7fb4b81370e0 2023-12-01T15:59:40.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.792+0000 7fb4b7fff700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b81370e0 0x7fb4b81cad10 secure :-1 s=READY pgs=2921 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0016000 tx=0x7fb4b0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:40.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.796+0000 7fb49ffff700 1 -- 172.21.15.63:0/2972477961 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b000b220 con 0x7fb4b81370e0 2023-12-01T15:59:40.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.796+0000 7fb49ffff700 1 -- 172.21.15.63:0/2972477961 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b000b380 con 0x7fb4b81370e0 2023-12-01T15:59:40.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.796+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/2972477961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b806e0b0 con 0x7fb4b81370e0 2023-12-01T15:59:40.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.796+0000 7fb49ffff700 1 -- 172.21.15.63:0/2972477961 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b00218a0 con 0x7fb4b81370e0 2023-12-01T15:59:40.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.796+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/2972477961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b8071b60 con 0x7fb4b81370e0 2023-12-01T15:59:40.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.796+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/2972477961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b8065fb0 con 0x7fb4b81370e0 2023-12-01T15:59:40.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.796+0000 7fb49ffff700 1 -- 172.21.15.63:0/2972477961 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb4b0021a00 con 0x7fb4b81370e0 2023-12-01T15:59:40.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.796+0000 7fb49ffff700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4a4065ad0 0x7fb4a4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:40.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.796+0000 7fb49ffff700 1 -- 172.21.15.63:0/2972477961 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7fb4b0006e40 con 0x7fb4b81370e0 2023-12-01T15:59:40.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.796+0000 7fb4b77fe700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4a4065ad0 0x7fb4a4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:40.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.800+0000 7fb4b77fe700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4a4065ad0 0x7fb4a4067f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb4b809ed00 tx=0x7fb4ac009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:40.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.808+0000 7fb49ffff700 1 -- 172.21.15.63:0/2972477961 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb4b0054770 con 0x7fb4b81370e0 2023-12-01T15:59:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/2972477961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4b8061d90 con 0x7fb4b81370e0 2023-12-01T15:59:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb49ffff700 1 -- 172.21.15.63:0/2972477961 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4b0021cb0 con 0x7fb4b81370e0 2023-12-01T15:59:40.986 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-01T15:59:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4a4065ad0 msgr2=0x7fb4a4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb4bc9b0700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4a4065ad0 0x7fb4a4067f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb4b809ed00 tx=0x7fb4ac009240 comp rx=0 tx=0).stop 2023-12-01T15:59:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/2972477961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b81370e0 msgr2=0x7fb4b81cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb4bc9b0700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b81370e0 0x7fb4b81cad10 secure :-1 s=READY pgs=2921 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0016000 tx=0x7fb4b0004b40 comp rx=0 tx=0).stop 2023-12-01T15:59:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/2972477961 shutdown_connections 2023-12-01T15:59:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb4bc9b0700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb4a4065ad0 0x7fb4a4067f90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb4bc9b0700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b81370e0 0x7fb4b81cad10 unknown :-1 s=CLOSED pgs=2921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb4bc9b0700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4b80a1b20 0x7fb4b81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb4bc9b0700 1 --2- 172.21.15.63:0/2972477961 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4b80a0390 0x7fb4b8133eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.972+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/2972477961 >> 172.21.15.63:0/2972477961 conn(0x7fb4b80a8a70 msgr2=0x7fb4b81be8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.976+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/2972477961 shutdown_connections 2023-12-01T15:59:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:40.976+0000 7fb4bc9b0700 1 -- 172.21.15.63:0/2972477961 wait complete. 2023-12-01T15:59:41.001 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T15:59:41.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.104+0000 7f171759e700 1 Processor -- start 2023-12-01T15:59:41.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.104+0000 7f171759e700 1 -- start start 2023-12-01T15:59:41.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f17100c2b10 0x7f17100c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:41.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171001f310 con 0x7f17100c5440 2023-12-01T15:59:41.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171001e710 con 0x7f17100bc720 2023-12-01T15:59:41.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1710021970 con 0x7f17100c2b10 2023-12-01T15:59:41.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f1716d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f17100c5440 0x7f17100c7830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45172/0 (socket says 172.21.15.63:45172) 2023-12-01T15:59:41.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f1716d9d700 1 -- 172.21.15.63:0/3141420571 learned_addr learned my addr 172.21.15.63:0/3141420571 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:41.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f1715d9b700 1 --2- 172.21.15.63:0/3141420571 >> v2:172.21.15.66:3300/0 conn(0x7f17100c2b10 0x7f17100c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:41.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171559a700 1 -- 172.21.15.63:0/3141420571 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403385033 0 0) 0x7f171001f310 con 0x7f17100c5440 2023-12-01T15:59:41.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171559a700 1 -- 172.21.15.63:0/3141420571 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17040035d0 con 0x7f17100c5440 2023-12-01T15:59:41.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f1715d9b700 1 -- 172.21.15.63:0/3141420571 >> v1:172.21.15.66:6789/0 conn(0x7f17100bc720 legacy=0x7f17100bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171559a700 1 -- 172.21.15.63:0/3141420571 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730089690 0 0) 0x7f171001e710 con 0x7f17100bc720 2023-12-01T15:59:41.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f1715d9b700 1 -- 172.21.15.63:0/3141420571 >> v1:172.21.15.63:6789/0 conn(0x7f17100c5440 legacy=0x7f17100c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f1715d9b700 1 -- 172.21.15.63:0/3141420571 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171001e980 con 0x7f17100c2b10 2023-12-01T15:59:41.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f1715d9b700 1 --2- 172.21.15.63:0/3141420571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17100c2b10 0x7f17100c4f00 secure :-1 s=READY pgs=2930 cs=0 l=1 rev1=1 crypto rx=0x7f1708009850 tx=0x7f1708009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e16886a9a544b93 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:41.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171559a700 1 -- 172.21.15.63:0/3141420571 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708011830 con 0x7f17100c2b10 2023-12-01T15:59:41.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171559a700 1 -- 172.21.15.63:0/3141420571 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1708011990 con 0x7f17100c2b10 2023-12-01T15:59:41.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171559a700 1 -- 172.21.15.63:0/3141420571 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708011d00 con 0x7f17100c2b10 2023-12-01T15:59:41.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171759e700 1 -- 172.21.15.63:0/3141420571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17100c2b10 msgr2=0x7f17100c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171759e700 1 --2- 172.21.15.63:0/3141420571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17100c2b10 0x7f17100c4f00 secure :-1 s=READY pgs=2930 cs=0 l=1 rev1=1 crypto rx=0x7f1708009850 tx=0x7f1708009b60 comp rx=0 tx=0).stop 2023-12-01T15:59:41.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171759e700 1 -- 172.21.15.63:0/3141420571 shutdown_connections 2023-12-01T15:59:41.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171759e700 1 --2- 172.21.15.63:0/3141420571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17100c2b10 0x7f17100c4f00 unknown :-1 s=CLOSED pgs=2930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171759e700 1 -- 172.21.15.63:0/3141420571 >> 172.21.15.63:0/3141420571 conn(0x7f17100071d0 msgr2=0x7f17100220f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:41.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171759e700 1 -- 172.21.15.63:0/3141420571 shutdown_connections 2023-12-01T15:59:41.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.108+0000 7f171759e700 1 -- 172.21.15.63:0/3141420571 wait complete. 2023-12-01T15:59:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171759e700 1 Processor -- start 2023-12-01T15:59:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171759e700 1 -- start start 2023-12-01T15:59:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171759e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17100bc720 0x7f1710025580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17100c2b10 0x7f1710025ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:41.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17100c5440 0x7f1710026000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:41.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171759e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17100bd210 con 0x7f17100bc720 2023-12-01T15:59:41.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1710028700 con 0x7f17100c2b10 2023-12-01T15:59:41.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1710028980 con 0x7f17100c5440 2023-12-01T15:59:41.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17100bc720 0x7f1710025580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:41.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17100bc720 0x7f1710025580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38478/0 (socket says 172.21.15.63:38478) 2023-12-01T15:59:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171659c700 1 -- 172.21.15.63:0/3555626650 learned_addr learned my addr 172.21.15.63:0/3555626650 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f1715d9b700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17100c2b10 0x7f1710025ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f1716d9d700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17100c5440 0x7f1710026000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171659c700 1 -- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17100c5440 msgr2=0x7f1710026000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171659c700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17100c5440 0x7f1710026000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171659c700 1 -- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17100c2b10 msgr2=0x7f1710025ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171659c700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17100c2b10 0x7f1710025ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171659c700 1 -- 172.21.15.63:0/3555626650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17080094b0 con 0x7f17100bc720 2023-12-01T15:59:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f171659c700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17100bc720 0x7f1710025580 secure :-1 s=READY pgs=2923 cs=0 l=1 rev1=1 crypto rx=0x7f17000011e0 tx=0x7f170000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.112+0000 7f170effd700 1 -- 172.21.15.63:0/3555626650 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000054e0 con 0x7f17100bc720 2023-12-01T15:59:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.116+0000 7f171759e700 1 -- 172.21.15.63:0/3555626650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1710027550 con 0x7f17100bc720 2023-12-01T15:59:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.116+0000 7f170effd700 1 -- 172.21.15.63:0/3555626650 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17000036a0 con 0x7f17100bc720 2023-12-01T15:59:41.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.116+0000 7f170effd700 1 -- 172.21.15.63:0/3555626650 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700003a50 con 0x7f17100bc720 2023-12-01T15:59:41.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.116+0000 7f171759e700 1 -- 172.21.15.63:0/3555626650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171002a470 con 0x7f17100bc720 2023-12-01T15:59:41.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.116+0000 7f171759e700 1 -- 172.21.15.63:0/3555626650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1710029330 con 0x7f17100bc720 2023-12-01T15:59:41.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.116+0000 7f170effd700 1 -- 172.21.15.63:0/3555626650 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1700003bb0 con 0x7f17100bc720 2023-12-01T15:59:41.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.116+0000 7f170effd700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f16f8065b00 0x7f16f8067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:41.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.116+0000 7f170effd700 1 -- 172.21.15.63:0/3555626650 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f17000824c0 con 0x7f17100bc720 2023-12-01T15:59:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.116+0000 7f1715d9b700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f16f8065b00 0x7f16f8067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.120+0000 7f1715d9b700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f16f8065b00 0x7f16f8067fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17080090b0 tx=0x7f1708008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.120+0000 7f170effd700 1 -- 172.21.15.63:0/3555626650 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1700050410 con 0x7f17100bc720 2023-12-01T15:59:41.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.288+0000 7f171759e700 1 -- 172.21.15.63:0/3555626650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17100058c0 con 0x7f17100bc720 2023-12-01T15:59:41.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f170effd700 1 -- 172.21.15.63:0/3555626650 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17000170a0 con 0x7f17100bc720 2023-12-01T15:59:41.305 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-01T15:59:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 -- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f16f8065b00 msgr2=0x7f16f8067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f16f8065b00 0x7f16f8067fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17080090b0 tx=0x7f1708008030 comp rx=0 tx=0).stop 2023-12-01T15:59:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 -- 172.21.15.63:0/3555626650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17100bc720 msgr2=0x7f1710025580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17100bc720 0x7f1710025580 secure :-1 s=READY pgs=2923 cs=0 l=1 rev1=1 crypto rx=0x7f17000011e0 tx=0x7f170000ca30 comp rx=0 tx=0).stop 2023-12-01T15:59:41.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 -- 172.21.15.63:0/3555626650 shutdown_connections 2023-12-01T15:59:41.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f16f8065b00 0x7f16f8067fc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17100c5440 0x7f1710026000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17100c2b10 0x7f1710025ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 --2- 172.21.15.63:0/3555626650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17100bc720 0x7f1710025580 unknown :-1 s=CLOSED pgs=2923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 -- 172.21.15.63:0/3555626650 >> 172.21.15.63:0/3555626650 conn(0x7f17100071d0 msgr2=0x7f17100bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:41.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 -- 172.21.15.63:0/3555626650 shutdown_connections 2023-12-01T15:59:41.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.292+0000 7f171759e700 1 -- 172.21.15.63:0/3555626650 wait complete. 2023-12-01T15:59:41.320 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-01T15:59:41.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6ca539700 1 Processor -- start 2023-12-01T15:59:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6ca539700 1 -- start start 2023-12-01T15:59:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6ca539700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6c4138bb0 0x7fa6c406f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6ca539700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6c4099170 0x7fa6c4140870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6ca539700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c40a4700 con 0x7fa6c4138f90 2023-12-01T15:59:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6ca539700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c40a4930 con 0x7fa6c4099170 2023-12-01T15:59:41.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6ca539700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c406fbe0 con 0x7fa6c4138bb0 2023-12-01T15:59:41.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6c9d38700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6c4099170 0x7fa6c4140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:41.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6c9537700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6c4138bb0 0x7fa6c406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:41.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6c8d36700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa6c4138f90 0x7fa6c4098a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:44296/0 (socket says 172.21.15.63:44296) 2023-12-01T15:59:41.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6c8d36700 1 -- 172.21.15.63:0/1029173039 learned_addr learned my addr 172.21.15.63:0/1029173039 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:41.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6c9537700 1 -- 172.21.15.63:0/1029173039 >> v2:172.21.15.66:3300/0 conn(0x7fa6c4099170 msgr2=0x7fa6c4140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:41.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6c9537700 1 --2- 172.21.15.63:0/1029173039 >> v2:172.21.15.66:3300/0 conn(0x7fa6c4099170 0x7fa6c4140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6c9537700 1 -- 172.21.15.63:0/1029173039 >> v1:172.21.15.66:6789/0 conn(0x7fa6c4138f90 legacy=0x7fa6c4098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6c9537700 1 -- 172.21.15.63:0/1029173039 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c4099f20 con 0x7fa6c4138bb0 2023-12-01T15:59:41.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6c9537700 1 --2- 172.21.15.63:0/1029173039 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6c4138bb0 0x7fa6c406f550 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009850 tx=0x7fa6c0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f13301e4d32d26 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:41.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6bbfff700 1 -- 172.21.15.63:0/1029173039 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0011830 con 0x7fa6c4138bb0 2023-12-01T15:59:41.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6bbfff700 1 -- 172.21.15.63:0/1029173039 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c0011990 con 0x7fa6c4138bb0 2023-12-01T15:59:41.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.424+0000 7fa6bbfff700 1 -- 172.21.15.63:0/1029173039 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0011d40 con 0x7fa6c4138bb0 2023-12-01T15:59:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 -- 172.21.15.63:0/1029173039 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6c4138bb0 msgr2=0x7fa6c406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 --2- 172.21.15.63:0/1029173039 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6c4138bb0 0x7fa6c406f550 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009850 tx=0x7fa6c0009b60 comp rx=0 tx=0).stop 2023-12-01T15:59:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 -- 172.21.15.63:0/1029173039 shutdown_connections 2023-12-01T15:59:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 --2- 172.21.15.63:0/1029173039 >> v2:172.21.15.66:3300/0 conn(0x7fa6c4099170 0x7fa6c4140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 --2- 172.21.15.63:0/1029173039 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6c4138bb0 0x7fa6c406f550 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 -- 172.21.15.63:0/1029173039 >> 172.21.15.63:0/1029173039 conn(0x7fa6c40a5cc0 msgr2=0x7fa6c40a60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 -- 172.21.15.63:0/1029173039 shutdown_connections 2023-12-01T15:59:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 -- 172.21.15.63:0/1029173039 wait complete. 2023-12-01T15:59:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 Processor -- start 2023-12-01T15:59:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 -- start start 2023-12-01T15:59:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6c4099170 0x7fa6c41c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6c4138bb0 0x7fa6c41ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6c4138f90 0x7fa6c41ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c40a1e10 con 0x7fa6c4138bb0 2023-12-01T15:59:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c41c99a0 con 0x7fa6c4099170 2023-12-01T15:59:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6ca539700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c40a17b0 con 0x7fa6c4138f90 2023-12-01T15:59:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6c8d36700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6c4138bb0 0x7fa6c41ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6c8d36700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6c4138bb0 0x7fa6c41ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38494/0 (socket says 172.21.15.63:38494) 2023-12-01T15:59:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6c8d36700 1 -- 172.21.15.63:0/3740019342 learned_addr learned my addr 172.21.15.63:0/3740019342 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6c9537700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6c4099170 0x7fa6c41c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6c9d38700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6c4138f90 0x7fa6c41ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6c8d36700 1 -- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6c4138f90 msgr2=0x7fa6c41ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6c8d36700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6c4138f90 0x7fa6c41ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6c8d36700 1 -- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6c4099170 msgr2=0x7fa6c41c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6c8d36700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6c4099170 0x7fa6c41c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6c8d36700 1 -- 172.21.15.63:0/3740019342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c00094b0 con 0x7fa6c4138bb0 2023-12-01T15:59:41.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.428+0000 7fa6c8d36700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6c4138bb0 0x7fa6c41ca0d0 secure :-1 s=READY pgs=2924 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4001eb0 tx=0x7fa6b400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:41.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.432+0000 7fa6b9ffb700 1 -- 172.21.15.63:0/3740019342 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4005d90 con 0x7fa6c4138bb0 2023-12-01T15:59:41.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.432+0000 7fa6b9ffb700 1 -- 172.21.15.63:0/3740019342 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b40070d0 con 0x7fa6c4138bb0 2023-12-01T15:59:41.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.432+0000 7fa6ca539700 1 -- 172.21.15.63:0/3740019342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c40a0b20 con 0x7fa6c4138bb0 2023-12-01T15:59:41.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.432+0000 7fa6b9ffb700 1 -- 172.21.15.63:0/3740019342 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4007440 con 0x7fa6c4138bb0 2023-12-01T15:59:41.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.432+0000 7fa6ca539700 1 -- 172.21.15.63:0/3740019342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c40a2940 con 0x7fa6c4138bb0 2023-12-01T15:59:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.432+0000 7fa6ca539700 1 -- 172.21.15.63:0/3740019342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c4065fb0 con 0x7fa6c4138bb0 2023-12-01T15:59:41.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.432+0000 7fa6b9ffb700 1 -- 172.21.15.63:0/3740019342 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa6b40075a0 con 0x7fa6c4138bb0 2023-12-01T15:59:41.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.432+0000 7fa6b9ffb700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6a8065ad0 0x7fa6a8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:41.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.432+0000 7fa6b9ffb700 1 -- 172.21.15.63:0/3740019342 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7fa6b4081f70 con 0x7fa6c4138bb0 2023-12-01T15:59:41.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.432+0000 7fa6c9537700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6a8065ad0 0x7fa6a8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:41.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.436+0000 7fa6c9537700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6a8065ad0 0x7fa6a8067f90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00090b0 tx=0x7fa6c0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:41.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.440+0000 7fa6b9ffb700 1 -- 172.21.15.63:0/3740019342 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa6b404fed0 con 0x7fa6c4138bb0 2023-12-01T15:59:41.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.620+0000 7fa6ca539700 1 -- 172.21.15.63:0/3740019342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa6c411ff10 con 0x7fa6c4138bb0 2023-12-01T15:59:41.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.620+0000 7fa6b9ffb700 1 -- 172.21.15.63:0/3740019342 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa6b4017080 con 0x7fa6c4138bb0 2023-12-01T15:59:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.620+0000 7fa6ca539700 1 -- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6a8065ad0 msgr2=0x7fa6a8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.620+0000 7fa6ca539700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6a8065ad0 0x7fa6a8067f90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00090b0 tx=0x7fa6c0008030 comp rx=0 tx=0).stop 2023-12-01T15:59:41.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.620+0000 7fa6ca539700 1 -- 172.21.15.63:0/3740019342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6c4138bb0 msgr2=0x7fa6c41ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:41.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.620+0000 7fa6ca539700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6c4138bb0 0x7fa6c41ca0d0 secure :-1 s=READY pgs=2924 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4001eb0 tx=0x7fa6b400c7b0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.624+0000 7fa6ca539700 1 -- 172.21.15.63:0/3740019342 shutdown_connections 2023-12-01T15:59:41.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.624+0000 7fa6ca539700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fa6a8065ad0 0x7fa6a8067f90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.624+0000 7fa6ca539700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6c4138f90 0x7fa6c41ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.624+0000 7fa6ca539700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6c4138bb0 0x7fa6c41ca0d0 unknown :-1 s=CLOSED pgs=2924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.624+0000 7fa6ca539700 1 --2- 172.21.15.63:0/3740019342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6c4099170 0x7fa6c41c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:41.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.624+0000 7fa6ca539700 1 -- 172.21.15.63:0/3740019342 >> 172.21.15.63:0/3740019342 conn(0x7fa6c40a5cc0 msgr2=0x7fa6c406ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:41.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.624+0000 7fa6ca539700 1 -- 172.21.15.63:0/3740019342 shutdown_connections 2023-12-01T15:59:41.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:41.624+0000 7fa6ca539700 1 -- 172.21.15.63:0/3740019342 wait complete. 2023-12-01T15:59:41.639 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2023-12-01T15:59:41.650 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-12-01T15:59:41.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:59:41.650 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-01T15:59:41.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[27328]: fuse finished with error 0 and tester_r 0 2023-12-01T15:59:41.687 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T15:59:41.730 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-12-01T15:59:41.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:59:41.731 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-01T15:59:41.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:59:41.747 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-12-01T15:59:41.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-01T15:59:41.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:59:41.754 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T15:59:41.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T15:59:41.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-12-01T15:59:41.899 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-01T15:59:41.909 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-01T15:59:41.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T15:59:42.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.016+0000 7f62e6099700 1 Processor -- start 2023-12-01T15:59:42.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.016+0000 7f62e6099700 1 -- start start 2023-12-01T15:59:42.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62e0137270 0x7f62e0137650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f62e00a2fe0 0x7f62e00a3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e009f4a0 con 0x7f62e00a3970 2023-12-01T15:59:42.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e0099bc0 con 0x7f62e0137270 2023-12-01T15:59:42.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00a0270 con 0x7f62e00a2fe0 2023-12-01T15:59:42.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62deffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f62e00a2fe0 0x7f62e00a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62df7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f62e0137270 0x7f62e0137650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62deffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f62e00a2fe0 0x7f62e00a3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:38626/0 (socket says 172.21.15.63:38626) 2023-12-01T15:59:42.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62dffff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f62e00a3970 0x7f62e013e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:44300/0 (socket says 172.21.15.63:44300) 2023-12-01T15:59:42.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62deffd700 1 -- 172.21.15.63:0/3257457872 learned_addr learned my addr 172.21.15.63:0/3257457872 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:42.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62deffd700 1 -- 172.21.15.63:0/3257457872 >> v2:172.21.15.63:3300/0 conn(0x7f62e0137270 msgr2=0x7f62e0137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:42.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62deffd700 1 --2- 172.21.15.63:0/3257457872 >> v2:172.21.15.63:3300/0 conn(0x7f62e0137270 0x7f62e0137650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62deffd700 1 -- 172.21.15.63:0/3257457872 >> v1:172.21.15.66:6789/0 conn(0x7f62e00a3970 legacy=0x7f62e013e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62deffd700 1 -- 172.21.15.63:0/3257457872 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e009fbf0 con 0x7f62e00a2fe0 2023-12-01T15:59:42.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62deffd700 1 --2- 172.21.15.63:0/3257457872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e00a2fe0 0x7f62e00a3430 secure :-1 s=READY pgs=2933 cs=0 l=1 rev1=1 crypto rx=0x7f62e006bae0 tx=0x7f62d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53c964e6c6dabc51 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:42.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62de7fc700 1 -- 172.21.15.63:0/3257457872 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d000b910 con 0x7f62e00a2fe0 2023-12-01T15:59:42.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62de7fc700 1 -- 172.21.15.63:0/3257457872 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d000ba70 con 0x7f62e00a2fe0 2023-12-01T15:59:42.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62de7fc700 1 -- 172.21.15.63:0/3257457872 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d000be20 con 0x7f62e00a2fe0 2023-12-01T15:59:42.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 -- 172.21.15.63:0/3257457872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e00a2fe0 msgr2=0x7f62e00a3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 --2- 172.21.15.63:0/3257457872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e00a2fe0 0x7f62e00a3430 secure :-1 s=READY pgs=2933 cs=0 l=1 rev1=1 crypto rx=0x7f62e006bae0 tx=0x7f62d000b330 comp rx=0 tx=0).stop 2023-12-01T15:59:42.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 -- 172.21.15.63:0/3257457872 shutdown_connections 2023-12-01T15:59:42.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 --2- 172.21.15.63:0/3257457872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e00a2fe0 0x7f62e00a3430 unknown :-1 s=CLOSED pgs=2933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 --2- 172.21.15.63:0/3257457872 >> v2:172.21.15.63:3300/0 conn(0x7f62e0137270 0x7f62e0137650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 -- 172.21.15.63:0/3257457872 >> 172.21.15.63:0/3257457872 conn(0x7f62e00738c0 msgr2=0x7f62e00a8660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:42.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 -- 172.21.15.63:0/3257457872 shutdown_connections 2023-12-01T15:59:42.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 -- 172.21.15.63:0/3257457872 wait complete. 2023-12-01T15:59:42.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 Processor -- start 2023-12-01T15:59:42.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.020+0000 7f62e6099700 1 -- start start 2023-12-01T15:59:42.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62e6099700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f62e00a2fe0 0x7f62e0135f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62e6099700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e00a3970 0x7f62e0136450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62e6099700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62e0137270 0x7f62e009c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62e6099700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e009dc00 con 0x7f62e0137270 2023-12-01T15:59:42.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62e6099700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e011f6a0 con 0x7f62e00a3970 2023-12-01T15:59:42.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62e6099700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e011f1b0 con 0x7f62e00a2fe0 2023-12-01T15:59:42.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62dffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62e0137270 0x7f62e009c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62deffd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e00a3970 0x7f62e0136450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62df7fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f62e00a2fe0 0x7f62e0135f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62deffd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e00a3970 0x7f62e0136450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:38642/0 (socket says 172.21.15.63:38642) 2023-12-01T15:59:42.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62dffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62e0137270 0x7f62e009c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38522/0 (socket says 172.21.15.63:38522) 2023-12-01T15:59:42.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62deffd700 1 -- 172.21.15.63:0/1283440955 learned_addr learned my addr 172.21.15.63:0/1283440955 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:42.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62deffd700 1 -- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f62e00a2fe0 msgr2=0x7f62e0135f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62deffd700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f62e00a2fe0 0x7f62e0135f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62deffd700 1 -- 172.21.15.63:0/1283440955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62e0137270 msgr2=0x7f62e009c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62deffd700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62e0137270 0x7f62e009c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62deffd700 1 -- 172.21.15.63:0/1283440955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d0009b30 con 0x7f62e00a3970 2023-12-01T15:59:42.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62deffd700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e00a3970 0x7f62e0136450 secure :-1 s=READY pgs=2934 cs=0 l=1 rev1=1 crypto rx=0x7f62d000bfd0 tx=0x7f62d0004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:42.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62d7fff700 1 -- 172.21.15.63:0/1283440955 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d000b910 con 0x7f62e00a3970 2023-12-01T15:59:42.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62d7fff700 1 -- 172.21.15.63:0/1283440955 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d0004690 con 0x7f62e00a3970 2023-12-01T15:59:42.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62e6099700 1 -- 172.21.15.63:0/1283440955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e011fd90 con 0x7f62e00a3970 2023-12-01T15:59:42.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62d7fff700 1 -- 172.21.15.63:0/1283440955 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d00092e0 con 0x7f62e00a3970 2023-12-01T15:59:42.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62e6099700 1 -- 172.21.15.63:0/1283440955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e0136990 con 0x7f62e00a3970 2023-12-01T15:59:42.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.024+0000 7f62e6099700 1 -- 172.21.15.63:0/1283440955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e0065fb0 con 0x7f62e00a3970 2023-12-01T15:59:42.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.028+0000 7f62d7fff700 1 -- 172.21.15.63:0/1283440955 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f62d001a420 con 0x7f62e00a3970 2023-12-01T15:59:42.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.028+0000 7f62d7fff700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f62c0065b00 0x7f62c0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.028+0000 7f62d7fff700 1 -- 172.21.15.63:0/1283440955 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f62d0083ef0 con 0x7f62e00a3970 2023-12-01T15:59:42.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.028+0000 7f62df7fe700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f62c0065b00 0x7f62c0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.028+0000 7f62df7fe700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f62c0065b00 0x7f62c0067fc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009bf0 tx=0x7f62c8009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:42.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.036+0000 7f62d7fff700 1 -- 172.21.15.63:0/1283440955 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f62d00559f0 con 0x7f62e00a3970 2023-12-01T15:59:42.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.200+0000 7f62e6099700 1 -- 172.21.15.63:0/1283440955 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62e00a3e20 con 0x7f62c0065b00 2023-12-01T15:59:42.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.220+0000 7f62d7fff700 1 -- 172.21.15.63:0/1283440955 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281340 (secure 0 0 0) 0x7f62c80118c0 con 0x7f62c0065b00 2023-12-01T15:59:42.237 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:59:42.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 -- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f62c0065b00 msgr2=0x7f62c0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f62c0065b00 0x7f62c0067fc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009bf0 tx=0x7f62c8009240 comp rx=0 tx=0).stop 2023-12-01T15:59:42.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 -- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e00a3970 msgr2=0x7f62e0136450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e00a3970 0x7f62e0136450 secure :-1 s=READY pgs=2934 cs=0 l=1 rev1=1 crypto rx=0x7f62d000bfd0 tx=0x7f62d0004af0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 -- 172.21.15.63:0/1283440955 shutdown_connections 2023-12-01T15:59:42.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f62c0065b00 0x7f62c0067fc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62e0137270 0x7f62e009c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62e00a3970 0x7f62e0136450 unknown :-1 s=CLOSED pgs=2934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 --2- 172.21.15.63:0/1283440955 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f62e00a2fe0 0x7f62e0135f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 -- 172.21.15.63:0/1283440955 >> 172.21.15.63:0/1283440955 conn(0x7f62e00738c0 msgr2=0x7f62e00a50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:42.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 -- 172.21.15.63:0/1283440955 shutdown_connections 2023-12-01T15:59:42.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.224+0000 7f62e6099700 1 -- 172.21.15.63:0/1283440955 wait complete. 2023-12-01T15:59:42.241 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T15:59:42.253 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2023-12-01T15:59:40.700118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":278585011,"num_objects":242,"num_object_clones":28,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":15,"num_read":370,"num_read_kb":3540,"num_write":153128,"num_write_kb":684151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301968,"ondisk_log_size":301968,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":2888400,"kb_used_data":546160,"kb_used_omap":0,"kb_used_meta":2342208,"kb_avail":374598960,"statfs":{"total":386547056640,"available":383589335040,"internally_reserved":0,"allocated":559267840,"data_stored":557876206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2398420992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1935099,"num_objects":7,"num_object_clones":3,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":3,"num_read":6,"num_read_kb":7,"num_write":126,"num_write_kb":1962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003615"},"pg_stats":[{"pgid":"4.3f","version":"43'3303","reported_seq":2796,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.134377+0000","last_change":"2023-12-01T15:59:36.960583+0000","last_active":"2023-12-01T15:59:37.134377+0000","last_peered":"2023-12-01T15:59:37.134377+0000","last_clean":"2023-12-01T15:59:37.134377+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:59:37.134377+0000","last_undegraded":"2023-12-01T15:59:37.134377+0000","last_fullsized":"2023-12-01T15:59:37.134377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13670799,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3e","version":"43'3496","reported_seq":2953,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.094520+0000","last_change":"2023-12-01T15:59:36.899161+0000","last_active":"2023-12-01T15:59:37.094520+0000","last_peered":"2023-12-01T15:59:37.094520+0000","last_clean":"2023-12-01T15:59:37.094520+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T15:59:37.094520+0000","last_undegraded":"2023-12-01T15:59:37.094520+0000","last_fullsized":"2023-12-01T15:59:37.094520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.085048589999999993,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3d","version":"43'3434","reported_seq":2894,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181268+0000","last_change":"2023-12-01T15:59:36.980200+0000","last_active":"2023-12-01T15:59:37.181268+0000","last_peered":"2023-12-01T15:59:37.181268+0000","last_clean":"2023-12-01T15:59:37.181268+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:59:37.181268+0000","last_undegraded":"2023-12-01T15:59:37.181268+0000","last_fullsized":"2023-12-01T15:59:37.181268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:52:46.242732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15483981599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3c","version":"43'3687","reported_seq":3037,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.088442+0000","last_change":"2023-12-01T15:59:36.901834+0000","last_active":"2023-12-01T15:59:37.088442+0000","last_peered":"2023-12-01T15:59:37.088442+0000","last_clean":"2023-12-01T15:59:37.088442+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:59:37.088442+0000","last_undegraded":"2023-12-01T15:59:37.088442+0000","last_fullsized":"2023-12-01T15:59:37.088442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3687,"log_dups_size":0,"ondisk_log_size":3687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086572531999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3b","version":"43'3485","reported_seq":2915,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.097685+0000","last_change":"2023-12-01T15:59:36.962909+0000","last_active":"2023-12-01T15:59:37.097685+0000","last_peered":"2023-12-01T15:59:37.097685+0000","last_clean":"2023-12-01T15:59:37.097685+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T15:59:37.097685+0000","last_undegraded":"2023-12-01T15:59:37.097685+0000","last_fullsized":"2023-12-01T15:59:37.097685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13014335599999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3a","version":"43'3419","reported_seq":2858,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.179968+0000","last_change":"2023-12-01T15:59:36.980233+0000","last_active":"2023-12-01T15:59:37.179968+0000","last_peered":"2023-12-01T15:59:37.179968+0000","last_clean":"2023-12-01T15:59:37.179968+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T15:59:37.179968+0000","last_undegraded":"2023-12-01T15:59:37.179968+0000","last_fullsized":"2023-12-01T15:59:37.179968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.133828119,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.39","version":"43'3764","reported_seq":3216,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.089165+0000","last_change":"2023-12-01T15:59:36.977002+0000","last_active":"2023-12-01T15:59:37.089165+0000","last_peered":"2023-12-01T15:59:37.089165+0000","last_clean":"2023-12-01T15:59:37.089165+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T15:59:37.089165+0000","last_undegraded":"2023-12-01T15:59:37.089165+0000","last_fullsized":"2023-12-01T15:59:37.089165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3764,"log_dups_size":0,"ondisk_log_size":3764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16251290900000001,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.38","version":"43'3433","reported_seq":2835,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.154788+0000","last_change":"2023-12-01T15:59:36.975843+0000","last_active":"2023-12-01T15:59:37.154788+0000","last_peered":"2023-12-01T15:59:37.154788+0000","last_clean":"2023-12-01T15:59:37.154788+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:59:37.154788+0000","last_undegraded":"2023-12-01T15:59:37.154788+0000","last_fullsized":"2023-12-01T15:59:37.154788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3433,"log_dups_size":0,"ondisk_log_size":3433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:31:59.832465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.173046373,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.37","version":"43'3524","reported_seq":2940,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.134223+0000","last_change":"2023-12-01T15:59:36.960250+0000","last_active":"2023-12-01T15:59:37.134223+0000","last_peered":"2023-12-01T15:59:37.134223+0000","last_clean":"2023-12-01T15:59:37.134223+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:59:37.134223+0000","last_undegraded":"2023-12-01T15:59:37.134223+0000","last_fullsized":"2023-12-01T15:59:37.134223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13648046599999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.36","version":"43'3320","reported_seq":2807,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.116703+0000","last_change":"2023-12-01T15:59:36.978454+0000","last_active":"2023-12-01T15:59:37.116703+0000","last_peered":"2023-12-01T15:59:37.116703+0000","last_clean":"2023-12-01T15:59:37.116703+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:59:37.116703+0000","last_undegraded":"2023-12-01T15:59:37.116703+0000","last_fullsized":"2023-12-01T15:59:37.116703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:00:15.540017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.160523057,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.35","version":"43'3407","reported_seq":2866,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.128890+0000","last_change":"2023-12-01T15:59:36.894457+0000","last_active":"2023-12-01T15:59:37.128890+0000","last_peered":"2023-12-01T15:59:37.128890+0000","last_clean":"2023-12-01T15:59:37.128890+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:59:37.128890+0000","last_undegraded":"2023-12-01T15:59:37.128890+0000","last_fullsized":"2023-12-01T15:59:37.128890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3407,"log_dups_size":0,"ondisk_log_size":3407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.080275320999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.34","version":"43'3529","reported_seq":2900,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.462843+0000","last_change":"2023-12-01T15:59:37.474340+0000","last_active":"2023-12-01T15:59:37.462843+0000","last_peered":"2023-12-01T15:59:37.462843+0000","last_clean":"2023-12-01T15:59:37.462843+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T15:59:37.462843+0000","last_undegraded":"2023-12-01T15:59:37.462843+0000","last_fullsized":"2023-12-01T15:59:37.462843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63957533600000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.33","version":"43'3178","reported_seq":2647,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.098108+0000","last_change":"2023-12-01T15:59:36.959529+0000","last_active":"2023-12-01T15:59:37.098108+0000","last_peered":"2023-12-01T15:59:37.098108+0000","last_clean":"2023-12-01T15:59:37.098108+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T15:59:37.098108+0000","last_undegraded":"2023-12-01T15:59:37.098108+0000","last_fullsized":"2023-12-01T15:59:37.098108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3178,"log_dups_size":0,"ondisk_log_size":3178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138334033,"stat_sum":{"num_bytes":12297,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.32","version":"43'3508","reported_seq":2930,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.113502+0000","last_change":"2023-12-01T15:59:36.908392+0000","last_active":"2023-12-01T15:59:37.113502+0000","last_peered":"2023-12-01T15:59:37.113502+0000","last_clean":"2023-12-01T15:59:37.113502+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T15:59:37.113502+0000","last_undegraded":"2023-12-01T15:59:37.113502+0000","last_fullsized":"2023-12-01T15:59:37.113502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.091404182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.31","version":"43'3600","reported_seq":3005,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.128107+0000","last_change":"2023-12-01T15:59:36.901530+0000","last_active":"2023-12-01T15:59:37.128107+0000","last_peered":"2023-12-01T15:59:37.128107+0000","last_clean":"2023-12-01T15:59:37.128107+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:37.128107+0000","last_undegraded":"2023-12-01T15:59:37.128107+0000","last_fullsized":"2023-12-01T15:59:37.128107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086861997999999996,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1247,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.30","version":"43'3533","reported_seq":2940,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.132837+0000","last_change":"2023-12-01T15:59:36.976205+0000","last_active":"2023-12-01T15:59:37.132837+0000","last_peered":"2023-12-01T15:59:37.132837+0000","last_clean":"2023-12-01T15:59:37.132837+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T15:59:37.132837+0000","last_undegraded":"2023-12-01T15:59:37.132837+0000","last_fullsized":"2023-12-01T15:59:37.132837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3533,"log_dups_size":0,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:23.641161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17327173600000001,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2f","version":"43'3588","reported_seq":2962,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.134083+0000","last_change":"2023-12-01T15:59:36.959847+0000","last_active":"2023-12-01T15:59:37.134083+0000","last_peered":"2023-12-01T15:59:37.134083+0000","last_clean":"2023-12-01T15:59:37.134083+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T15:59:37.134083+0000","last_undegraded":"2023-12-01T15:59:37.134083+0000","last_fullsized":"2023-12-01T15:59:37.134083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13630616600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2e","version":"43'3282","reported_seq":2782,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.131272+0000","last_change":"2023-12-01T15:59:36.977461+0000","last_active":"2023-12-01T15:59:37.131272+0000","last_peered":"2023-12-01T15:59:37.131272+0000","last_clean":"2023-12-01T15:59:37.131272+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T15:59:37.131272+0000","last_undegraded":"2023-12-01T15:59:37.131272+0000","last_fullsized":"2023-12-01T15:59:37.131272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:46:31.135544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.159652814,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1044,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2d","version":"43'3337","reported_seq":2775,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.127501+0000","last_change":"2023-12-01T15:59:36.954938+0000","last_active":"2023-12-01T15:59:37.127501+0000","last_peered":"2023-12-01T15:59:37.127501+0000","last_clean":"2023-12-01T15:59:37.127501+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T15:59:37.127501+0000","last_undegraded":"2023-12-01T15:59:37.127501+0000","last_fullsized":"2023-12-01T15:59:37.127501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134439324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2c","version":"43'3655","reported_seq":3089,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.095700+0000","last_change":"2023-12-01T15:59:36.963898+0000","last_active":"2023-12-01T15:59:37.095700+0000","last_peered":"2023-12-01T15:59:37.095700+0000","last_clean":"2023-12-01T15:59:37.095700+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:59:37.095700+0000","last_undegraded":"2023-12-01T15:59:37.095700+0000","last_fullsized":"2023-12-01T15:59:37.095700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3655,"log_dups_size":0,"ondisk_log_size":3655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:50.215328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16502647100000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2b","version":"43'3592","reported_seq":3027,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.148002+0000","last_change":"2023-12-01T15:59:36.908706+0000","last_active":"2023-12-01T15:59:37.148002+0000","last_peered":"2023-12-01T15:59:37.148002+0000","last_clean":"2023-12-01T15:59:37.148002+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T15:59:37.148002+0000","last_undegraded":"2023-12-01T15:59:37.148002+0000","last_fullsized":"2023-12-01T15:59:37.148002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.082049368999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2a","version":"43'3494","reported_seq":2865,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.072178+0000","last_change":"2023-12-01T15:59:36.954854+0000","last_active":"2023-12-01T15:59:37.072178+0000","last_peered":"2023-12-01T15:59:37.072178+0000","last_clean":"2023-12-01T15:59:37.072178+0000","last_became_active":"2023-12-01T15:44:30.528283+0000","last_became_peered":"2023-12-01T15:44:30.528283+0000","last_unstale":"2023-12-01T15:59:37.072178+0000","last_undegraded":"2023-12-01T15:59:37.072178+0000","last_fullsized":"2023-12-01T15:59:37.072178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3494,"log_dups_size":0,"ondisk_log_size":3494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:49:07.227935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13495370100000001,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.29","version":"43'3466","reported_seq":2921,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.421995+0000","last_change":"2023-12-01T15:59:37.440864+0000","last_active":"2023-12-01T15:59:37.421995+0000","last_peered":"2023-12-01T15:59:37.421995+0000","last_clean":"2023-12-01T15:59:37.421995+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T15:59:37.421995+0000","last_undegraded":"2023-12-01T15:59:37.421995+0000","last_fullsized":"2023-12-01T15:59:37.421995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3466,"log_dups_size":0,"ondisk_log_size":3466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.62816057700000005,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.28","version":"43'3577","reported_seq":2946,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.126385+0000","last_change":"2023-12-01T15:59:36.976374+0000","last_active":"2023-12-01T15:59:37.126385+0000","last_peered":"2023-12-01T15:59:37.126385+0000","last_clean":"2023-12-01T15:59:37.126385+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:59:37.126385+0000","last_undegraded":"2023-12-01T15:59:37.126385+0000","last_fullsized":"2023-12-01T15:59:37.126385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:16:11.702379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17330785400000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.27","version":"43'3344","reported_seq":2820,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.440997+0000","last_change":"2023-12-01T15:59:37.452527+0000","last_active":"2023-12-01T15:59:37.440997+0000","last_peered":"2023-12-01T15:59:37.440997+0000","last_clean":"2023-12-01T15:59:37.440997+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T15:59:37.440997+0000","last_undegraded":"2023-12-01T15:59:37.440997+0000","last_fullsized":"2023-12-01T15:59:37.440997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63729295699999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.26","version":"43'3411","reported_seq":2861,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.414457+0000","last_change":"2023-12-01T15:59:37.421961+0000","last_active":"2023-12-01T15:59:37.414457+0000","last_peered":"2023-12-01T15:59:37.414457+0000","last_clean":"2023-12-01T15:59:37.414457+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T15:59:37.414457+0000","last_undegraded":"2023-12-01T15:59:37.414457+0000","last_fullsized":"2023-12-01T15:59:37.414457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3411,"log_dups_size":0,"ondisk_log_size":3411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.611917673,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.25","version":"43'3312","reported_seq":2736,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.180983+0000","last_change":"2023-12-01T15:59:36.980913+0000","last_active":"2023-12-01T15:59:37.180983+0000","last_peered":"2023-12-01T15:59:37.180983+0000","last_clean":"2023-12-01T15:59:37.180983+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T15:59:37.180983+0000","last_undegraded":"2023-12-01T15:59:37.180983+0000","last_fullsized":"2023-12-01T15:59:37.180983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:34:06.793940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.146734475,"stat_sum":{"num_bytes":4116,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.24","version":"43'3312","reported_seq":2770,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.481996+0000","last_change":"2023-12-01T15:59:37.489547+0000","last_active":"2023-12-01T15:59:37.481996+0000","last_peered":"2023-12-01T15:59:37.481996+0000","last_clean":"2023-12-01T15:59:37.481996+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T15:59:37.481996+0000","last_undegraded":"2023-12-01T15:59:37.481996+0000","last_fullsized":"2023-12-01T15:59:37.481996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65414528699999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.23","version":"43'3662","reported_seq":3036,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.146827+0000","last_change":"2023-12-01T15:59:36.959770+0000","last_active":"2023-12-01T15:59:37.146827+0000","last_peered":"2023-12-01T15:59:37.146827+0000","last_clean":"2023-12-01T15:59:37.146827+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T15:59:37.146827+0000","last_undegraded":"2023-12-01T15:59:37.146827+0000","last_fullsized":"2023-12-01T15:59:37.146827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13835824199999999,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.22","version":"43'3520","reported_seq":2989,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181386+0000","last_change":"2023-12-01T15:59:36.981606+0000","last_active":"2023-12-01T15:59:37.181386+0000","last_peered":"2023-12-01T15:59:37.181386+0000","last_clean":"2023-12-01T15:59:37.181386+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:59:37.181386+0000","last_undegraded":"2023-12-01T15:59:37.181386+0000","last_fullsized":"2023-12-01T15:59:37.181386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3520,"log_dups_size":0,"ondisk_log_size":3520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13490588100000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.21","version":"43'3994","reported_seq":3317,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.460079+0000","last_change":"2023-12-01T15:59:37.471324+0000","last_active":"2023-12-01T15:59:37.460079+0000","last_peered":"2023-12-01T15:59:37.460079+0000","last_clean":"2023-12-01T15:59:37.460079+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T15:59:37.460079+0000","last_undegraded":"2023-12-01T15:59:37.460079+0000","last_fullsized":"2023-12-01T15:59:37.460079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3994,"log_dups_size":0,"ondisk_log_size":3994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65412195699999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.20","version":"43'3592","reported_seq":2992,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.179485+0000","last_change":"2023-12-01T15:59:36.911013+0000","last_active":"2023-12-01T15:59:37.179485+0000","last_peered":"2023-12-01T15:59:37.179485+0000","last_clean":"2023-12-01T15:59:37.179485+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T15:59:37.179485+0000","last_undegraded":"2023-12-01T15:59:37.179485+0000","last_fullsized":"2023-12-01T15:59:37.179485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090414480000000005,"stat_sum":{"num_bytes":4118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.14","version":"43'3661","reported_seq":3059,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.474372+0000","last_change":"2023-12-01T15:59:37.481885+0000","last_active":"2023-12-01T15:59:37.474372+0000","last_peered":"2023-12-01T15:59:37.474372+0000","last_clean":"2023-12-01T15:59:37.474372+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:59:37.474372+0000","last_undegraded":"2023-12-01T15:59:37.474372+0000","last_fullsized":"2023-12-01T15:59:37.474372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3661,"log_dups_size":0,"ondisk_log_size":3661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.646838511,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.13","version":"39'2734","reported_seq":2775,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.532051+0000","last_change":"2023-12-01T15:43:45.205685+0000","last_active":"2023-12-01T15:59:28.532051+0000","last_peered":"2023-12-01T15:59:28.532051+0000","last_clean":"2023-12-01T15:59:28.532051+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T15:59:28.532051+0000","last_undegraded":"2023-12-01T15:59:28.532051+0000","last_fullsized":"2023-12-01T15:59:28.532051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2734,"log_dups_size":0,"ondisk_log_size":2734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2729,"num_write_kb":18350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"43'3426","reported_seq":2842,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.174019+0000","last_change":"2023-12-01T15:59:36.979597+0000","last_active":"2023-12-01T15:59:37.174019+0000","last_peered":"2023-12-01T15:59:37.174019+0000","last_clean":"2023-12-01T15:59:37.174019+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:59:37.174019+0000","last_undegraded":"2023-12-01T15:59:37.174019+0000","last_fullsized":"2023-12-01T15:59:37.174019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:53:22.216155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15458043599999999,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.12","version":"35'5","reported_seq":46,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.582381+0000","last_change":"2023-12-01T15:43:45.203521+0000","last_active":"2023-12-01T15:59:28.582381+0000","last_peered":"2023-12-01T15:59:28.582381+0000","last_clean":"2023-12-01T15:59:28.582381+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T15:59:28.582381+0000","last_undegraded":"2023-12-01T15:59:28.582381+0000","last_fullsized":"2023-12-01T15:59:28.582381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"43'3628","reported_seq":3075,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.097162+0000","last_change":"2023-12-01T15:59:36.960912+0000","last_active":"2023-12-01T15:59:37.097162+0000","last_peered":"2023-12-01T15:59:37.097162+0000","last_clean":"2023-12-01T15:59:37.097162+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:59:37.097162+0000","last_undegraded":"2023-12-01T15:59:37.097162+0000","last_fullsized":"2023-12-01T15:59:37.097162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13624631700000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.11","version":"43'1007","reported_seq":1048,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.814672+0000","last_change":"2023-12-01T15:43:45.205291+0000","last_active":"2023-12-01T15:59:36.814672+0000","last_peered":"2023-12-01T15:59:36.814672+0000","last_clean":"2023-12-01T15:59:36.814672+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T15:59:36.814672+0000","last_undegraded":"2023-12-01T15:59:36.814672+0000","last_fullsized":"2023-12-01T15:59:36.814672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":10007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"43'3451","reported_seq":2870,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.111236+0000","last_change":"2023-12-01T15:59:36.960049+0000","last_active":"2023-12-01T15:59:37.111236+0000","last_peered":"2023-12-01T15:59:37.111236+0000","last_clean":"2023-12-01T15:59:37.111236+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:59:37.111236+0000","last_undegraded":"2023-12-01T15:59:37.111236+0000","last_fullsized":"2023-12-01T15:59:37.111236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3451,"log_dups_size":0,"ondisk_log_size":3451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13638832000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.10","version":"42'1384","reported_seq":1425,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:32.209748+0000","last_change":"2023-12-01T15:43:45.207762+0000","last_active":"2023-12-01T15:59:32.209748+0000","last_peered":"2023-12-01T15:59:32.209748+0000","last_clean":"2023-12-01T15:59:32.209748+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T15:59:32.209748+0000","last_undegraded":"2023-12-01T15:59:32.209748+0000","last_fullsized":"2023-12-01T15:59:32.209748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1392,"num_write_kb":12529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'1276","reported_seq":1318,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:34.527920+0000","last_change":"2023-12-01T15:43:45.203999+0000","last_active":"2023-12-01T15:59:34.527920+0000","last_peered":"2023-12-01T15:59:34.527920+0000","last_clean":"2023-12-01T15:59:34.527920+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T15:59:34.527920+0000","last_undegraded":"2023-12-01T15:59:34.527920+0000","last_fullsized":"2023-12-01T15:59:34.527920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1276,"log_dups_size":0,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":12495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'3658","reported_seq":3044,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.154849+0000","last_change":"2023-12-01T15:59:36.976848+0000","last_active":"2023-12-01T15:59:37.154849+0000","last_peered":"2023-12-01T15:59:37.154849+0000","last_clean":"2023-12-01T15:59:37.154849+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:59:37.154849+0000","last_undegraded":"2023-12-01T15:59:37.154849+0000","last_fullsized":"2023-12-01T15:59:37.154849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:40:12.233063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.172903538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.e","version":"35'1240","reported_seq":1282,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.526561+0000","last_change":"2023-12-01T15:43:45.201303+0000","last_active":"2023-12-01T15:59:29.526561+0000","last_peered":"2023-12-01T15:59:29.526561+0000","last_clean":"2023-12-01T15:59:29.526561+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T15:59:29.526561+0000","last_undegraded":"2023-12-01T15:59:29.526561+0000","last_fullsized":"2023-12-01T15:59:29.526561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1238,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'3442","reported_seq":2867,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.080995+0000","last_change":"2023-12-01T15:59:36.906470+0000","last_active":"2023-12-01T15:59:37.080995+0000","last_peered":"2023-12-01T15:59:37.080995+0000","last_clean":"2023-12-01T15:59:37.080995+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:59:37.080995+0000","last_undegraded":"2023-12-01T15:59:37.080995+0000","last_fullsized":"2023-12-01T15:59:37.080995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3442,"log_dups_size":0,"ondisk_log_size":3442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090755167999999997,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1186,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.d","version":"39'4742","reported_seq":4784,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.481999+0000","last_change":"2023-12-01T15:43:45.207098+0000","last_active":"2023-12-01T15:59:29.481999+0000","last_peered":"2023-12-01T15:59:29.481999+0000","last_clean":"2023-12-01T15:59:29.481999+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T15:59:29.481999+0000","last_undegraded":"2023-12-01T15:59:29.481999+0000","last_fullsized":"2023-12-01T15:59:29.481999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4742,"log_dups_size":0,"ondisk_log_size":4742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4735,"num_write_kb":27522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'3359","reported_seq":2781,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.145987+0000","last_change":"2023-12-01T15:59:36.907684+0000","last_active":"2023-12-01T15:59:37.145987+0000","last_peered":"2023-12-01T15:59:37.145987+0000","last_clean":"2023-12-01T15:59:37.145987+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:59:37.145987+0000","last_undegraded":"2023-12-01T15:59:37.145987+0000","last_fullsized":"2023-12-01T15:59:37.145987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:32:00.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090274558000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.c","version":"36'1988","reported_seq":2030,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.481918+0000","last_change":"2023-12-01T15:43:45.206777+0000","last_active":"2023-12-01T15:59:29.481918+0000","last_peered":"2023-12-01T15:59:29.481918+0000","last_clean":"2023-12-01T15:59:29.481918+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T15:59:29.481918+0000","last_undegraded":"2023-12-01T15:59:29.481918+0000","last_fullsized":"2023-12-01T15:59:29.481918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1988,"log_dups_size":0,"ondisk_log_size":1988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1987,"num_write_kb":25538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"43'3403","reported_seq":2894,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.112373+0000","last_change":"2023-12-01T15:59:36.962413+0000","last_active":"2023-12-01T15:59:37.112373+0000","last_peered":"2023-12-01T15:59:37.112373+0000","last_clean":"2023-12-01T15:59:37.112373+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:59:37.112373+0000","last_undegraded":"2023-12-01T15:59:37.112373+0000","last_fullsized":"2023-12-01T15:59:37.112373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13034463499999999,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1138,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.b","version":"39'4348","reported_seq":4390,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.931337+0000","last_change":"2023-12-01T15:43:45.204182+0000","last_active":"2023-12-01T15:59:29.931337+0000","last_peered":"2023-12-01T15:59:29.931337+0000","last_clean":"2023-12-01T15:59:29.931337+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T15:59:29.931337+0000","last_undegraded":"2023-12-01T15:59:29.931337+0000","last_fullsized":"2023-12-01T15:59:29.931337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4348,"log_dups_size":0,"ondisk_log_size":4348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4337,"num_write_kb":30065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"43'3797","reported_seq":3176,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.094738+0000","last_change":"2023-12-01T15:59:36.966407+0000","last_active":"2023-12-01T15:59:37.094738+0000","last_peered":"2023-12-01T15:59:37.094738+0000","last_clean":"2023-12-01T15:59:37.094738+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T15:59:37.094738+0000","last_undegraded":"2023-12-01T15:59:37.094738+0000","last_fullsized":"2023-12-01T15:59:37.094738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.165714477,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.a","version":"41'2491","reported_seq":2533,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531502+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:59:28.531502+0000","last_peered":"2023-12-01T15:59:28.531502+0000","last_clean":"2023-12-01T15:59:28.531502+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:59:28.531502+0000","last_undegraded":"2023-12-01T15:59:28.531502+0000","last_fullsized":"2023-12-01T15:59:28.531502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2491,"log_dups_size":0,"ondisk_log_size":2491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2494,"num_write_kb":26915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'3462","reported_seq":2929,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181399+0000","last_change":"2023-12-01T15:59:36.980979+0000","last_active":"2023-12-01T15:59:37.181399+0000","last_peered":"2023-12-01T15:59:37.181399+0000","last_clean":"2023-12-01T15:59:37.181399+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:59:37.181399+0000","last_undegraded":"2023-12-01T15:59:37.181399+0000","last_fullsized":"2023-12-01T15:59:37.181399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:51.219271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15615646,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1160,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.9","version":"40'2352","reported_seq":2394,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531275+0000","last_change":"2023-12-01T15:43:45.206261+0000","last_active":"2023-12-01T15:59:28.531275+0000","last_peered":"2023-12-01T15:59:28.531275+0000","last_clean":"2023-12-01T15:59:28.531275+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T15:59:28.531275+0000","last_undegraded":"2023-12-01T15:59:28.531275+0000","last_fullsized":"2023-12-01T15:59:28.531275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2354,"num_write_kb":17078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'3597","reported_seq":2980,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.098070+0000","last_change":"2023-12-01T15:59:36.901256+0000","last_active":"2023-12-01T15:59:37.098070+0000","last_peered":"2023-12-01T15:59:37.098070+0000","last_clean":"2023-12-01T15:59:37.098070+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T15:59:37.098070+0000","last_undegraded":"2023-12-01T15:59:37.098070+0000","last_fullsized":"2023-12-01T15:59:37.098070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086977656,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.8","version":"36'1538","reported_seq":1580,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.387769+0000","last_change":"2023-12-01T15:43:45.200481+0000","last_active":"2023-12-01T15:59:28.387769+0000","last_peered":"2023-12-01T15:59:28.387769+0000","last_clean":"2023-12-01T15:59:28.387769+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T15:59:28.387769+0000","last_undegraded":"2023-12-01T15:59:28.387769+0000","last_fullsized":"2023-12-01T15:59:28.387769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1538,"log_dups_size":0,"ondisk_log_size":1538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1538,"num_write_kb":10132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3475","reported_seq":2901,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.447779+0000","last_change":"2023-12-01T15:59:37.462768+0000","last_active":"2023-12-01T15:59:37.447779+0000","last_peered":"2023-12-01T15:59:37.447779+0000","last_clean":"2023-12-01T15:59:37.447779+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:59:37.447779+0000","last_undegraded":"2023-12-01T15:59:37.447779+0000","last_fullsized":"2023-12-01T15:59:37.447779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.64740572200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"12'117","reported_seq":198,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531461+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:59:28.531461+0000","last_peered":"2023-12-01T15:59:28.531461+0000","last_clean":"2023-12-01T15:59:28.531461+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:59:28.531461+0000","last_undegraded":"2023-12-01T15:59:28.531461+0000","last_fullsized":"2023-12-01T15:59:28.531461+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:09:18.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.532269+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:59:28.532269+0000","last_peered":"2023-12-01T15:59:28.532269+0000","last_clean":"2023-12-01T15:59:28.532269+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:59:28.532269+0000","last_undegraded":"2023-12-01T15:59:28.532269+0000","last_fullsized":"2023-12-01T15:59:28.532269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:10:37.881379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"39'4414","reported_seq":4456,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.389387+0000","last_change":"2023-12-01T15:43:45.201766+0000","last_active":"2023-12-01T15:59:28.389387+0000","last_peered":"2023-12-01T15:59:28.389387+0000","last_clean":"2023-12-01T15:59:28.389387+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T15:59:28.389387+0000","last_undegraded":"2023-12-01T15:59:28.389387+0000","last_fullsized":"2023-12-01T15:59:28.389387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4414,"log_dups_size":0,"ondisk_log_size":4414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4406,"num_write_kb":30219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"43'3657","reported_seq":3067,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181820+0000","last_change":"2023-12-01T15:59:36.978939+0000","last_active":"2023-12-01T15:59:37.181820+0000","last_peered":"2023-12-01T15:59:37.181820+0000","last_clean":"2023-12-01T15:59:37.181820+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:59:37.181820+0000","last_undegraded":"2023-12-01T15:59:37.181820+0000","last_fullsized":"2023-12-01T15:59:37.181820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3657,"log_dups_size":0,"ondisk_log_size":3657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.144833777,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531242+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:59:28.531242+0000","last_peered":"2023-12-01T15:59:28.531242+0000","last_clean":"2023-12-01T15:59:28.531242+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:59:28.531242+0000","last_undegraded":"2023-12-01T15:59:28.531242+0000","last_fullsized":"2023-12-01T15:59:28.531242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'2295","reported_seq":2537,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:38.213756+0000","last_change":"2023-12-01T15:43:45.209138+0000","last_active":"2023-12-01T15:59:38.213756+0000","last_peered":"2023-12-01T15:59:38.213756+0000","last_clean":"2023-12-01T15:59:38.213756+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T15:59:38.213756+0000","last_undegraded":"2023-12-01T15:59:38.213756+0000","last_fullsized":"2023-12-01T15:59:38.213756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3359983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":3419,"num_write":2296,"num_write_kb":16044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'3370","reported_seq":2808,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.096150+0000","last_change":"2023-12-01T15:59:36.960605+0000","last_active":"2023-12-01T15:59:37.096150+0000","last_peered":"2023-12-01T15:59:37.096150+0000","last_clean":"2023-12-01T15:59:37.096150+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T15:59:37.096150+0000","last_undegraded":"2023-12-01T15:59:37.096150+0000","last_fullsized":"2023-12-01T15:59:37.096150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3370,"log_dups_size":0,"ondisk_log_size":3370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13848359499999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1137,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.388444+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:59:28.388444+0000","last_peered":"2023-12-01T15:59:28.388444+0000","last_clean":"2023-12-01T15:59:28.388444+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:59:28.388444+0000","last_undegraded":"2023-12-01T15:59:28.388444+0000","last_fullsized":"2023-12-01T15:59:28.388444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:05:36.049760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"42'2706","reported_seq":2748,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:30.346534+0000","last_change":"2023-12-01T15:43:45.204466+0000","last_active":"2023-12-01T15:59:30.346534+0000","last_peered":"2023-12-01T15:59:30.346534+0000","last_clean":"2023-12-01T15:59:30.346534+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T15:59:30.346534+0000","last_undegraded":"2023-12-01T15:59:30.346534+0000","last_fullsized":"2023-12-01T15:59:30.346534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2706,"log_dups_size":0,"ondisk_log_size":2706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2697,"num_write_kb":25331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'3392","reported_seq":2863,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.452643+0000","last_change":"2023-12-01T15:59:37.459988+0000","last_active":"2023-12-01T15:59:37.452643+0000","last_peered":"2023-12-01T15:59:37.452643+0000","last_clean":"2023-12-01T15:59:37.452643+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:59:37.452643+0000","last_undegraded":"2023-12-01T15:59:37.452643+0000","last_fullsized":"2023-12-01T15:59:37.452643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.644502672,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1119,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531578+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:59:28.531578+0000","last_peered":"2023-12-01T15:59:28.531578+0000","last_clean":"2023-12-01T15:59:28.531578+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:59:28.531578+0000","last_undegraded":"2023-12-01T15:59:28.531578+0000","last_fullsized":"2023-12-01T15:59:28.531578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:11:42.240939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"42'3556","reported_seq":3598,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:30.344225+0000","last_change":"2023-12-01T15:43:45.207506+0000","last_active":"2023-12-01T15:59:30.344225+0000","last_peered":"2023-12-01T15:59:30.344225+0000","last_clean":"2023-12-01T15:59:30.344225+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T15:59:30.344225+0000","last_undegraded":"2023-12-01T15:59:30.344225+0000","last_fullsized":"2023-12-01T15:59:30.344225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3556,"log_dups_size":0,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3556,"num_write_kb":20852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"43'3572","reported_seq":2961,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.485563+0000","last_change":"2023-12-01T15:59:37.493069+0000","last_active":"2023-12-01T15:59:37.485563+0000","last_peered":"2023-12-01T15:59:37.485563+0000","last_clean":"2023-12-01T15:59:37.485563+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:37.485563+0000","last_undegraded":"2023-12-01T15:59:37.485563+0000","last_fullsized":"2023-12-01T15:59:37.485563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3572,"log_dups_size":0,"ondisk_log_size":3572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65789627900000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.5","version":"43'2830","reported_seq":2872,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.217388+0000","last_change":"2023-12-01T15:43:45.210575+0000","last_active":"2023-12-01T15:59:37.217388+0000","last_peered":"2023-12-01T15:59:37.217388+0000","last_clean":"2023-12-01T15:59:37.217388+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T15:59:37.217388+0000","last_undegraded":"2023-12-01T15:59:37.217388+0000","last_fullsized":"2023-12-01T15:59:37.217388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2830,"log_dups_size":0,"ondisk_log_size":2830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2820,"num_write_kb":26865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.391178+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:59:28.391178+0000","last_peered":"2023-12-01T15:59:28.391178+0000","last_clean":"2023-12-01T15:59:28.391178+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:59:28.391178+0000","last_undegraded":"2023-12-01T15:59:28.391178+0000","last_fullsized":"2023-12-01T15:59:28.391178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3759","reported_seq":3194,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.439827+0000","last_change":"2023-12-01T15:59:37.447706+0000","last_active":"2023-12-01T15:59:37.439827+0000","last_peered":"2023-12-01T15:59:37.439827+0000","last_clean":"2023-12-01T15:59:37.439827+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:59:37.439827+0000","last_undegraded":"2023-12-01T15:59:37.439827+0000","last_fullsized":"2023-12-01T15:59:37.439827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.64064258500000004,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.4","version":"43'723","reported_seq":765,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.835279+0000","last_change":"2023-12-01T15:43:45.200408+0000","last_active":"2023-12-01T15:59:36.835279+0000","last_peered":"2023-12-01T15:59:36.835279+0000","last_clean":"2023-12-01T15:59:36.835279+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T15:59:36.835279+0000","last_undegraded":"2023-12-01T15:59:36.835279+0000","last_fullsized":"2023-12-01T15:59:36.835279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":8308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.534317+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:59:28.534317+0000","last_peered":"2023-12-01T15:59:28.534317+0000","last_clean":"2023-12-01T15:59:28.534317+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:59:28.534317+0000","last_undegraded":"2023-12-01T15:59:28.534317+0000","last_fullsized":"2023-12-01T15:59:28.534317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:50:39.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"43'3558","reported_seq":2959,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.125309+0000","last_change":"2023-12-01T15:59:36.962654+0000","last_active":"2023-12-01T15:59:37.125309+0000","last_peered":"2023-12-01T15:59:37.125309+0000","last_clean":"2023-12-01T15:59:37.125309+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T15:59:37.125309+0000","last_undegraded":"2023-12-01T15:59:37.125309+0000","last_fullsized":"2023-12-01T15:59:37.125309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:19.706992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13059393599999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1243,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.7","version":"36'1637","reported_seq":1679,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.391945+0000","last_change":"2023-12-01T15:43:45.203186+0000","last_active":"2023-12-01T15:59:28.391945+0000","last_peered":"2023-12-01T15:59:28.391945+0000","last_clean":"2023-12-01T15:59:28.391945+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T15:59:28.391945+0000","last_undegraded":"2023-12-01T15:59:28.391945+0000","last_fullsized":"2023-12-01T15:59:28.391945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1642,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.390379+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:59:28.390379+0000","last_peered":"2023-12-01T15:59:28.390379+0000","last_clean":"2023-12-01T15:59:28.390379+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:59:28.390379+0000","last_undegraded":"2023-12-01T15:59:28.390379+0000","last_fullsized":"2023-12-01T15:59:28.390379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:40:03.704778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'3696","reported_seq":3059,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.128697+0000","last_change":"2023-12-01T15:59:36.953191+0000","last_active":"2023-12-01T15:59:37.128697+0000","last_peered":"2023-12-01T15:59:37.128697+0000","last_clean":"2023-12-01T15:59:37.128697+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:59:37.128697+0000","last_undegraded":"2023-12-01T15:59:37.128697+0000","last_fullsized":"2023-12-01T15:59:37.128697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3696,"log_dups_size":0,"ondisk_log_size":3696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13319146700000001,"stat_sum":{"num_bytes":4118,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.6","version":"43'1993","reported_seq":2035,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.824773+0000","last_change":"2023-12-01T15:43:45.205286+0000","last_active":"2023-12-01T15:59:36.824773+0000","last_peered":"2023-12-01T15:59:36.824773+0000","last_clean":"2023-12-01T15:59:36.824773+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T15:59:36.824773+0000","last_undegraded":"2023-12-01T15:59:36.824773+0000","last_fullsized":"2023-12-01T15:59:36.824773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2261,"num_write_kb":16414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.534613+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:59:28.534613+0000","last_peered":"2023-12-01T15:59:28.534613+0000","last_clean":"2023-12-01T15:59:28.534613+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:59:28.534613+0000","last_undegraded":"2023-12-01T15:59:28.534613+0000","last_fullsized":"2023-12-01T15:59:28.534613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:55:21.181781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"43'3405","reported_seq":2816,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.094097+0000","last_change":"2023-12-01T15:59:36.902129+0000","last_active":"2023-12-01T15:59:37.094097+0000","last_peered":"2023-12-01T15:59:37.094097+0000","last_clean":"2023-12-01T15:59:37.094097+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T15:59:37.094097+0000","last_undegraded":"2023-12-01T15:59:37.094097+0000","last_fullsized":"2023-12-01T15:59:37.094097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3405,"log_dups_size":0,"ondisk_log_size":3405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.087179219000000002,"stat_sum":{"num_bytes":12302,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.13","version":"43'3613","reported_seq":3016,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.131832+0000","last_change":"2023-12-01T15:59:36.912052+0000","last_active":"2023-12-01T15:59:37.131832+0000","last_peered":"2023-12-01T15:59:37.131832+0000","last_clean":"2023-12-01T15:59:37.131832+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:59:37.131832+0000","last_undegraded":"2023-12-01T15:59:37.131832+0000","last_fullsized":"2023-12-01T15:59:37.131832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:21:55.500677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.084182759999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.14","version":"42'3711","reported_seq":3752,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:31.213338+0000","last_change":"2023-12-01T15:43:45.208015+0000","last_active":"2023-12-01T15:59:31.213338+0000","last_peered":"2023-12-01T15:59:31.213338+0000","last_clean":"2023-12-01T15:59:31.213338+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T15:59:31.213338+0000","last_undegraded":"2023-12-01T15:59:31.213338+0000","last_fullsized":"2023-12-01T15:59:31.213338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3711,"num_write_kb":29795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"43'3508","reported_seq":2924,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.420142+0000","last_change":"2023-12-01T15:59:37.439759+0000","last_active":"2023-12-01T15:59:37.420142+0000","last_peered":"2023-12-01T15:59:37.420142+0000","last_clean":"2023-12-01T15:59:37.420142+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T15:59:37.420142+0000","last_undegraded":"2023-12-01T15:59:37.420142+0000","last_fullsized":"2023-12-01T15:59:37.420142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63296622700000005,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.15","version":"43'2457","reported_seq":2498,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.224645+0000","last_change":"2023-12-01T15:43:45.210538+0000","last_active":"2023-12-01T15:59:37.224645+0000","last_peered":"2023-12-01T15:59:37.224645+0000","last_clean":"2023-12-01T15:59:37.224645+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T15:59:37.224645+0000","last_undegraded":"2023-12-01T15:59:37.224645+0000","last_fullsized":"2023-12-01T15:59:37.224645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2457,"log_dups_size":0,"ondisk_log_size":2457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2453,"num_write_kb":21278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"43'1339","reported_seq":1380,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.814374+0000","last_change":"2023-12-01T15:43:45.204325+0000","last_active":"2023-12-01T15:59:36.814374+0000","last_peered":"2023-12-01T15:59:36.814374+0000","last_clean":"2023-12-01T15:59:36.814374+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T15:59:36.814374+0000","last_undegraded":"2023-12-01T15:59:36.814374+0000","last_fullsized":"2023-12-01T15:59:36.814374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1339,"log_dups_size":0,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1338,"num_write_kb":26066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'3641","reported_seq":3001,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.099603+0000","last_change":"2023-12-01T15:59:36.952311+0000","last_active":"2023-12-01T15:59:37.099603+0000","last_peered":"2023-12-01T15:59:37.099603+0000","last_clean":"2023-12-01T15:59:37.099603+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T15:59:37.099603+0000","last_undegraded":"2023-12-01T15:59:37.099603+0000","last_fullsized":"2023-12-01T15:59:37.099603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:36.724287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13235097200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.17","version":"43'900","reported_seq":941,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.217107+0000","last_change":"2023-12-01T15:43:45.203624+0000","last_active":"2023-12-01T15:59:37.217107+0000","last_peered":"2023-12-01T15:59:37.217107+0000","last_clean":"2023-12-01T15:59:37.217107+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T15:59:37.217107+0000","last_undegraded":"2023-12-01T15:59:37.217107+0000","last_fullsized":"2023-12-01T15:59:37.217107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'3458","reported_seq":2866,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.382919+0000","last_change":"2023-12-01T15:59:37.396927+0000","last_active":"2023-12-01T15:59:37.382919+0000","last_peered":"2023-12-01T15:59:37.382919+0000","last_clean":"2023-12-01T15:59:37.382919+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:59:37.382919+0000","last_undegraded":"2023-12-01T15:59:37.382919+0000","last_fullsized":"2023-12-01T15:59:37.382919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3458,"log_dups_size":0,"ondisk_log_size":3458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.59367497300000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1187,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.1f","version":"43'3413","reported_seq":2906,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.115077+0000","last_change":"2023-12-01T15:59:36.971349+0000","last_active":"2023-12-01T15:59:37.115077+0000","last_peered":"2023-12-01T15:59:37.115077+0000","last_clean":"2023-12-01T15:59:37.115077+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:59:37.115077+0000","last_undegraded":"2023-12-01T15:59:37.115077+0000","last_fullsized":"2023-12-01T15:59:37.115077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:20.675396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17121966999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.18","version":"43'4973","reported_seq":5014,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.803258+0000","last_change":"2023-12-01T15:43:45.205650+0000","last_active":"2023-12-01T15:59:36.803258+0000","last_peered":"2023-12-01T15:59:36.803258+0000","last_clean":"2023-12-01T15:59:36.803258+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:59:36.803258+0000","last_undegraded":"2023-12-01T15:59:36.803258+0000","last_fullsized":"2023-12-01T15:59:36.803258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4973,"log_dups_size":0,"ondisk_log_size":4973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4962,"num_write_kb":39191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3226","reported_seq":2693,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.116439+0000","last_change":"2023-12-01T15:59:36.959488+0000","last_active":"2023-12-01T15:59:37.116439+0000","last_peered":"2023-12-01T15:59:37.116439+0000","last_clean":"2023-12-01T15:59:37.116439+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T15:59:37.116439+0000","last_undegraded":"2023-12-01T15:59:37.116439+0000","last_fullsized":"2023-12-01T15:59:37.116439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3226,"log_dups_size":0,"ondisk_log_size":3226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13751970099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.19","version":"36'490","reported_seq":531,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.388301+0000","last_change":"2023-12-01T15:43:45.200400+0000","last_active":"2023-12-01T15:59:28.388301+0000","last_peered":"2023-12-01T15:59:28.388301+0000","last_clean":"2023-12-01T15:59:28.388301+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:59:28.388301+0000","last_undegraded":"2023-12-01T15:59:28.388301+0000","last_fullsized":"2023-12-01T15:59:28.388301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":17875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'3421","reported_seq":2858,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.051612+0000","last_change":"2023-12-01T15:59:36.955244+0000","last_active":"2023-12-01T15:59:37.051612+0000","last_peered":"2023-12-01T15:59:37.051612+0000","last_clean":"2023-12-01T15:59:37.051612+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:59:37.051612+0000","last_undegraded":"2023-12-01T15:59:37.051612+0000","last_fullsized":"2023-12-01T15:59:37.051612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134588554,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"43'3616","reported_seq":3657,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.817642+0000","last_change":"2023-12-01T15:43:45.200975+0000","last_active":"2023-12-01T15:59:36.817642+0000","last_peered":"2023-12-01T15:59:36.817642+0000","last_clean":"2023-12-01T15:59:36.817642+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:59:36.817642+0000","last_undegraded":"2023-12-01T15:59:36.817642+0000","last_fullsized":"2023-12-01T15:59:36.817642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3616,"log_dups_size":0,"ondisk_log_size":3616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3601,"num_write_kb":33849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"43'3891","reported_seq":3214,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.471375+0000","last_change":"2023-12-01T15:59:37.485420+0000","last_active":"2023-12-01T15:59:37.471375+0000","last_peered":"2023-12-01T15:59:37.471375+0000","last_clean":"2023-12-01T15:59:37.471375+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T15:59:37.471375+0000","last_undegraded":"2023-12-01T15:59:37.471375+0000","last_fullsized":"2023-12-01T15:59:37.471375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3891,"log_dups_size":0,"ondisk_log_size":3891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65050901000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1b","version":"40'2098","reported_seq":2139,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.584412+0000","last_change":"2023-12-01T15:43:45.208899+0000","last_active":"2023-12-01T15:59:28.584412+0000","last_peered":"2023-12-01T15:59:28.584412+0000","last_clean":"2023-12-01T15:59:28.584412+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T15:59:28.584412+0000","last_undegraded":"2023-12-01T15:59:28.584412+0000","last_fullsized":"2023-12-01T15:59:28.584412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2089,"num_write_kb":16989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"43'3665","reported_seq":3073,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.912047+0000","last_change":"2023-12-01T15:59:36.912047+0000","last_active":"2023-12-01T15:59:36.912047+0000","last_peered":"2023-12-01T15:59:36.912047+0000","last_clean":"2023-12-01T15:59:36.912047+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T15:59:36.912047+0000","last_undegraded":"2023-12-01T15:59:36.912047+0000","last_fullsized":"2023-12-01T15:59:36.912047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.084960400000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1169,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1c","version":"43'637","reported_seq":678,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.321599+0000","last_change":"2023-12-01T15:43:45.203471+0000","last_active":"2023-12-01T15:59:37.321599+0000","last_peered":"2023-12-01T15:59:37.321599+0000","last_clean":"2023-12-01T15:59:37.321599+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T15:59:37.321599+0000","last_undegraded":"2023-12-01T15:59:37.321599+0000","last_fullsized":"2023-12-01T15:59:37.321599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1876097,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":640,"num_write_kb":6069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"43'3570","reported_seq":2963,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.129073+0000","last_change":"2023-12-01T15:59:36.912038+0000","last_active":"2023-12-01T15:59:37.129073+0000","last_peered":"2023-12-01T15:59:37.129073+0000","last_clean":"2023-12-01T15:59:37.129073+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:59:37.129073+0000","last_undegraded":"2023-12-01T15:59:37.129073+0000","last_fullsized":"2023-12-01T15:59:37.129073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.094045403999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"36'5936","reported_seq":5977,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.533385+0000","last_change":"2023-12-01T15:43:45.208222+0000","last_active":"2023-12-01T15:59:28.533385+0000","last_peered":"2023-12-01T15:59:28.533385+0000","last_clean":"2023-12-01T15:59:28.533385+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:59:28.533385+0000","last_undegraded":"2023-12-01T15:59:28.533385+0000","last_fullsized":"2023-12-01T15:59:28.533385+0000","mapping_epoch":16,"log_start":"21'300","ondisk_log_start":"21'300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":5636,"log_dups_size":0,"ondisk_log_size":5636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5940,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'3525","reported_seq":2985,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.125486+0000","last_change":"2023-12-01T15:59:36.954665+0000","last_active":"2023-12-01T15:59:37.125486+0000","last_peered":"2023-12-01T15:59:37.125486+0000","last_clean":"2023-12-01T15:59:37.125486+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:59:37.125486+0000","last_undegraded":"2023-12-01T15:59:37.125486+0000","last_fullsized":"2023-12-01T15:59:37.125486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134288985,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1e","version":"39'3426","reported_seq":3468,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.584478+0000","last_change":"2023-12-01T15:43:45.208256+0000","last_active":"2023-12-01T15:59:28.584478+0000","last_peered":"2023-12-01T15:59:28.584478+0000","last_clean":"2023-12-01T15:59:28.584478+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T15:59:28.584478+0000","last_undegraded":"2023-12-01T15:59:28.584478+0000","last_fullsized":"2023-12-01T15:59:28.584478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3411,"num_write_kb":30086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'4049","reported_seq":3327,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.182492+0000","last_change":"2023-12-01T15:59:36.912664+0000","last_active":"2023-12-01T15:59:37.182492+0000","last_peered":"2023-12-01T15:59:37.182492+0000","last_clean":"2023-12-01T15:59:37.182492+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:59:37.182492+0000","last_undegraded":"2023-12-01T15:59:37.182492+0000","last_fullsized":"2023-12-01T15:59:37.182492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":4049,"log_dups_size":0,"ondisk_log_size":4049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.091841191000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1f","version":"39'1803","reported_seq":1845,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.585180+0000","last_change":"2023-12-01T15:43:45.204599+0000","last_active":"2023-12-01T15:59:28.585180+0000","last_peered":"2023-12-01T15:59:28.585180+0000","last_clean":"2023-12-01T15:59:28.585180+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T15:59:28.585180+0000","last_undegraded":"2023-12-01T15:59:28.585180+0000","last_fullsized":"2023-12-01T15:59:28.585180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1803,"log_dups_size":0,"ondisk_log_size":1803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1812,"num_write_kb":15324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":76140,"num_write_kb":40588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225506,"ondisk_log_size":225506,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":277867455,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":223,"num_read_kb":3419,"num_write":76829,"num_write_kb":641147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":555802624,"data_stored":555734910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76345,"ondisk_log_size":76345,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705861,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":682744,"kb_used_data":134064,"kb_used_omap":0,"kb_used_meta":548672,"kb_avail":93689096,"statfs":{"total":96636764160,"available":95937634304,"internally_reserved":0,"allocated":137281536,"data_stored":136927884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":561840128},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.68500000000000005,"15min":0.63400000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.1799999999999999,"5min":10.84,"15min":10.84},"last":0.627},{"interface":"front","average":{"1min":1.129,"5min":0.88900000000000001,"15min":0.70899999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":11.926,"5min":11.926,"15min":11.926},"last":0.75900000000000001}]},{"osd":1,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.71799999999999997,"15min":0.66800000000000004},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.246},"max":{"1min":0.77200000000000002,"5min":10.807,"15min":10.807},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":3.552,"5min":3.552,"15min":3.552},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.72699999999999998,"15min":0.63},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.8700000000000001,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.68000000000000005,"15min":0.64700000000000002},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.71599999999999997,"5min":10.715999999999999,"15min":10.715999999999999},"last":0.46100000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705862,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":801868,"kb_used_data":157252,"kb_used_omap":0,"kb_used_meta":644608,"kb_avail":93569972,"statfs":{"total":96636764160,"available":95815651328,"internally_reserved":0,"allocated":161026048,"data_stored":160664268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":660078592},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.23000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.798,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.60699999999999998,"15min":0.65500000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.84099999999999997,"5min":0.91200000000000003,"15min":2.657},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.68600000000000005,"15min":0.66300000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.8240000000000001,"5min":8.0779999999999994,"15min":8.0779999999999994},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.439,"5min":0.60799999999999998,"15min":0.627},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80500000000000005,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.53300000000000003,"15min":0.56499999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52200000000000002,"5min":2.048,"15min":7.5289999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.70799999999999996,"15min":0.67200000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.845,"5min":8.0370000000000008,"15min":9.8949999999999996},"last":0.42099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705861,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589232,"kb_used_data":98856,"kb_used_omap":0,"kb_used_meta":490368,"kb_avail":93782608,"statfs":{"total":96636764160,"available":96033390592,"internally_reserved":0,"allocated":101228544,"data_stored":100901390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502136832},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.45600000000000002,"15min":0.50800000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17299999999999999},"max":{"1min":0.73299999999999998,"5min":0.749,"15min":8.4589999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.22,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.7729999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63800000000000001,"15min":0.64500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.25900000000000001},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.501},{"interface":"front","average":{"1min":0.501,"5min":0.63,"15min":0.68300000000000005},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.754,"5min":2.6640000000000001,"15min":10.914999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.251},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.36699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":3.1539999999999999,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.62}]}]},{"osd":0,"up_from":9,"seq":38654705861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814556,"kb_used_data":155988,"kb_used_omap":0,"kb_used_meta":658560,"kb_avail":93557284,"statfs":{"total":96636764160,"available":95802658816,"internally_reserved":0,"allocated":159731712,"data_stored":159382664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":674365440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47399999999999998,"15min":0.49099999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.1890000000000001,"5min":1.595,"15min":1.595},"last":0.502},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.51800000000000002,"15min":0.623},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.70499999999999996,"5min":3.3639999999999999,"15min":30.995000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61399999999999999,"15min":0.73099999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":24.504000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.64600000000000002,"15min":0.76400000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":24.524999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64800000000000002,"15min":0.75600000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.859,"5min":2.859,"15min":31.038},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.63400000000000001,"15min":0.69799999999999995},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.95799999999999996,"15min":7.9420000000000002},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":158564352,"data_stored":158550118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":160452608,"data_stored":160426146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":136122368,"data_stored":136095350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T15:59:42.261 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T15:59:42.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.360+0000 7fab3759e700 1 Processor -- start 2023-12-01T15:59:42.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.360+0000 7fab3759e700 1 -- start start 2023-12-01T15:59:42.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.360+0000 7fab3759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fab3806e1d0 0x7fab38134710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.360+0000 7fab3759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3806d1a0 0x7fab380a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.360+0000 7fab3759e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3806e890 con 0x7fab380a3ce0 2023-12-01T15:59:42.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.360+0000 7fab3759e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab38133e10 con 0x7fab3806e1d0 2023-12-01T15:59:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.360+0000 7fab3759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab38134000 con 0x7fab3806d1a0 2023-12-01T15:59:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3659c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fab3806e1d0 0x7fab38134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab36d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fab380a3ce0 0x7fab3813e790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45178/0 (socket says 172.21.15.63:45178) 2023-12-01T15:59:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab36d9d700 1 -- 172.21.15.63:0/1826674132 learned_addr learned my addr 172.21.15.63:0/1826674132 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab35d9b700 1 --2- 172.21.15.63:0/1826674132 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3806d1a0 0x7fab380a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3659c700 1 -- 172.21.15.63:0/1826674132 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3806d1a0 msgr2=0x7fab380a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:42.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3659c700 1 --2- 172.21.15.63:0/1826674132 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3806d1a0 0x7fab380a37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3659c700 1 -- 172.21.15.63:0/1826674132 >> v1:172.21.15.63:6789/0 conn(0x7fab380a3ce0 legacy=0x7fab3813e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3659c700 1 -- 172.21.15.63:0/1826674132 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab381342c0 con 0x7fab3806e1d0 2023-12-01T15:59:42.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3559a700 1 -- 172.21.15.63:0/1826674132 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444197578 0 0) 0x7fab3806e890 con 0x7fab380a3ce0 2023-12-01T15:59:42.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3659c700 1 --2- 172.21.15.63:0/1826674132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab3806e1d0 0x7fab38134710 secure :-1 s=READY pgs=2926 cs=0 l=1 rev1=1 crypto rx=0x7fab28009850 tx=0x7fab28009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c3221e4cdfe195 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:42.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3559a700 1 -- 172.21.15.63:0/1826674132 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab28011830 con 0x7fab3806e1d0 2023-12-01T15:59:42.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3559a700 1 -- 172.21.15.63:0/1826674132 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab28011990 con 0x7fab3806e1d0 2023-12-01T15:59:42.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3559a700 1 -- 172.21.15.63:0/1826674132 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab28011d40 con 0x7fab3806e1d0 2023-12-01T15:59:42.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3759e700 1 -- 172.21.15.63:0/1826674132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab3806e1d0 msgr2=0x7fab38134710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3759e700 1 --2- 172.21.15.63:0/1826674132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab3806e1d0 0x7fab38134710 secure :-1 s=READY pgs=2926 cs=0 l=1 rev1=1 crypto rx=0x7fab28009850 tx=0x7fab28009b60 comp rx=0 tx=0).stop 2023-12-01T15:59:42.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3759e700 1 -- 172.21.15.63:0/1826674132 shutdown_connections 2023-12-01T15:59:42.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3759e700 1 --2- 172.21.15.63:0/1826674132 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3806d1a0 0x7fab380a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3759e700 1 --2- 172.21.15.63:0/1826674132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab3806e1d0 0x7fab38134710 unknown :-1 s=CLOSED pgs=2926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3759e700 1 -- 172.21.15.63:0/1826674132 >> 172.21.15.63:0/1826674132 conn(0x7fab380a5cc0 msgr2=0x7fab380a60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:42.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3759e700 1 -- 172.21.15.63:0/1826674132 shutdown_connections 2023-12-01T15:59:42.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.364+0000 7fab3759e700 1 -- 172.21.15.63:0/1826674132 wait complete. 2023-12-01T15:59:42.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3759e700 1 Processor -- start 2023-12-01T15:59:42.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3759e700 1 -- start start 2023-12-01T15:59:42.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3806d1a0 0x7fab38131200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3759e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab3806e1d0 0x7fab381cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab380a3ce0 0x7fab381ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3759e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab381302c0 con 0x7fab3806e1d0 2023-12-01T15:59:42.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3812f8f0 con 0x7fab380a3ce0 2023-12-01T15:59:42.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab381304d0 con 0x7fab3806d1a0 2023-12-01T15:59:42.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab35d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab3806e1d0 0x7fab381cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab35d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab3806e1d0 0x7fab381cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38544/0 (socket says 172.21.15.63:38544) 2023-12-01T15:59:42.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab35d9b700 1 -- 172.21.15.63:0/1634898022 learned_addr learned my addr 172.21.15.63:0/1634898022 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:42.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3659c700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3806d1a0 0x7fab38131200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab36d9d700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab380a3ce0 0x7fab381ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab35d9b700 1 -- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3806d1a0 msgr2=0x7fab38131200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab35d9b700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3806d1a0 0x7fab38131200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab35d9b700 1 -- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab380a3ce0 msgr2=0x7fab381ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab35d9b700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab380a3ce0 0x7fab381ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab35d9b700 1 -- 172.21.15.63:0/1634898022 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab280094b0 con 0x7fab3806e1d0 2023-12-01T15:59:42.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab35d9b700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab3806e1d0 0x7fab381cc760 secure :-1 s=READY pgs=2927 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00e870 tx=0x7fab2c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:42.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab26ffd700 1 -- 172.21.15.63:0/1634898022 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c0095c0 con 0x7fab3806e1d0 2023-12-01T15:59:42.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab26ffd700 1 -- 172.21.15.63:0/1634898022 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c013680 con 0x7fab3806e1d0 2023-12-01T15:59:42.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab26ffd700 1 -- 172.21.15.63:0/1634898022 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c013a10 con 0x7fab3806e1d0 2023-12-01T15:59:42.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3759e700 1 -- 172.21.15.63:0/1634898022 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab381cd1e0 con 0x7fab3806e1d0 2023-12-01T15:59:42.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3759e700 1 -- 172.21.15.63:0/1634898022 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3812e780 con 0x7fab3806e1d0 2023-12-01T15:59:42.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.368+0000 7fab3759e700 1 -- 172.21.15.63:0/1634898022 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab38065fb0 con 0x7fab3806e1d0 2023-12-01T15:59:42.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.372+0000 7fab26ffd700 1 -- 172.21.15.63:0/1634898022 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fab2c013b70 con 0x7fab3806e1d0 2023-12-01T15:59:42.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.372+0000 7fab26ffd700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fab18065ad0 0x7fab18067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.372+0000 7fab26ffd700 1 -- 172.21.15.63:0/1634898022 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7fab2c082b50 con 0x7fab3806e1d0 2023-12-01T15:59:42.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.372+0000 7fab3659c700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fab18065ad0 0x7fab18067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.372+0000 7fab3659c700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fab18065ad0 0x7fab18067f90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fab280090b0 tx=0x7fab2801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:42.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.376+0000 7fab26ffd700 1 -- 172.21.15.63:0/1634898022 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fab2c050a00 con 0x7fab3806e1d0 2023-12-01T15:59:42.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.544+0000 7fab3759e700 1 -- 172.21.15.63:0/1634898022 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab3806e5b0 con 0x7fab18065ad0 2023-12-01T15:59:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.556+0000 7fab26ffd700 1 -- 172.21.15.63:0/1634898022 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281340 (secure 0 0 0) 0x7fab28011b80 con 0x7fab18065ad0 2023-12-01T15:59:42.574 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:59:42.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 -- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fab18065ad0 msgr2=0x7fab18067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fab18065ad0 0x7fab18067f90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fab280090b0 tx=0x7fab2801c040 comp rx=0 tx=0).stop 2023-12-01T15:59:42.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 -- 172.21.15.63:0/1634898022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab3806e1d0 msgr2=0x7fab381cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab3806e1d0 0x7fab381cc760 secure :-1 s=READY pgs=2927 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00e870 tx=0x7fab2c00eb80 comp rx=0 tx=0).stop 2023-12-01T15:59:42.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 -- 172.21.15.63:0/1634898022 shutdown_connections 2023-12-01T15:59:42.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fab18065ad0 0x7fab18067f90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab380a3ce0 0x7fab381ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab3806e1d0 0x7fab381cc760 unknown :-1 s=CLOSED pgs=2927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 --2- 172.21.15.63:0/1634898022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3806d1a0 0x7fab38131200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 -- 172.21.15.63:0/1634898022 >> 172.21.15.63:0/1634898022 conn(0x7fab380a5cc0 msgr2=0x7fab38131d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:42.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 -- 172.21.15.63:0/1634898022 shutdown_connections 2023-12-01T15:59:42.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.560+0000 7fab3759e700 1 -- 172.21.15.63:0/1634898022 wait complete. 2023-12-01T15:59:42.579 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T15:59:42.589 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2023-12-01T15:59:40.700118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":278585011,"num_objects":242,"num_object_clones":28,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":15,"num_read":370,"num_read_kb":3540,"num_write":153128,"num_write_kb":684151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301968,"ondisk_log_size":301968,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":2888400,"kb_used_data":546160,"kb_used_omap":0,"kb_used_meta":2342208,"kb_avail":374598960,"statfs":{"total":386547056640,"available":383589335040,"internally_reserved":0,"allocated":559267840,"data_stored":557876206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2398420992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1935099,"num_objects":7,"num_object_clones":3,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":3,"num_read":6,"num_read_kb":7,"num_write":126,"num_write_kb":1962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003615"},"pg_stats":[{"pgid":"4.3f","version":"43'3303","reported_seq":2796,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.134377+0000","last_change":"2023-12-01T15:59:36.960583+0000","last_active":"2023-12-01T15:59:37.134377+0000","last_peered":"2023-12-01T15:59:37.134377+0000","last_clean":"2023-12-01T15:59:37.134377+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:59:37.134377+0000","last_undegraded":"2023-12-01T15:59:37.134377+0000","last_fullsized":"2023-12-01T15:59:37.134377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13670799,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3e","version":"43'3496","reported_seq":2953,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.094520+0000","last_change":"2023-12-01T15:59:36.899161+0000","last_active":"2023-12-01T15:59:37.094520+0000","last_peered":"2023-12-01T15:59:37.094520+0000","last_clean":"2023-12-01T15:59:37.094520+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T15:59:37.094520+0000","last_undegraded":"2023-12-01T15:59:37.094520+0000","last_fullsized":"2023-12-01T15:59:37.094520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.085048589999999993,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3d","version":"43'3434","reported_seq":2894,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181268+0000","last_change":"2023-12-01T15:59:36.980200+0000","last_active":"2023-12-01T15:59:37.181268+0000","last_peered":"2023-12-01T15:59:37.181268+0000","last_clean":"2023-12-01T15:59:37.181268+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:59:37.181268+0000","last_undegraded":"2023-12-01T15:59:37.181268+0000","last_fullsized":"2023-12-01T15:59:37.181268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:52:46.242732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15483981599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3c","version":"43'3687","reported_seq":3037,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.088442+0000","last_change":"2023-12-01T15:59:36.901834+0000","last_active":"2023-12-01T15:59:37.088442+0000","last_peered":"2023-12-01T15:59:37.088442+0000","last_clean":"2023-12-01T15:59:37.088442+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:59:37.088442+0000","last_undegraded":"2023-12-01T15:59:37.088442+0000","last_fullsized":"2023-12-01T15:59:37.088442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3687,"log_dups_size":0,"ondisk_log_size":3687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086572531999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3b","version":"43'3485","reported_seq":2915,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.097685+0000","last_change":"2023-12-01T15:59:36.962909+0000","last_active":"2023-12-01T15:59:37.097685+0000","last_peered":"2023-12-01T15:59:37.097685+0000","last_clean":"2023-12-01T15:59:37.097685+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T15:59:37.097685+0000","last_undegraded":"2023-12-01T15:59:37.097685+0000","last_fullsized":"2023-12-01T15:59:37.097685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13014335599999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3a","version":"43'3419","reported_seq":2858,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.179968+0000","last_change":"2023-12-01T15:59:36.980233+0000","last_active":"2023-12-01T15:59:37.179968+0000","last_peered":"2023-12-01T15:59:37.179968+0000","last_clean":"2023-12-01T15:59:37.179968+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T15:59:37.179968+0000","last_undegraded":"2023-12-01T15:59:37.179968+0000","last_fullsized":"2023-12-01T15:59:37.179968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.133828119,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.39","version":"43'3764","reported_seq":3216,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.089165+0000","last_change":"2023-12-01T15:59:36.977002+0000","last_active":"2023-12-01T15:59:37.089165+0000","last_peered":"2023-12-01T15:59:37.089165+0000","last_clean":"2023-12-01T15:59:37.089165+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T15:59:37.089165+0000","last_undegraded":"2023-12-01T15:59:37.089165+0000","last_fullsized":"2023-12-01T15:59:37.089165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3764,"log_dups_size":0,"ondisk_log_size":3764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16251290900000001,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.38","version":"43'3433","reported_seq":2835,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.154788+0000","last_change":"2023-12-01T15:59:36.975843+0000","last_active":"2023-12-01T15:59:37.154788+0000","last_peered":"2023-12-01T15:59:37.154788+0000","last_clean":"2023-12-01T15:59:37.154788+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:59:37.154788+0000","last_undegraded":"2023-12-01T15:59:37.154788+0000","last_fullsized":"2023-12-01T15:59:37.154788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3433,"log_dups_size":0,"ondisk_log_size":3433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:31:59.832465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.173046373,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.37","version":"43'3524","reported_seq":2940,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.134223+0000","last_change":"2023-12-01T15:59:36.960250+0000","last_active":"2023-12-01T15:59:37.134223+0000","last_peered":"2023-12-01T15:59:37.134223+0000","last_clean":"2023-12-01T15:59:37.134223+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:59:37.134223+0000","last_undegraded":"2023-12-01T15:59:37.134223+0000","last_fullsized":"2023-12-01T15:59:37.134223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13648046599999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.36","version":"43'3320","reported_seq":2807,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.116703+0000","last_change":"2023-12-01T15:59:36.978454+0000","last_active":"2023-12-01T15:59:37.116703+0000","last_peered":"2023-12-01T15:59:37.116703+0000","last_clean":"2023-12-01T15:59:37.116703+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:59:37.116703+0000","last_undegraded":"2023-12-01T15:59:37.116703+0000","last_fullsized":"2023-12-01T15:59:37.116703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:00:15.540017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.160523057,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.35","version":"43'3407","reported_seq":2866,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.128890+0000","last_change":"2023-12-01T15:59:36.894457+0000","last_active":"2023-12-01T15:59:37.128890+0000","last_peered":"2023-12-01T15:59:37.128890+0000","last_clean":"2023-12-01T15:59:37.128890+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:59:37.128890+0000","last_undegraded":"2023-12-01T15:59:37.128890+0000","last_fullsized":"2023-12-01T15:59:37.128890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3407,"log_dups_size":0,"ondisk_log_size":3407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.080275320999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.34","version":"43'3529","reported_seq":2900,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.462843+0000","last_change":"2023-12-01T15:59:37.474340+0000","last_active":"2023-12-01T15:59:37.462843+0000","last_peered":"2023-12-01T15:59:37.462843+0000","last_clean":"2023-12-01T15:59:37.462843+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T15:59:37.462843+0000","last_undegraded":"2023-12-01T15:59:37.462843+0000","last_fullsized":"2023-12-01T15:59:37.462843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63957533600000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.33","version":"43'3178","reported_seq":2647,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.098108+0000","last_change":"2023-12-01T15:59:36.959529+0000","last_active":"2023-12-01T15:59:37.098108+0000","last_peered":"2023-12-01T15:59:37.098108+0000","last_clean":"2023-12-01T15:59:37.098108+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T15:59:37.098108+0000","last_undegraded":"2023-12-01T15:59:37.098108+0000","last_fullsized":"2023-12-01T15:59:37.098108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3178,"log_dups_size":0,"ondisk_log_size":3178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138334033,"stat_sum":{"num_bytes":12297,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.32","version":"43'3508","reported_seq":2930,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.113502+0000","last_change":"2023-12-01T15:59:36.908392+0000","last_active":"2023-12-01T15:59:37.113502+0000","last_peered":"2023-12-01T15:59:37.113502+0000","last_clean":"2023-12-01T15:59:37.113502+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T15:59:37.113502+0000","last_undegraded":"2023-12-01T15:59:37.113502+0000","last_fullsized":"2023-12-01T15:59:37.113502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.091404182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.31","version":"43'3600","reported_seq":3005,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.128107+0000","last_change":"2023-12-01T15:59:36.901530+0000","last_active":"2023-12-01T15:59:37.128107+0000","last_peered":"2023-12-01T15:59:37.128107+0000","last_clean":"2023-12-01T15:59:37.128107+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:37.128107+0000","last_undegraded":"2023-12-01T15:59:37.128107+0000","last_fullsized":"2023-12-01T15:59:37.128107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086861997999999996,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1247,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.30","version":"43'3533","reported_seq":2940,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.132837+0000","last_change":"2023-12-01T15:59:36.976205+0000","last_active":"2023-12-01T15:59:37.132837+0000","last_peered":"2023-12-01T15:59:37.132837+0000","last_clean":"2023-12-01T15:59:37.132837+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T15:59:37.132837+0000","last_undegraded":"2023-12-01T15:59:37.132837+0000","last_fullsized":"2023-12-01T15:59:37.132837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3533,"log_dups_size":0,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:23.641161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17327173600000001,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2f","version":"43'3588","reported_seq":2962,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.134083+0000","last_change":"2023-12-01T15:59:36.959847+0000","last_active":"2023-12-01T15:59:37.134083+0000","last_peered":"2023-12-01T15:59:37.134083+0000","last_clean":"2023-12-01T15:59:37.134083+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T15:59:37.134083+0000","last_undegraded":"2023-12-01T15:59:37.134083+0000","last_fullsized":"2023-12-01T15:59:37.134083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13630616600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2e","version":"43'3282","reported_seq":2782,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.131272+0000","last_change":"2023-12-01T15:59:36.977461+0000","last_active":"2023-12-01T15:59:37.131272+0000","last_peered":"2023-12-01T15:59:37.131272+0000","last_clean":"2023-12-01T15:59:37.131272+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T15:59:37.131272+0000","last_undegraded":"2023-12-01T15:59:37.131272+0000","last_fullsized":"2023-12-01T15:59:37.131272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:46:31.135544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.159652814,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1044,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2d","version":"43'3337","reported_seq":2775,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.127501+0000","last_change":"2023-12-01T15:59:36.954938+0000","last_active":"2023-12-01T15:59:37.127501+0000","last_peered":"2023-12-01T15:59:37.127501+0000","last_clean":"2023-12-01T15:59:37.127501+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T15:59:37.127501+0000","last_undegraded":"2023-12-01T15:59:37.127501+0000","last_fullsized":"2023-12-01T15:59:37.127501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134439324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2c","version":"43'3655","reported_seq":3089,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.095700+0000","last_change":"2023-12-01T15:59:36.963898+0000","last_active":"2023-12-01T15:59:37.095700+0000","last_peered":"2023-12-01T15:59:37.095700+0000","last_clean":"2023-12-01T15:59:37.095700+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:59:37.095700+0000","last_undegraded":"2023-12-01T15:59:37.095700+0000","last_fullsized":"2023-12-01T15:59:37.095700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3655,"log_dups_size":0,"ondisk_log_size":3655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:50.215328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16502647100000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2b","version":"43'3592","reported_seq":3027,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.148002+0000","last_change":"2023-12-01T15:59:36.908706+0000","last_active":"2023-12-01T15:59:37.148002+0000","last_peered":"2023-12-01T15:59:37.148002+0000","last_clean":"2023-12-01T15:59:37.148002+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T15:59:37.148002+0000","last_undegraded":"2023-12-01T15:59:37.148002+0000","last_fullsized":"2023-12-01T15:59:37.148002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.082049368999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2a","version":"43'3494","reported_seq":2865,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.072178+0000","last_change":"2023-12-01T15:59:36.954854+0000","last_active":"2023-12-01T15:59:37.072178+0000","last_peered":"2023-12-01T15:59:37.072178+0000","last_clean":"2023-12-01T15:59:37.072178+0000","last_became_active":"2023-12-01T15:44:30.528283+0000","last_became_peered":"2023-12-01T15:44:30.528283+0000","last_unstale":"2023-12-01T15:59:37.072178+0000","last_undegraded":"2023-12-01T15:59:37.072178+0000","last_fullsized":"2023-12-01T15:59:37.072178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3494,"log_dups_size":0,"ondisk_log_size":3494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:49:07.227935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13495370100000001,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.29","version":"43'3466","reported_seq":2921,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.421995+0000","last_change":"2023-12-01T15:59:37.440864+0000","last_active":"2023-12-01T15:59:37.421995+0000","last_peered":"2023-12-01T15:59:37.421995+0000","last_clean":"2023-12-01T15:59:37.421995+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T15:59:37.421995+0000","last_undegraded":"2023-12-01T15:59:37.421995+0000","last_fullsized":"2023-12-01T15:59:37.421995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3466,"log_dups_size":0,"ondisk_log_size":3466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.62816057700000005,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.28","version":"43'3577","reported_seq":2946,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.126385+0000","last_change":"2023-12-01T15:59:36.976374+0000","last_active":"2023-12-01T15:59:37.126385+0000","last_peered":"2023-12-01T15:59:37.126385+0000","last_clean":"2023-12-01T15:59:37.126385+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:59:37.126385+0000","last_undegraded":"2023-12-01T15:59:37.126385+0000","last_fullsized":"2023-12-01T15:59:37.126385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:16:11.702379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17330785400000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.27","version":"43'3344","reported_seq":2820,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.440997+0000","last_change":"2023-12-01T15:59:37.452527+0000","last_active":"2023-12-01T15:59:37.440997+0000","last_peered":"2023-12-01T15:59:37.440997+0000","last_clean":"2023-12-01T15:59:37.440997+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T15:59:37.440997+0000","last_undegraded":"2023-12-01T15:59:37.440997+0000","last_fullsized":"2023-12-01T15:59:37.440997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63729295699999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.26","version":"43'3411","reported_seq":2861,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.414457+0000","last_change":"2023-12-01T15:59:37.421961+0000","last_active":"2023-12-01T15:59:37.414457+0000","last_peered":"2023-12-01T15:59:37.414457+0000","last_clean":"2023-12-01T15:59:37.414457+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T15:59:37.414457+0000","last_undegraded":"2023-12-01T15:59:37.414457+0000","last_fullsized":"2023-12-01T15:59:37.414457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3411,"log_dups_size":0,"ondisk_log_size":3411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.611917673,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.25","version":"43'3312","reported_seq":2736,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.180983+0000","last_change":"2023-12-01T15:59:36.980913+0000","last_active":"2023-12-01T15:59:37.180983+0000","last_peered":"2023-12-01T15:59:37.180983+0000","last_clean":"2023-12-01T15:59:37.180983+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T15:59:37.180983+0000","last_undegraded":"2023-12-01T15:59:37.180983+0000","last_fullsized":"2023-12-01T15:59:37.180983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:34:06.793940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.146734475,"stat_sum":{"num_bytes":4116,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.24","version":"43'3312","reported_seq":2770,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.481996+0000","last_change":"2023-12-01T15:59:37.489547+0000","last_active":"2023-12-01T15:59:37.481996+0000","last_peered":"2023-12-01T15:59:37.481996+0000","last_clean":"2023-12-01T15:59:37.481996+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T15:59:37.481996+0000","last_undegraded":"2023-12-01T15:59:37.481996+0000","last_fullsized":"2023-12-01T15:59:37.481996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65414528699999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.23","version":"43'3662","reported_seq":3036,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.146827+0000","last_change":"2023-12-01T15:59:36.959770+0000","last_active":"2023-12-01T15:59:37.146827+0000","last_peered":"2023-12-01T15:59:37.146827+0000","last_clean":"2023-12-01T15:59:37.146827+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T15:59:37.146827+0000","last_undegraded":"2023-12-01T15:59:37.146827+0000","last_fullsized":"2023-12-01T15:59:37.146827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13835824199999999,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.22","version":"43'3520","reported_seq":2989,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181386+0000","last_change":"2023-12-01T15:59:36.981606+0000","last_active":"2023-12-01T15:59:37.181386+0000","last_peered":"2023-12-01T15:59:37.181386+0000","last_clean":"2023-12-01T15:59:37.181386+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:59:37.181386+0000","last_undegraded":"2023-12-01T15:59:37.181386+0000","last_fullsized":"2023-12-01T15:59:37.181386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3520,"log_dups_size":0,"ondisk_log_size":3520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13490588100000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.21","version":"43'3994","reported_seq":3317,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.460079+0000","last_change":"2023-12-01T15:59:37.471324+0000","last_active":"2023-12-01T15:59:37.460079+0000","last_peered":"2023-12-01T15:59:37.460079+0000","last_clean":"2023-12-01T15:59:37.460079+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T15:59:37.460079+0000","last_undegraded":"2023-12-01T15:59:37.460079+0000","last_fullsized":"2023-12-01T15:59:37.460079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3994,"log_dups_size":0,"ondisk_log_size":3994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65412195699999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.20","version":"43'3592","reported_seq":2992,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.179485+0000","last_change":"2023-12-01T15:59:36.911013+0000","last_active":"2023-12-01T15:59:37.179485+0000","last_peered":"2023-12-01T15:59:37.179485+0000","last_clean":"2023-12-01T15:59:37.179485+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T15:59:37.179485+0000","last_undegraded":"2023-12-01T15:59:37.179485+0000","last_fullsized":"2023-12-01T15:59:37.179485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090414480000000005,"stat_sum":{"num_bytes":4118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.14","version":"43'3661","reported_seq":3059,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.474372+0000","last_change":"2023-12-01T15:59:37.481885+0000","last_active":"2023-12-01T15:59:37.474372+0000","last_peered":"2023-12-01T15:59:37.474372+0000","last_clean":"2023-12-01T15:59:37.474372+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:59:37.474372+0000","last_undegraded":"2023-12-01T15:59:37.474372+0000","last_fullsized":"2023-12-01T15:59:37.474372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3661,"log_dups_size":0,"ondisk_log_size":3661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.646838511,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.13","version":"39'2734","reported_seq":2775,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.532051+0000","last_change":"2023-12-01T15:43:45.205685+0000","last_active":"2023-12-01T15:59:28.532051+0000","last_peered":"2023-12-01T15:59:28.532051+0000","last_clean":"2023-12-01T15:59:28.532051+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T15:59:28.532051+0000","last_undegraded":"2023-12-01T15:59:28.532051+0000","last_fullsized":"2023-12-01T15:59:28.532051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2734,"log_dups_size":0,"ondisk_log_size":2734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2729,"num_write_kb":18350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"43'3426","reported_seq":2842,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.174019+0000","last_change":"2023-12-01T15:59:36.979597+0000","last_active":"2023-12-01T15:59:37.174019+0000","last_peered":"2023-12-01T15:59:37.174019+0000","last_clean":"2023-12-01T15:59:37.174019+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:59:37.174019+0000","last_undegraded":"2023-12-01T15:59:37.174019+0000","last_fullsized":"2023-12-01T15:59:37.174019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:53:22.216155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15458043599999999,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.12","version":"35'5","reported_seq":46,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.582381+0000","last_change":"2023-12-01T15:43:45.203521+0000","last_active":"2023-12-01T15:59:28.582381+0000","last_peered":"2023-12-01T15:59:28.582381+0000","last_clean":"2023-12-01T15:59:28.582381+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T15:59:28.582381+0000","last_undegraded":"2023-12-01T15:59:28.582381+0000","last_fullsized":"2023-12-01T15:59:28.582381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"43'3628","reported_seq":3075,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.097162+0000","last_change":"2023-12-01T15:59:36.960912+0000","last_active":"2023-12-01T15:59:37.097162+0000","last_peered":"2023-12-01T15:59:37.097162+0000","last_clean":"2023-12-01T15:59:37.097162+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:59:37.097162+0000","last_undegraded":"2023-12-01T15:59:37.097162+0000","last_fullsized":"2023-12-01T15:59:37.097162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13624631700000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.11","version":"43'1007","reported_seq":1048,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.814672+0000","last_change":"2023-12-01T15:43:45.205291+0000","last_active":"2023-12-01T15:59:36.814672+0000","last_peered":"2023-12-01T15:59:36.814672+0000","last_clean":"2023-12-01T15:59:36.814672+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T15:59:36.814672+0000","last_undegraded":"2023-12-01T15:59:36.814672+0000","last_fullsized":"2023-12-01T15:59:36.814672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":10007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"43'3451","reported_seq":2870,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.111236+0000","last_change":"2023-12-01T15:59:36.960049+0000","last_active":"2023-12-01T15:59:37.111236+0000","last_peered":"2023-12-01T15:59:37.111236+0000","last_clean":"2023-12-01T15:59:37.111236+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:59:37.111236+0000","last_undegraded":"2023-12-01T15:59:37.111236+0000","last_fullsized":"2023-12-01T15:59:37.111236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3451,"log_dups_size":0,"ondisk_log_size":3451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13638832000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.10","version":"42'1384","reported_seq":1425,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:32.209748+0000","last_change":"2023-12-01T15:43:45.207762+0000","last_active":"2023-12-01T15:59:32.209748+0000","last_peered":"2023-12-01T15:59:32.209748+0000","last_clean":"2023-12-01T15:59:32.209748+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T15:59:32.209748+0000","last_undegraded":"2023-12-01T15:59:32.209748+0000","last_fullsized":"2023-12-01T15:59:32.209748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1392,"num_write_kb":12529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'1276","reported_seq":1318,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:34.527920+0000","last_change":"2023-12-01T15:43:45.203999+0000","last_active":"2023-12-01T15:59:34.527920+0000","last_peered":"2023-12-01T15:59:34.527920+0000","last_clean":"2023-12-01T15:59:34.527920+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T15:59:34.527920+0000","last_undegraded":"2023-12-01T15:59:34.527920+0000","last_fullsized":"2023-12-01T15:59:34.527920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1276,"log_dups_size":0,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":12495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'3658","reported_seq":3044,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.154849+0000","last_change":"2023-12-01T15:59:36.976848+0000","last_active":"2023-12-01T15:59:37.154849+0000","last_peered":"2023-12-01T15:59:37.154849+0000","last_clean":"2023-12-01T15:59:37.154849+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:59:37.154849+0000","last_undegraded":"2023-12-01T15:59:37.154849+0000","last_fullsized":"2023-12-01T15:59:37.154849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:40:12.233063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.172903538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.e","version":"35'1240","reported_seq":1282,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.526561+0000","last_change":"2023-12-01T15:43:45.201303+0000","last_active":"2023-12-01T15:59:29.526561+0000","last_peered":"2023-12-01T15:59:29.526561+0000","last_clean":"2023-12-01T15:59:29.526561+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T15:59:29.526561+0000","last_undegraded":"2023-12-01T15:59:29.526561+0000","last_fullsized":"2023-12-01T15:59:29.526561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1238,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'3442","reported_seq":2867,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.080995+0000","last_change":"2023-12-01T15:59:36.906470+0000","last_active":"2023-12-01T15:59:37.080995+0000","last_peered":"2023-12-01T15:59:37.080995+0000","last_clean":"2023-12-01T15:59:37.080995+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:59:37.080995+0000","last_undegraded":"2023-12-01T15:59:37.080995+0000","last_fullsized":"2023-12-01T15:59:37.080995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3442,"log_dups_size":0,"ondisk_log_size":3442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090755167999999997,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1186,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.d","version":"39'4742","reported_seq":4784,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.481999+0000","last_change":"2023-12-01T15:43:45.207098+0000","last_active":"2023-12-01T15:59:29.481999+0000","last_peered":"2023-12-01T15:59:29.481999+0000","last_clean":"2023-12-01T15:59:29.481999+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T15:59:29.481999+0000","last_undegraded":"2023-12-01T15:59:29.481999+0000","last_fullsized":"2023-12-01T15:59:29.481999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4742,"log_dups_size":0,"ondisk_log_size":4742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4735,"num_write_kb":27522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'3359","reported_seq":2781,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.145987+0000","last_change":"2023-12-01T15:59:36.907684+0000","last_active":"2023-12-01T15:59:37.145987+0000","last_peered":"2023-12-01T15:59:37.145987+0000","last_clean":"2023-12-01T15:59:37.145987+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:59:37.145987+0000","last_undegraded":"2023-12-01T15:59:37.145987+0000","last_fullsized":"2023-12-01T15:59:37.145987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:32:00.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090274558000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.c","version":"36'1988","reported_seq":2030,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.481918+0000","last_change":"2023-12-01T15:43:45.206777+0000","last_active":"2023-12-01T15:59:29.481918+0000","last_peered":"2023-12-01T15:59:29.481918+0000","last_clean":"2023-12-01T15:59:29.481918+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T15:59:29.481918+0000","last_undegraded":"2023-12-01T15:59:29.481918+0000","last_fullsized":"2023-12-01T15:59:29.481918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1988,"log_dups_size":0,"ondisk_log_size":1988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1987,"num_write_kb":25538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"43'3403","reported_seq":2894,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.112373+0000","last_change":"2023-12-01T15:59:36.962413+0000","last_active":"2023-12-01T15:59:37.112373+0000","last_peered":"2023-12-01T15:59:37.112373+0000","last_clean":"2023-12-01T15:59:37.112373+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:59:37.112373+0000","last_undegraded":"2023-12-01T15:59:37.112373+0000","last_fullsized":"2023-12-01T15:59:37.112373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13034463499999999,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1138,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.b","version":"39'4348","reported_seq":4390,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.931337+0000","last_change":"2023-12-01T15:43:45.204182+0000","last_active":"2023-12-01T15:59:29.931337+0000","last_peered":"2023-12-01T15:59:29.931337+0000","last_clean":"2023-12-01T15:59:29.931337+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T15:59:29.931337+0000","last_undegraded":"2023-12-01T15:59:29.931337+0000","last_fullsized":"2023-12-01T15:59:29.931337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4348,"log_dups_size":0,"ondisk_log_size":4348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4337,"num_write_kb":30065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"43'3797","reported_seq":3176,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.094738+0000","last_change":"2023-12-01T15:59:36.966407+0000","last_active":"2023-12-01T15:59:37.094738+0000","last_peered":"2023-12-01T15:59:37.094738+0000","last_clean":"2023-12-01T15:59:37.094738+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T15:59:37.094738+0000","last_undegraded":"2023-12-01T15:59:37.094738+0000","last_fullsized":"2023-12-01T15:59:37.094738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.165714477,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.a","version":"41'2491","reported_seq":2533,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531502+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:59:28.531502+0000","last_peered":"2023-12-01T15:59:28.531502+0000","last_clean":"2023-12-01T15:59:28.531502+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:59:28.531502+0000","last_undegraded":"2023-12-01T15:59:28.531502+0000","last_fullsized":"2023-12-01T15:59:28.531502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2491,"log_dups_size":0,"ondisk_log_size":2491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2494,"num_write_kb":26915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'3462","reported_seq":2929,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181399+0000","last_change":"2023-12-01T15:59:36.980979+0000","last_active":"2023-12-01T15:59:37.181399+0000","last_peered":"2023-12-01T15:59:37.181399+0000","last_clean":"2023-12-01T15:59:37.181399+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:59:37.181399+0000","last_undegraded":"2023-12-01T15:59:37.181399+0000","last_fullsized":"2023-12-01T15:59:37.181399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:51.219271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15615646,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1160,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.9","version":"40'2352","reported_seq":2394,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531275+0000","last_change":"2023-12-01T15:43:45.206261+0000","last_active":"2023-12-01T15:59:28.531275+0000","last_peered":"2023-12-01T15:59:28.531275+0000","last_clean":"2023-12-01T15:59:28.531275+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T15:59:28.531275+0000","last_undegraded":"2023-12-01T15:59:28.531275+0000","last_fullsized":"2023-12-01T15:59:28.531275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2354,"num_write_kb":17078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'3597","reported_seq":2980,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.098070+0000","last_change":"2023-12-01T15:59:36.901256+0000","last_active":"2023-12-01T15:59:37.098070+0000","last_peered":"2023-12-01T15:59:37.098070+0000","last_clean":"2023-12-01T15:59:37.098070+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T15:59:37.098070+0000","last_undegraded":"2023-12-01T15:59:37.098070+0000","last_fullsized":"2023-12-01T15:59:37.098070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086977656,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.8","version":"36'1538","reported_seq":1580,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.387769+0000","last_change":"2023-12-01T15:43:45.200481+0000","last_active":"2023-12-01T15:59:28.387769+0000","last_peered":"2023-12-01T15:59:28.387769+0000","last_clean":"2023-12-01T15:59:28.387769+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T15:59:28.387769+0000","last_undegraded":"2023-12-01T15:59:28.387769+0000","last_fullsized":"2023-12-01T15:59:28.387769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1538,"log_dups_size":0,"ondisk_log_size":1538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1538,"num_write_kb":10132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3475","reported_seq":2901,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.447779+0000","last_change":"2023-12-01T15:59:37.462768+0000","last_active":"2023-12-01T15:59:37.447779+0000","last_peered":"2023-12-01T15:59:37.447779+0000","last_clean":"2023-12-01T15:59:37.447779+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:59:37.447779+0000","last_undegraded":"2023-12-01T15:59:37.447779+0000","last_fullsized":"2023-12-01T15:59:37.447779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.64740572200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"12'117","reported_seq":198,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531461+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:59:28.531461+0000","last_peered":"2023-12-01T15:59:28.531461+0000","last_clean":"2023-12-01T15:59:28.531461+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:59:28.531461+0000","last_undegraded":"2023-12-01T15:59:28.531461+0000","last_fullsized":"2023-12-01T15:59:28.531461+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:09:18.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.532269+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:59:28.532269+0000","last_peered":"2023-12-01T15:59:28.532269+0000","last_clean":"2023-12-01T15:59:28.532269+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:59:28.532269+0000","last_undegraded":"2023-12-01T15:59:28.532269+0000","last_fullsized":"2023-12-01T15:59:28.532269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:10:37.881379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"39'4414","reported_seq":4456,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.389387+0000","last_change":"2023-12-01T15:43:45.201766+0000","last_active":"2023-12-01T15:59:28.389387+0000","last_peered":"2023-12-01T15:59:28.389387+0000","last_clean":"2023-12-01T15:59:28.389387+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T15:59:28.389387+0000","last_undegraded":"2023-12-01T15:59:28.389387+0000","last_fullsized":"2023-12-01T15:59:28.389387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4414,"log_dups_size":0,"ondisk_log_size":4414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4406,"num_write_kb":30219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"43'3657","reported_seq":3067,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181820+0000","last_change":"2023-12-01T15:59:36.978939+0000","last_active":"2023-12-01T15:59:37.181820+0000","last_peered":"2023-12-01T15:59:37.181820+0000","last_clean":"2023-12-01T15:59:37.181820+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:59:37.181820+0000","last_undegraded":"2023-12-01T15:59:37.181820+0000","last_fullsized":"2023-12-01T15:59:37.181820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3657,"log_dups_size":0,"ondisk_log_size":3657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.144833777,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531242+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:59:28.531242+0000","last_peered":"2023-12-01T15:59:28.531242+0000","last_clean":"2023-12-01T15:59:28.531242+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:59:28.531242+0000","last_undegraded":"2023-12-01T15:59:28.531242+0000","last_fullsized":"2023-12-01T15:59:28.531242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'2295","reported_seq":2537,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:38.213756+0000","last_change":"2023-12-01T15:43:45.209138+0000","last_active":"2023-12-01T15:59:38.213756+0000","last_peered":"2023-12-01T15:59:38.213756+0000","last_clean":"2023-12-01T15:59:38.213756+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T15:59:38.213756+0000","last_undegraded":"2023-12-01T15:59:38.213756+0000","last_fullsized":"2023-12-01T15:59:38.213756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3359983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":3419,"num_write":2296,"num_write_kb":16044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'3370","reported_seq":2808,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.096150+0000","last_change":"2023-12-01T15:59:36.960605+0000","last_active":"2023-12-01T15:59:37.096150+0000","last_peered":"2023-12-01T15:59:37.096150+0000","last_clean":"2023-12-01T15:59:37.096150+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T15:59:37.096150+0000","last_undegraded":"2023-12-01T15:59:37.096150+0000","last_fullsized":"2023-12-01T15:59:37.096150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3370,"log_dups_size":0,"ondisk_log_size":3370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13848359499999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1137,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.388444+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:59:28.388444+0000","last_peered":"2023-12-01T15:59:28.388444+0000","last_clean":"2023-12-01T15:59:28.388444+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:59:28.388444+0000","last_undegraded":"2023-12-01T15:59:28.388444+0000","last_fullsized":"2023-12-01T15:59:28.388444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:05:36.049760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"42'2706","reported_seq":2748,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:30.346534+0000","last_change":"2023-12-01T15:43:45.204466+0000","last_active":"2023-12-01T15:59:30.346534+0000","last_peered":"2023-12-01T15:59:30.346534+0000","last_clean":"2023-12-01T15:59:30.346534+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T15:59:30.346534+0000","last_undegraded":"2023-12-01T15:59:30.346534+0000","last_fullsized":"2023-12-01T15:59:30.346534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2706,"log_dups_size":0,"ondisk_log_size":2706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2697,"num_write_kb":25331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'3392","reported_seq":2863,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.452643+0000","last_change":"2023-12-01T15:59:37.459988+0000","last_active":"2023-12-01T15:59:37.452643+0000","last_peered":"2023-12-01T15:59:37.452643+0000","last_clean":"2023-12-01T15:59:37.452643+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:59:37.452643+0000","last_undegraded":"2023-12-01T15:59:37.452643+0000","last_fullsized":"2023-12-01T15:59:37.452643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.644502672,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1119,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531578+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:59:28.531578+0000","last_peered":"2023-12-01T15:59:28.531578+0000","last_clean":"2023-12-01T15:59:28.531578+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:59:28.531578+0000","last_undegraded":"2023-12-01T15:59:28.531578+0000","last_fullsized":"2023-12-01T15:59:28.531578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:11:42.240939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"42'3556","reported_seq":3598,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:30.344225+0000","last_change":"2023-12-01T15:43:45.207506+0000","last_active":"2023-12-01T15:59:30.344225+0000","last_peered":"2023-12-01T15:59:30.344225+0000","last_clean":"2023-12-01T15:59:30.344225+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T15:59:30.344225+0000","last_undegraded":"2023-12-01T15:59:30.344225+0000","last_fullsized":"2023-12-01T15:59:30.344225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3556,"log_dups_size":0,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3556,"num_write_kb":20852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"43'3572","reported_seq":2961,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.485563+0000","last_change":"2023-12-01T15:59:37.493069+0000","last_active":"2023-12-01T15:59:37.485563+0000","last_peered":"2023-12-01T15:59:37.485563+0000","last_clean":"2023-12-01T15:59:37.485563+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:37.485563+0000","last_undegraded":"2023-12-01T15:59:37.485563+0000","last_fullsized":"2023-12-01T15:59:37.485563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3572,"log_dups_size":0,"ondisk_log_size":3572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65789627900000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.5","version":"43'2830","reported_seq":2872,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.217388+0000","last_change":"2023-12-01T15:43:45.210575+0000","last_active":"2023-12-01T15:59:37.217388+0000","last_peered":"2023-12-01T15:59:37.217388+0000","last_clean":"2023-12-01T15:59:37.217388+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T15:59:37.217388+0000","last_undegraded":"2023-12-01T15:59:37.217388+0000","last_fullsized":"2023-12-01T15:59:37.217388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2830,"log_dups_size":0,"ondisk_log_size":2830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2820,"num_write_kb":26865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.391178+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:59:28.391178+0000","last_peered":"2023-12-01T15:59:28.391178+0000","last_clean":"2023-12-01T15:59:28.391178+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:59:28.391178+0000","last_undegraded":"2023-12-01T15:59:28.391178+0000","last_fullsized":"2023-12-01T15:59:28.391178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3759","reported_seq":3194,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.439827+0000","last_change":"2023-12-01T15:59:37.447706+0000","last_active":"2023-12-01T15:59:37.439827+0000","last_peered":"2023-12-01T15:59:37.439827+0000","last_clean":"2023-12-01T15:59:37.439827+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:59:37.439827+0000","last_undegraded":"2023-12-01T15:59:37.439827+0000","last_fullsized":"2023-12-01T15:59:37.439827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.64064258500000004,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.4","version":"43'723","reported_seq":765,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.835279+0000","last_change":"2023-12-01T15:43:45.200408+0000","last_active":"2023-12-01T15:59:36.835279+0000","last_peered":"2023-12-01T15:59:36.835279+0000","last_clean":"2023-12-01T15:59:36.835279+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T15:59:36.835279+0000","last_undegraded":"2023-12-01T15:59:36.835279+0000","last_fullsized":"2023-12-01T15:59:36.835279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":8308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.534317+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:59:28.534317+0000","last_peered":"2023-12-01T15:59:28.534317+0000","last_clean":"2023-12-01T15:59:28.534317+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:59:28.534317+0000","last_undegraded":"2023-12-01T15:59:28.534317+0000","last_fullsized":"2023-12-01T15:59:28.534317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:50:39.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"43'3558","reported_seq":2959,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.125309+0000","last_change":"2023-12-01T15:59:36.962654+0000","last_active":"2023-12-01T15:59:37.125309+0000","last_peered":"2023-12-01T15:59:37.125309+0000","last_clean":"2023-12-01T15:59:37.125309+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T15:59:37.125309+0000","last_undegraded":"2023-12-01T15:59:37.125309+0000","last_fullsized":"2023-12-01T15:59:37.125309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:19.706992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13059393599999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1243,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.7","version":"36'1637","reported_seq":1679,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.391945+0000","last_change":"2023-12-01T15:43:45.203186+0000","last_active":"2023-12-01T15:59:28.391945+0000","last_peered":"2023-12-01T15:59:28.391945+0000","last_clean":"2023-12-01T15:59:28.391945+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T15:59:28.391945+0000","last_undegraded":"2023-12-01T15:59:28.391945+0000","last_fullsized":"2023-12-01T15:59:28.391945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1642,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.390379+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:59:28.390379+0000","last_peered":"2023-12-01T15:59:28.390379+0000","last_clean":"2023-12-01T15:59:28.390379+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:59:28.390379+0000","last_undegraded":"2023-12-01T15:59:28.390379+0000","last_fullsized":"2023-12-01T15:59:28.390379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:40:03.704778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'3696","reported_seq":3059,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.128697+0000","last_change":"2023-12-01T15:59:36.953191+0000","last_active":"2023-12-01T15:59:37.128697+0000","last_peered":"2023-12-01T15:59:37.128697+0000","last_clean":"2023-12-01T15:59:37.128697+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:59:37.128697+0000","last_undegraded":"2023-12-01T15:59:37.128697+0000","last_fullsized":"2023-12-01T15:59:37.128697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3696,"log_dups_size":0,"ondisk_log_size":3696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13319146700000001,"stat_sum":{"num_bytes":4118,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.6","version":"43'1993","reported_seq":2035,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.824773+0000","last_change":"2023-12-01T15:43:45.205286+0000","last_active":"2023-12-01T15:59:36.824773+0000","last_peered":"2023-12-01T15:59:36.824773+0000","last_clean":"2023-12-01T15:59:36.824773+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T15:59:36.824773+0000","last_undegraded":"2023-12-01T15:59:36.824773+0000","last_fullsized":"2023-12-01T15:59:36.824773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2261,"num_write_kb":16414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.534613+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:59:28.534613+0000","last_peered":"2023-12-01T15:59:28.534613+0000","last_clean":"2023-12-01T15:59:28.534613+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:59:28.534613+0000","last_undegraded":"2023-12-01T15:59:28.534613+0000","last_fullsized":"2023-12-01T15:59:28.534613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:55:21.181781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"43'3405","reported_seq":2816,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.094097+0000","last_change":"2023-12-01T15:59:36.902129+0000","last_active":"2023-12-01T15:59:37.094097+0000","last_peered":"2023-12-01T15:59:37.094097+0000","last_clean":"2023-12-01T15:59:37.094097+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T15:59:37.094097+0000","last_undegraded":"2023-12-01T15:59:37.094097+0000","last_fullsized":"2023-12-01T15:59:37.094097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3405,"log_dups_size":0,"ondisk_log_size":3405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.087179219000000002,"stat_sum":{"num_bytes":12302,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.13","version":"43'3613","reported_seq":3016,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.131832+0000","last_change":"2023-12-01T15:59:36.912052+0000","last_active":"2023-12-01T15:59:37.131832+0000","last_peered":"2023-12-01T15:59:37.131832+0000","last_clean":"2023-12-01T15:59:37.131832+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:59:37.131832+0000","last_undegraded":"2023-12-01T15:59:37.131832+0000","last_fullsized":"2023-12-01T15:59:37.131832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:21:55.500677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.084182759999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.14","version":"42'3711","reported_seq":3752,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:31.213338+0000","last_change":"2023-12-01T15:43:45.208015+0000","last_active":"2023-12-01T15:59:31.213338+0000","last_peered":"2023-12-01T15:59:31.213338+0000","last_clean":"2023-12-01T15:59:31.213338+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T15:59:31.213338+0000","last_undegraded":"2023-12-01T15:59:31.213338+0000","last_fullsized":"2023-12-01T15:59:31.213338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3711,"num_write_kb":29795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"43'3508","reported_seq":2924,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.420142+0000","last_change":"2023-12-01T15:59:37.439759+0000","last_active":"2023-12-01T15:59:37.420142+0000","last_peered":"2023-12-01T15:59:37.420142+0000","last_clean":"2023-12-01T15:59:37.420142+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T15:59:37.420142+0000","last_undegraded":"2023-12-01T15:59:37.420142+0000","last_fullsized":"2023-12-01T15:59:37.420142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63296622700000005,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.15","version":"43'2457","reported_seq":2498,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.224645+0000","last_change":"2023-12-01T15:43:45.210538+0000","last_active":"2023-12-01T15:59:37.224645+0000","last_peered":"2023-12-01T15:59:37.224645+0000","last_clean":"2023-12-01T15:59:37.224645+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T15:59:37.224645+0000","last_undegraded":"2023-12-01T15:59:37.224645+0000","last_fullsized":"2023-12-01T15:59:37.224645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2457,"log_dups_size":0,"ondisk_log_size":2457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2453,"num_write_kb":21278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"43'1339","reported_seq":1380,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.814374+0000","last_change":"2023-12-01T15:43:45.204325+0000","last_active":"2023-12-01T15:59:36.814374+0000","last_peered":"2023-12-01T15:59:36.814374+0000","last_clean":"2023-12-01T15:59:36.814374+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T15:59:36.814374+0000","last_undegraded":"2023-12-01T15:59:36.814374+0000","last_fullsized":"2023-12-01T15:59:36.814374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1339,"log_dups_size":0,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1338,"num_write_kb":26066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'3641","reported_seq":3001,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.099603+0000","last_change":"2023-12-01T15:59:36.952311+0000","last_active":"2023-12-01T15:59:37.099603+0000","last_peered":"2023-12-01T15:59:37.099603+0000","last_clean":"2023-12-01T15:59:37.099603+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T15:59:37.099603+0000","last_undegraded":"2023-12-01T15:59:37.099603+0000","last_fullsized":"2023-12-01T15:59:37.099603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:36.724287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13235097200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.17","version":"43'900","reported_seq":941,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.217107+0000","last_change":"2023-12-01T15:43:45.203624+0000","last_active":"2023-12-01T15:59:37.217107+0000","last_peered":"2023-12-01T15:59:37.217107+0000","last_clean":"2023-12-01T15:59:37.217107+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T15:59:37.217107+0000","last_undegraded":"2023-12-01T15:59:37.217107+0000","last_fullsized":"2023-12-01T15:59:37.217107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'3458","reported_seq":2866,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.382919+0000","last_change":"2023-12-01T15:59:37.396927+0000","last_active":"2023-12-01T15:59:37.382919+0000","last_peered":"2023-12-01T15:59:37.382919+0000","last_clean":"2023-12-01T15:59:37.382919+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:59:37.382919+0000","last_undegraded":"2023-12-01T15:59:37.382919+0000","last_fullsized":"2023-12-01T15:59:37.382919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3458,"log_dups_size":0,"ondisk_log_size":3458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.59367497300000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1187,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.1f","version":"43'3413","reported_seq":2906,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.115077+0000","last_change":"2023-12-01T15:59:36.971349+0000","last_active":"2023-12-01T15:59:37.115077+0000","last_peered":"2023-12-01T15:59:37.115077+0000","last_clean":"2023-12-01T15:59:37.115077+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:59:37.115077+0000","last_undegraded":"2023-12-01T15:59:37.115077+0000","last_fullsized":"2023-12-01T15:59:37.115077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:20.675396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17121966999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.18","version":"43'4973","reported_seq":5014,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.803258+0000","last_change":"2023-12-01T15:43:45.205650+0000","last_active":"2023-12-01T15:59:36.803258+0000","last_peered":"2023-12-01T15:59:36.803258+0000","last_clean":"2023-12-01T15:59:36.803258+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:59:36.803258+0000","last_undegraded":"2023-12-01T15:59:36.803258+0000","last_fullsized":"2023-12-01T15:59:36.803258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4973,"log_dups_size":0,"ondisk_log_size":4973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4962,"num_write_kb":39191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3226","reported_seq":2693,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.116439+0000","last_change":"2023-12-01T15:59:36.959488+0000","last_active":"2023-12-01T15:59:37.116439+0000","last_peered":"2023-12-01T15:59:37.116439+0000","last_clean":"2023-12-01T15:59:37.116439+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T15:59:37.116439+0000","last_undegraded":"2023-12-01T15:59:37.116439+0000","last_fullsized":"2023-12-01T15:59:37.116439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3226,"log_dups_size":0,"ondisk_log_size":3226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13751970099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.19","version":"36'490","reported_seq":531,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.388301+0000","last_change":"2023-12-01T15:43:45.200400+0000","last_active":"2023-12-01T15:59:28.388301+0000","last_peered":"2023-12-01T15:59:28.388301+0000","last_clean":"2023-12-01T15:59:28.388301+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:59:28.388301+0000","last_undegraded":"2023-12-01T15:59:28.388301+0000","last_fullsized":"2023-12-01T15:59:28.388301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":17875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'3421","reported_seq":2858,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.051612+0000","last_change":"2023-12-01T15:59:36.955244+0000","last_active":"2023-12-01T15:59:37.051612+0000","last_peered":"2023-12-01T15:59:37.051612+0000","last_clean":"2023-12-01T15:59:37.051612+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:59:37.051612+0000","last_undegraded":"2023-12-01T15:59:37.051612+0000","last_fullsized":"2023-12-01T15:59:37.051612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134588554,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"43'3616","reported_seq":3657,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.817642+0000","last_change":"2023-12-01T15:43:45.200975+0000","last_active":"2023-12-01T15:59:36.817642+0000","last_peered":"2023-12-01T15:59:36.817642+0000","last_clean":"2023-12-01T15:59:36.817642+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:59:36.817642+0000","last_undegraded":"2023-12-01T15:59:36.817642+0000","last_fullsized":"2023-12-01T15:59:36.817642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3616,"log_dups_size":0,"ondisk_log_size":3616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3601,"num_write_kb":33849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"43'3891","reported_seq":3214,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.471375+0000","last_change":"2023-12-01T15:59:37.485420+0000","last_active":"2023-12-01T15:59:37.471375+0000","last_peered":"2023-12-01T15:59:37.471375+0000","last_clean":"2023-12-01T15:59:37.471375+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T15:59:37.471375+0000","last_undegraded":"2023-12-01T15:59:37.471375+0000","last_fullsized":"2023-12-01T15:59:37.471375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3891,"log_dups_size":0,"ondisk_log_size":3891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65050901000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1b","version":"40'2098","reported_seq":2139,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.584412+0000","last_change":"2023-12-01T15:43:45.208899+0000","last_active":"2023-12-01T15:59:28.584412+0000","last_peered":"2023-12-01T15:59:28.584412+0000","last_clean":"2023-12-01T15:59:28.584412+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T15:59:28.584412+0000","last_undegraded":"2023-12-01T15:59:28.584412+0000","last_fullsized":"2023-12-01T15:59:28.584412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2089,"num_write_kb":16989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"43'3665","reported_seq":3073,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.912047+0000","last_change":"2023-12-01T15:59:36.912047+0000","last_active":"2023-12-01T15:59:36.912047+0000","last_peered":"2023-12-01T15:59:36.912047+0000","last_clean":"2023-12-01T15:59:36.912047+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T15:59:36.912047+0000","last_undegraded":"2023-12-01T15:59:36.912047+0000","last_fullsized":"2023-12-01T15:59:36.912047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.084960400000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1169,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1c","version":"43'637","reported_seq":678,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.321599+0000","last_change":"2023-12-01T15:43:45.203471+0000","last_active":"2023-12-01T15:59:37.321599+0000","last_peered":"2023-12-01T15:59:37.321599+0000","last_clean":"2023-12-01T15:59:37.321599+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T15:59:37.321599+0000","last_undegraded":"2023-12-01T15:59:37.321599+0000","last_fullsized":"2023-12-01T15:59:37.321599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1876097,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":640,"num_write_kb":6069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"43'3570","reported_seq":2963,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.129073+0000","last_change":"2023-12-01T15:59:36.912038+0000","last_active":"2023-12-01T15:59:37.129073+0000","last_peered":"2023-12-01T15:59:37.129073+0000","last_clean":"2023-12-01T15:59:37.129073+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:59:37.129073+0000","last_undegraded":"2023-12-01T15:59:37.129073+0000","last_fullsized":"2023-12-01T15:59:37.129073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.094045403999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"36'5936","reported_seq":5977,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.533385+0000","last_change":"2023-12-01T15:43:45.208222+0000","last_active":"2023-12-01T15:59:28.533385+0000","last_peered":"2023-12-01T15:59:28.533385+0000","last_clean":"2023-12-01T15:59:28.533385+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:59:28.533385+0000","last_undegraded":"2023-12-01T15:59:28.533385+0000","last_fullsized":"2023-12-01T15:59:28.533385+0000","mapping_epoch":16,"log_start":"21'300","ondisk_log_start":"21'300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":5636,"log_dups_size":0,"ondisk_log_size":5636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5940,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'3525","reported_seq":2985,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.125486+0000","last_change":"2023-12-01T15:59:36.954665+0000","last_active":"2023-12-01T15:59:37.125486+0000","last_peered":"2023-12-01T15:59:37.125486+0000","last_clean":"2023-12-01T15:59:37.125486+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:59:37.125486+0000","last_undegraded":"2023-12-01T15:59:37.125486+0000","last_fullsized":"2023-12-01T15:59:37.125486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134288985,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1e","version":"39'3426","reported_seq":3468,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.584478+0000","last_change":"2023-12-01T15:43:45.208256+0000","last_active":"2023-12-01T15:59:28.584478+0000","last_peered":"2023-12-01T15:59:28.584478+0000","last_clean":"2023-12-01T15:59:28.584478+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T15:59:28.584478+0000","last_undegraded":"2023-12-01T15:59:28.584478+0000","last_fullsized":"2023-12-01T15:59:28.584478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3411,"num_write_kb":30086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'4049","reported_seq":3327,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.182492+0000","last_change":"2023-12-01T15:59:36.912664+0000","last_active":"2023-12-01T15:59:37.182492+0000","last_peered":"2023-12-01T15:59:37.182492+0000","last_clean":"2023-12-01T15:59:37.182492+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:59:37.182492+0000","last_undegraded":"2023-12-01T15:59:37.182492+0000","last_fullsized":"2023-12-01T15:59:37.182492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":4049,"log_dups_size":0,"ondisk_log_size":4049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.091841191000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1f","version":"39'1803","reported_seq":1845,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.585180+0000","last_change":"2023-12-01T15:43:45.204599+0000","last_active":"2023-12-01T15:59:28.585180+0000","last_peered":"2023-12-01T15:59:28.585180+0000","last_clean":"2023-12-01T15:59:28.585180+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T15:59:28.585180+0000","last_undegraded":"2023-12-01T15:59:28.585180+0000","last_fullsized":"2023-12-01T15:59:28.585180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1803,"log_dups_size":0,"ondisk_log_size":1803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1812,"num_write_kb":15324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":76140,"num_write_kb":40588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225506,"ondisk_log_size":225506,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":277867455,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":223,"num_read_kb":3419,"num_write":76829,"num_write_kb":641147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":555802624,"data_stored":555734910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76345,"ondisk_log_size":76345,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705861,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":682744,"kb_used_data":134064,"kb_used_omap":0,"kb_used_meta":548672,"kb_avail":93689096,"statfs":{"total":96636764160,"available":95937634304,"internally_reserved":0,"allocated":137281536,"data_stored":136927884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":561840128},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.68500000000000005,"15min":0.63400000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.1799999999999999,"5min":10.84,"15min":10.84},"last":0.627},{"interface":"front","average":{"1min":1.129,"5min":0.88900000000000001,"15min":0.70899999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":11.926,"5min":11.926,"15min":11.926},"last":0.75900000000000001}]},{"osd":1,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.71799999999999997,"15min":0.66800000000000004},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.246},"max":{"1min":0.77200000000000002,"5min":10.807,"15min":10.807},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":3.552,"5min":3.552,"15min":3.552},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.72699999999999998,"15min":0.63},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.8700000000000001,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.68000000000000005,"15min":0.64700000000000002},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.71599999999999997,"5min":10.715999999999999,"15min":10.715999999999999},"last":0.46100000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705862,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":801868,"kb_used_data":157252,"kb_used_omap":0,"kb_used_meta":644608,"kb_avail":93569972,"statfs":{"total":96636764160,"available":95815651328,"internally_reserved":0,"allocated":161026048,"data_stored":160664268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":660078592},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.23000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.798,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.60699999999999998,"15min":0.65500000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.84099999999999997,"5min":0.91200000000000003,"15min":2.657},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.68600000000000005,"15min":0.66300000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.8240000000000001,"5min":8.0779999999999994,"15min":8.0779999999999994},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.439,"5min":0.60799999999999998,"15min":0.627},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80500000000000005,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.53300000000000003,"15min":0.56499999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52200000000000002,"5min":2.048,"15min":7.5289999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.70799999999999996,"15min":0.67200000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.845,"5min":8.0370000000000008,"15min":9.8949999999999996},"last":0.42099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705861,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589232,"kb_used_data":98856,"kb_used_omap":0,"kb_used_meta":490368,"kb_avail":93782608,"statfs":{"total":96636764160,"available":96033390592,"internally_reserved":0,"allocated":101228544,"data_stored":100901390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502136832},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.45600000000000002,"15min":0.50800000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17299999999999999},"max":{"1min":0.73299999999999998,"5min":0.749,"15min":8.4589999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.22,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.7729999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63800000000000001,"15min":0.64500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.25900000000000001},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.501},{"interface":"front","average":{"1min":0.501,"5min":0.63,"15min":0.68300000000000005},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.754,"5min":2.6640000000000001,"15min":10.914999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.251},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.36699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":3.1539999999999999,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.62}]}]},{"osd":0,"up_from":9,"seq":38654705861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814556,"kb_used_data":155988,"kb_used_omap":0,"kb_used_meta":658560,"kb_avail":93557284,"statfs":{"total":96636764160,"available":95802658816,"internally_reserved":0,"allocated":159731712,"data_stored":159382664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":674365440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47399999999999998,"15min":0.49099999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.1890000000000001,"5min":1.595,"15min":1.595},"last":0.502},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.51800000000000002,"15min":0.623},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.70499999999999996,"5min":3.3639999999999999,"15min":30.995000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61399999999999999,"15min":0.73099999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":24.504000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.64600000000000002,"15min":0.76400000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":24.524999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64800000000000002,"15min":0.75600000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.859,"5min":2.859,"15min":31.038},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.63400000000000001,"15min":0.69799999999999995},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.95799999999999996,"15min":7.9420000000000002},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":158564352,"data_stored":158550118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":160452608,"data_stored":160426146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":136122368,"data_stored":136095350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T15:59:42.599 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-01T15:59:42.600 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T15:59:42.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090ffff700 1 Processor -- start 2023-12-01T15:59:42.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090ffff700 1 -- start start 2023-12-01T15:59:42.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0910131390 0x7f0910131770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090ffff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100705e0 con 0x7f091006dbf0 2023-12-01T15:59:42.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090ffff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0910071d90 con 0x7f091006e760 2023-12-01T15:59:42.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090ffff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091006f150 con 0x7f0910131390 2023-12-01T15:59:42.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090e7fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f091006dbf0 0x7f091006e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45180/0 (socket says 172.21.15.63:45180) 2023-12-01T15:59:42.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090e7fc700 1 -- 172.21.15.63:0/2384675862 learned_addr learned my addr 172.21.15.63:0/2384675862 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:42.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090effd700 1 --2- 172.21.15.63:0/2384675862 >> v2:172.21.15.63:3300/0 conn(0x7f0910131390 0x7f0910131770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090dffb700 1 -- 172.21.15.63:0/2384675862 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213579112 0 0) 0x7f09100705e0 con 0x7f091006dbf0 2023-12-01T15:59:42.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090dffb700 1 -- 172.21.15.63:0/2384675862 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc0035d0 con 0x7f091006dbf0 2023-12-01T15:59:42.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090dffb700 1 -- 172.21.15.63:0/2384675862 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548567207 0 0) 0x7f0910071d90 con 0x7f091006e760 2023-12-01T15:59:42.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090effd700 1 -- 172.21.15.63:0/2384675862 >> v1:172.21.15.66:6789/0 conn(0x7f091006e760 legacy=0x7f091013f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090effd700 1 -- 172.21.15.63:0/2384675862 >> v1:172.21.15.63:6789/0 conn(0x7f091006dbf0 legacy=0x7f091006e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.700+0000 7f090effd700 1 -- 172.21.15.63:0/2384675862 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100708b0 con 0x7f0910131390 2023-12-01T15:59:42.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090effd700 1 --2- 172.21.15.63:0/2384675862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0910131390 0x7f0910131770 secure :-1 s=READY pgs=2929 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009850 tx=0x7f08f8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c34f0ab7e761521 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:42.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090dffb700 1 -- 172.21.15.63:0/2384675862 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8011830 con 0x7f0910131390 2023-12-01T15:59:42.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090dffb700 1 -- 172.21.15.63:0/2384675862 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8011990 con 0x7f0910131390 2023-12-01T15:59:42.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090dffb700 1 -- 172.21.15.63:0/2384675862 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8011d00 con 0x7f0910131390 2023-12-01T15:59:42.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 -- 172.21.15.63:0/2384675862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0910131390 msgr2=0x7f0910131770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 --2- 172.21.15.63:0/2384675862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0910131390 0x7f0910131770 secure :-1 s=READY pgs=2929 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009850 tx=0x7f08f8009b60 comp rx=0 tx=0).stop 2023-12-01T15:59:42.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 -- 172.21.15.63:0/2384675862 shutdown_connections 2023-12-01T15:59:42.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 --2- 172.21.15.63:0/2384675862 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0910131390 0x7f0910131770 unknown :-1 s=CLOSED pgs=2929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 -- 172.21.15.63:0/2384675862 >> 172.21.15.63:0/2384675862 conn(0x7f09100a8bd0 msgr2=0x7f0910098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:42.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 -- 172.21.15.63:0/2384675862 shutdown_connections 2023-12-01T15:59:42.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 -- 172.21.15.63:0/2384675862 wait complete. 2023-12-01T15:59:42.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 Processor -- start 2023-12-01T15:59:42.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 -- start start 2023-12-01T15:59:42.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f091006dbf0 0x7f09101cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f091006e760 0x7f09101cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0910131390 0x7f09101cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910137310 con 0x7f0910131390 2023-12-01T15:59:42.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09101377e0 con 0x7f091006dbf0 2023-12-01T15:59:42.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09100a0830 con 0x7f091006e760 2023-12-01T15:59:42.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0910131390 0x7f09101cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0910131390 0x7f09101cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38560/0 (socket says 172.21.15.63:38560) 2023-12-01T15:59:42.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090f7fe700 1 -- 172.21.15.63:0/3277098605 learned_addr learned my addr 172.21.15.63:0/3277098605 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:42.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090e7fc700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f091006e760 0x7f09101cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090effd700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f091006dbf0 0x7f09101cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090f7fe700 1 -- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f091006e760 msgr2=0x7f09101cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090f7fe700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f091006e760 0x7f09101cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090f7fe700 1 -- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f091006dbf0 msgr2=0x7f09101cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090f7fe700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f091006dbf0 0x7f09101cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090f7fe700 1 -- 172.21.15.63:0/3277098605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80094b0 con 0x7f0910131390 2023-12-01T15:59:42.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.704+0000 7f090effd700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f091006dbf0 0x7f09101cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:59:42.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.708+0000 7f090f7fe700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0910131390 0x7f09101cfae0 secure :-1 s=READY pgs=2930 cs=0 l=1 rev1=1 crypto rx=0x7f090800c490 tx=0x7f090800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:42.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.708+0000 7f0907fff700 1 -- 172.21.15.63:0/3277098605 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080054e0 con 0x7f0910131390 2023-12-01T15:59:42.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.708+0000 7f0907fff700 1 -- 172.21.15.63:0/3277098605 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09080036a0 con 0x7f0910131390 2023-12-01T15:59:42.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.708+0000 7f090ffff700 1 -- 172.21.15.63:0/3277098605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0910137a10 con 0x7f0910131390 2023-12-01T15:59:42.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.708+0000 7f0907fff700 1 -- 172.21.15.63:0/3277098605 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908003a50 con 0x7f0910131390 2023-12-01T15:59:42.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.708+0000 7f090ffff700 1 -- 172.21.15.63:0/3277098605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0910136750 con 0x7f0910131390 2023-12-01T15:59:42.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.708+0000 7f090ffff700 1 -- 172.21.15.63:0/3277098605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0910065fb0 con 0x7f0910131390 2023-12-01T15:59:42.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.708+0000 7f0907fff700 1 -- 172.21.15.63:0/3277098605 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0908003bb0 con 0x7f0910131390 2023-12-01T15:59:42.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.708+0000 7f0907fff700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065ad0 0x7f08f0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:42.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.708+0000 7f0907fff700 1 -- 172.21.15.63:0/3277098605 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f0908081fe0 con 0x7f0910131390 2023-12-01T15:59:42.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.708+0000 7f090effd700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065ad0 0x7f08f0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:42.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.712+0000 7f090effd700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065ad0 0x7f08f0067f90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08f8000c00 tx=0x7f08f8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:42.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.716+0000 7f0907fff700 1 -- 172.21.15.63:0/3277098605 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f090804ff30 con 0x7f0910131390 2023-12-01T15:59:42.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.876+0000 7f090ffff700 1 -- 172.21.15.63:0/3277098605 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09100723e0 con 0x7f08f0065ad0 2023-12-01T15:59:42.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.896+0000 7f0907fff700 1 -- 172.21.15.63:0/3277098605 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281340 (secure 0 0 0) 0x7f08f8004040 con 0x7f08f0065ad0 2023-12-01T15:59:42.913 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:59:42.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 -- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065ad0 msgr2=0x7f08f0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065ad0 0x7f08f0067f90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08f8000c00 tx=0x7f08f8008030 comp rx=0 tx=0).stop 2023-12-01T15:59:42.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 -- 172.21.15.63:0/3277098605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0910131390 msgr2=0x7f09101cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:42.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0910131390 0x7f09101cfae0 secure :-1 s=READY pgs=2930 cs=0 l=1 rev1=1 crypto rx=0x7f090800c490 tx=0x7f090800c7a0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 -- 172.21.15.63:0/3277098605 shutdown_connections 2023-12-01T15:59:42.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f08f0065ad0 0x7f08f0067f90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f091006e760 0x7f09101cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0910131390 0x7f09101cfae0 unknown :-1 s=CLOSED pgs=2930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 --2- 172.21.15.63:0/3277098605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f091006dbf0 0x7f09101cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:42.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 -- 172.21.15.63:0/3277098605 >> 172.21.15.63:0/3277098605 conn(0x7f09100a8bd0 msgr2=0x7f09100a5570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:42.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 -- 172.21.15.63:0/3277098605 shutdown_connections 2023-12-01T15:59:42.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:42.900+0000 7f090ffff700 1 -- 172.21.15.63:0/3277098605 wait complete. 2023-12-01T15:59:42.917 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T15:59:42.930 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":524,"stamp":"2023-12-01T15:59:42.701039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":278585011,"num_objects":242,"num_object_clones":28,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":15,"num_read":370,"num_read_kb":3540,"num_write":153128,"num_write_kb":684151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301968,"ondisk_log_size":301968,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":2888400,"kb_used_data":546160,"kb_used_omap":0,"kb_used_meta":2342208,"kb_avail":374598960,"statfs":{"total":386547056640,"available":383589335040,"internally_reserved":0,"allocated":559267840,"data_stored":557876206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2398420992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1935099,"num_objects":7,"num_object_clones":3,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":3,"num_read":6,"num_read_kb":7,"num_write":126,"num_write_kb":1962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003455"},"pg_stats":[{"pgid":"4.3f","version":"43'3303","reported_seq":2796,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.134377+0000","last_change":"2023-12-01T15:59:36.960583+0000","last_active":"2023-12-01T15:59:37.134377+0000","last_peered":"2023-12-01T15:59:37.134377+0000","last_clean":"2023-12-01T15:59:37.134377+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:59:37.134377+0000","last_undegraded":"2023-12-01T15:59:37.134377+0000","last_fullsized":"2023-12-01T15:59:37.134377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13670799,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3e","version":"43'3496","reported_seq":2953,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.094520+0000","last_change":"2023-12-01T15:59:36.899161+0000","last_active":"2023-12-01T15:59:37.094520+0000","last_peered":"2023-12-01T15:59:37.094520+0000","last_clean":"2023-12-01T15:59:37.094520+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T15:59:37.094520+0000","last_undegraded":"2023-12-01T15:59:37.094520+0000","last_fullsized":"2023-12-01T15:59:37.094520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.085048589999999993,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3d","version":"43'3434","reported_seq":2894,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181268+0000","last_change":"2023-12-01T15:59:36.980200+0000","last_active":"2023-12-01T15:59:37.181268+0000","last_peered":"2023-12-01T15:59:37.181268+0000","last_clean":"2023-12-01T15:59:37.181268+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:59:37.181268+0000","last_undegraded":"2023-12-01T15:59:37.181268+0000","last_fullsized":"2023-12-01T15:59:37.181268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:52:46.242732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15483981599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3c","version":"43'3687","reported_seq":3037,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.088442+0000","last_change":"2023-12-01T15:59:36.901834+0000","last_active":"2023-12-01T15:59:37.088442+0000","last_peered":"2023-12-01T15:59:37.088442+0000","last_clean":"2023-12-01T15:59:37.088442+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:59:37.088442+0000","last_undegraded":"2023-12-01T15:59:37.088442+0000","last_fullsized":"2023-12-01T15:59:37.088442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3687,"log_dups_size":0,"ondisk_log_size":3687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086572531999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3b","version":"43'3485","reported_seq":2915,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.097685+0000","last_change":"2023-12-01T15:59:36.962909+0000","last_active":"2023-12-01T15:59:37.097685+0000","last_peered":"2023-12-01T15:59:37.097685+0000","last_clean":"2023-12-01T15:59:37.097685+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T15:59:37.097685+0000","last_undegraded":"2023-12-01T15:59:37.097685+0000","last_fullsized":"2023-12-01T15:59:37.097685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13014335599999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3a","version":"43'3419","reported_seq":2858,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.179968+0000","last_change":"2023-12-01T15:59:36.980233+0000","last_active":"2023-12-01T15:59:37.179968+0000","last_peered":"2023-12-01T15:59:37.179968+0000","last_clean":"2023-12-01T15:59:37.179968+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T15:59:37.179968+0000","last_undegraded":"2023-12-01T15:59:37.179968+0000","last_fullsized":"2023-12-01T15:59:37.179968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.133828119,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.39","version":"43'3764","reported_seq":3216,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.089165+0000","last_change":"2023-12-01T15:59:36.977002+0000","last_active":"2023-12-01T15:59:37.089165+0000","last_peered":"2023-12-01T15:59:37.089165+0000","last_clean":"2023-12-01T15:59:37.089165+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T15:59:37.089165+0000","last_undegraded":"2023-12-01T15:59:37.089165+0000","last_fullsized":"2023-12-01T15:59:37.089165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3764,"log_dups_size":0,"ondisk_log_size":3764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16251290900000001,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.38","version":"43'3433","reported_seq":2835,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.154788+0000","last_change":"2023-12-01T15:59:36.975843+0000","last_active":"2023-12-01T15:59:37.154788+0000","last_peered":"2023-12-01T15:59:37.154788+0000","last_clean":"2023-12-01T15:59:37.154788+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:59:37.154788+0000","last_undegraded":"2023-12-01T15:59:37.154788+0000","last_fullsized":"2023-12-01T15:59:37.154788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3433,"log_dups_size":0,"ondisk_log_size":3433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:31:59.832465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.173046373,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.37","version":"43'3524","reported_seq":2940,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.134223+0000","last_change":"2023-12-01T15:59:36.960250+0000","last_active":"2023-12-01T15:59:37.134223+0000","last_peered":"2023-12-01T15:59:37.134223+0000","last_clean":"2023-12-01T15:59:37.134223+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:59:37.134223+0000","last_undegraded":"2023-12-01T15:59:37.134223+0000","last_fullsized":"2023-12-01T15:59:37.134223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13648046599999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.36","version":"43'3320","reported_seq":2807,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.116703+0000","last_change":"2023-12-01T15:59:36.978454+0000","last_active":"2023-12-01T15:59:37.116703+0000","last_peered":"2023-12-01T15:59:37.116703+0000","last_clean":"2023-12-01T15:59:37.116703+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:59:37.116703+0000","last_undegraded":"2023-12-01T15:59:37.116703+0000","last_fullsized":"2023-12-01T15:59:37.116703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:00:15.540017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.160523057,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.35","version":"43'3407","reported_seq":2866,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.128890+0000","last_change":"2023-12-01T15:59:36.894457+0000","last_active":"2023-12-01T15:59:37.128890+0000","last_peered":"2023-12-01T15:59:37.128890+0000","last_clean":"2023-12-01T15:59:37.128890+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:59:37.128890+0000","last_undegraded":"2023-12-01T15:59:37.128890+0000","last_fullsized":"2023-12-01T15:59:37.128890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3407,"log_dups_size":0,"ondisk_log_size":3407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.080275320999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.34","version":"43'3529","reported_seq":2900,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.462843+0000","last_change":"2023-12-01T15:59:37.474340+0000","last_active":"2023-12-01T15:59:37.462843+0000","last_peered":"2023-12-01T15:59:37.462843+0000","last_clean":"2023-12-01T15:59:37.462843+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T15:59:37.462843+0000","last_undegraded":"2023-12-01T15:59:37.462843+0000","last_fullsized":"2023-12-01T15:59:37.462843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63957533600000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.33","version":"43'3178","reported_seq":2647,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.098108+0000","last_change":"2023-12-01T15:59:36.959529+0000","last_active":"2023-12-01T15:59:37.098108+0000","last_peered":"2023-12-01T15:59:37.098108+0000","last_clean":"2023-12-01T15:59:37.098108+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T15:59:37.098108+0000","last_undegraded":"2023-12-01T15:59:37.098108+0000","last_fullsized":"2023-12-01T15:59:37.098108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3178,"log_dups_size":0,"ondisk_log_size":3178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138334033,"stat_sum":{"num_bytes":12297,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.32","version":"43'3508","reported_seq":2930,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.113502+0000","last_change":"2023-12-01T15:59:36.908392+0000","last_active":"2023-12-01T15:59:37.113502+0000","last_peered":"2023-12-01T15:59:37.113502+0000","last_clean":"2023-12-01T15:59:37.113502+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T15:59:37.113502+0000","last_undegraded":"2023-12-01T15:59:37.113502+0000","last_fullsized":"2023-12-01T15:59:37.113502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.091404182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.31","version":"43'3600","reported_seq":3005,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.128107+0000","last_change":"2023-12-01T15:59:36.901530+0000","last_active":"2023-12-01T15:59:37.128107+0000","last_peered":"2023-12-01T15:59:37.128107+0000","last_clean":"2023-12-01T15:59:37.128107+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:37.128107+0000","last_undegraded":"2023-12-01T15:59:37.128107+0000","last_fullsized":"2023-12-01T15:59:37.128107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086861997999999996,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1247,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.30","version":"43'3533","reported_seq":2940,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.132837+0000","last_change":"2023-12-01T15:59:36.976205+0000","last_active":"2023-12-01T15:59:37.132837+0000","last_peered":"2023-12-01T15:59:37.132837+0000","last_clean":"2023-12-01T15:59:37.132837+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T15:59:37.132837+0000","last_undegraded":"2023-12-01T15:59:37.132837+0000","last_fullsized":"2023-12-01T15:59:37.132837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3533,"log_dups_size":0,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:23.641161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17327173600000001,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2f","version":"43'3588","reported_seq":2962,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.134083+0000","last_change":"2023-12-01T15:59:36.959847+0000","last_active":"2023-12-01T15:59:37.134083+0000","last_peered":"2023-12-01T15:59:37.134083+0000","last_clean":"2023-12-01T15:59:37.134083+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T15:59:37.134083+0000","last_undegraded":"2023-12-01T15:59:37.134083+0000","last_fullsized":"2023-12-01T15:59:37.134083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13630616600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2e","version":"43'3282","reported_seq":2782,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.131272+0000","last_change":"2023-12-01T15:59:36.977461+0000","last_active":"2023-12-01T15:59:37.131272+0000","last_peered":"2023-12-01T15:59:37.131272+0000","last_clean":"2023-12-01T15:59:37.131272+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T15:59:37.131272+0000","last_undegraded":"2023-12-01T15:59:37.131272+0000","last_fullsized":"2023-12-01T15:59:37.131272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:46:31.135544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.159652814,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1044,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2d","version":"43'3337","reported_seq":2775,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.127501+0000","last_change":"2023-12-01T15:59:36.954938+0000","last_active":"2023-12-01T15:59:37.127501+0000","last_peered":"2023-12-01T15:59:37.127501+0000","last_clean":"2023-12-01T15:59:37.127501+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T15:59:37.127501+0000","last_undegraded":"2023-12-01T15:59:37.127501+0000","last_fullsized":"2023-12-01T15:59:37.127501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134439324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2c","version":"43'3655","reported_seq":3089,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.095700+0000","last_change":"2023-12-01T15:59:36.963898+0000","last_active":"2023-12-01T15:59:37.095700+0000","last_peered":"2023-12-01T15:59:37.095700+0000","last_clean":"2023-12-01T15:59:37.095700+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:59:37.095700+0000","last_undegraded":"2023-12-01T15:59:37.095700+0000","last_fullsized":"2023-12-01T15:59:37.095700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3655,"log_dups_size":0,"ondisk_log_size":3655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:50.215328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16502647100000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2b","version":"43'3592","reported_seq":3027,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.148002+0000","last_change":"2023-12-01T15:59:36.908706+0000","last_active":"2023-12-01T15:59:37.148002+0000","last_peered":"2023-12-01T15:59:37.148002+0000","last_clean":"2023-12-01T15:59:37.148002+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T15:59:37.148002+0000","last_undegraded":"2023-12-01T15:59:37.148002+0000","last_fullsized":"2023-12-01T15:59:37.148002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.082049368999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2a","version":"43'3494","reported_seq":2865,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.072178+0000","last_change":"2023-12-01T15:59:36.954854+0000","last_active":"2023-12-01T15:59:37.072178+0000","last_peered":"2023-12-01T15:59:37.072178+0000","last_clean":"2023-12-01T15:59:37.072178+0000","last_became_active":"2023-12-01T15:44:30.528283+0000","last_became_peered":"2023-12-01T15:44:30.528283+0000","last_unstale":"2023-12-01T15:59:37.072178+0000","last_undegraded":"2023-12-01T15:59:37.072178+0000","last_fullsized":"2023-12-01T15:59:37.072178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3494,"log_dups_size":0,"ondisk_log_size":3494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:49:07.227935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13495370100000001,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.29","version":"43'3466","reported_seq":2921,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.421995+0000","last_change":"2023-12-01T15:59:37.440864+0000","last_active":"2023-12-01T15:59:37.421995+0000","last_peered":"2023-12-01T15:59:37.421995+0000","last_clean":"2023-12-01T15:59:37.421995+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T15:59:37.421995+0000","last_undegraded":"2023-12-01T15:59:37.421995+0000","last_fullsized":"2023-12-01T15:59:37.421995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3466,"log_dups_size":0,"ondisk_log_size":3466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.62816057700000005,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.28","version":"43'3577","reported_seq":2946,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.126385+0000","last_change":"2023-12-01T15:59:36.976374+0000","last_active":"2023-12-01T15:59:37.126385+0000","last_peered":"2023-12-01T15:59:37.126385+0000","last_clean":"2023-12-01T15:59:37.126385+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:59:37.126385+0000","last_undegraded":"2023-12-01T15:59:37.126385+0000","last_fullsized":"2023-12-01T15:59:37.126385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:16:11.702379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17330785400000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.27","version":"43'3344","reported_seq":2820,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.440997+0000","last_change":"2023-12-01T15:59:37.452527+0000","last_active":"2023-12-01T15:59:37.440997+0000","last_peered":"2023-12-01T15:59:37.440997+0000","last_clean":"2023-12-01T15:59:37.440997+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T15:59:37.440997+0000","last_undegraded":"2023-12-01T15:59:37.440997+0000","last_fullsized":"2023-12-01T15:59:37.440997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63729295699999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.26","version":"43'3411","reported_seq":2861,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.414457+0000","last_change":"2023-12-01T15:59:37.421961+0000","last_active":"2023-12-01T15:59:37.414457+0000","last_peered":"2023-12-01T15:59:37.414457+0000","last_clean":"2023-12-01T15:59:37.414457+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T15:59:37.414457+0000","last_undegraded":"2023-12-01T15:59:37.414457+0000","last_fullsized":"2023-12-01T15:59:37.414457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3411,"log_dups_size":0,"ondisk_log_size":3411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.611917673,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.25","version":"43'3312","reported_seq":2736,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.180983+0000","last_change":"2023-12-01T15:59:36.980913+0000","last_active":"2023-12-01T15:59:37.180983+0000","last_peered":"2023-12-01T15:59:37.180983+0000","last_clean":"2023-12-01T15:59:37.180983+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T15:59:37.180983+0000","last_undegraded":"2023-12-01T15:59:37.180983+0000","last_fullsized":"2023-12-01T15:59:37.180983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:34:06.793940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.146734475,"stat_sum":{"num_bytes":4116,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.24","version":"43'3312","reported_seq":2770,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.481996+0000","last_change":"2023-12-01T15:59:37.489547+0000","last_active":"2023-12-01T15:59:37.481996+0000","last_peered":"2023-12-01T15:59:37.481996+0000","last_clean":"2023-12-01T15:59:37.481996+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T15:59:37.481996+0000","last_undegraded":"2023-12-01T15:59:37.481996+0000","last_fullsized":"2023-12-01T15:59:37.481996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65414528699999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.23","version":"43'3662","reported_seq":3036,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.146827+0000","last_change":"2023-12-01T15:59:36.959770+0000","last_active":"2023-12-01T15:59:37.146827+0000","last_peered":"2023-12-01T15:59:37.146827+0000","last_clean":"2023-12-01T15:59:37.146827+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T15:59:37.146827+0000","last_undegraded":"2023-12-01T15:59:37.146827+0000","last_fullsized":"2023-12-01T15:59:37.146827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13835824199999999,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.22","version":"43'3520","reported_seq":2989,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181386+0000","last_change":"2023-12-01T15:59:36.981606+0000","last_active":"2023-12-01T15:59:37.181386+0000","last_peered":"2023-12-01T15:59:37.181386+0000","last_clean":"2023-12-01T15:59:37.181386+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:59:37.181386+0000","last_undegraded":"2023-12-01T15:59:37.181386+0000","last_fullsized":"2023-12-01T15:59:37.181386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3520,"log_dups_size":0,"ondisk_log_size":3520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13490588100000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.21","version":"43'3994","reported_seq":3317,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.460079+0000","last_change":"2023-12-01T15:59:37.471324+0000","last_active":"2023-12-01T15:59:37.460079+0000","last_peered":"2023-12-01T15:59:37.460079+0000","last_clean":"2023-12-01T15:59:37.460079+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T15:59:37.460079+0000","last_undegraded":"2023-12-01T15:59:37.460079+0000","last_fullsized":"2023-12-01T15:59:37.460079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3994,"log_dups_size":0,"ondisk_log_size":3994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65412195699999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.20","version":"43'3592","reported_seq":2992,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.179485+0000","last_change":"2023-12-01T15:59:36.911013+0000","last_active":"2023-12-01T15:59:37.179485+0000","last_peered":"2023-12-01T15:59:37.179485+0000","last_clean":"2023-12-01T15:59:37.179485+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T15:59:37.179485+0000","last_undegraded":"2023-12-01T15:59:37.179485+0000","last_fullsized":"2023-12-01T15:59:37.179485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090414480000000005,"stat_sum":{"num_bytes":4118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.14","version":"43'3661","reported_seq":3059,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.474372+0000","last_change":"2023-12-01T15:59:37.481885+0000","last_active":"2023-12-01T15:59:37.474372+0000","last_peered":"2023-12-01T15:59:37.474372+0000","last_clean":"2023-12-01T15:59:37.474372+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:59:37.474372+0000","last_undegraded":"2023-12-01T15:59:37.474372+0000","last_fullsized":"2023-12-01T15:59:37.474372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3661,"log_dups_size":0,"ondisk_log_size":3661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.646838511,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.13","version":"39'2734","reported_seq":2775,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.532051+0000","last_change":"2023-12-01T15:43:45.205685+0000","last_active":"2023-12-01T15:59:28.532051+0000","last_peered":"2023-12-01T15:59:28.532051+0000","last_clean":"2023-12-01T15:59:28.532051+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T15:59:28.532051+0000","last_undegraded":"2023-12-01T15:59:28.532051+0000","last_fullsized":"2023-12-01T15:59:28.532051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2734,"log_dups_size":0,"ondisk_log_size":2734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2729,"num_write_kb":18350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"43'3426","reported_seq":2842,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.174019+0000","last_change":"2023-12-01T15:59:36.979597+0000","last_active":"2023-12-01T15:59:37.174019+0000","last_peered":"2023-12-01T15:59:37.174019+0000","last_clean":"2023-12-01T15:59:37.174019+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:59:37.174019+0000","last_undegraded":"2023-12-01T15:59:37.174019+0000","last_fullsized":"2023-12-01T15:59:37.174019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:53:22.216155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15458043599999999,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.12","version":"35'5","reported_seq":46,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.582381+0000","last_change":"2023-12-01T15:43:45.203521+0000","last_active":"2023-12-01T15:59:28.582381+0000","last_peered":"2023-12-01T15:59:28.582381+0000","last_clean":"2023-12-01T15:59:28.582381+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T15:59:28.582381+0000","last_undegraded":"2023-12-01T15:59:28.582381+0000","last_fullsized":"2023-12-01T15:59:28.582381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"43'3628","reported_seq":3075,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.097162+0000","last_change":"2023-12-01T15:59:36.960912+0000","last_active":"2023-12-01T15:59:37.097162+0000","last_peered":"2023-12-01T15:59:37.097162+0000","last_clean":"2023-12-01T15:59:37.097162+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:59:37.097162+0000","last_undegraded":"2023-12-01T15:59:37.097162+0000","last_fullsized":"2023-12-01T15:59:37.097162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13624631700000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.11","version":"43'1007","reported_seq":1048,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.814672+0000","last_change":"2023-12-01T15:43:45.205291+0000","last_active":"2023-12-01T15:59:36.814672+0000","last_peered":"2023-12-01T15:59:36.814672+0000","last_clean":"2023-12-01T15:59:36.814672+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T15:59:36.814672+0000","last_undegraded":"2023-12-01T15:59:36.814672+0000","last_fullsized":"2023-12-01T15:59:36.814672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":10007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"43'3451","reported_seq":2870,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.111236+0000","last_change":"2023-12-01T15:59:36.960049+0000","last_active":"2023-12-01T15:59:37.111236+0000","last_peered":"2023-12-01T15:59:37.111236+0000","last_clean":"2023-12-01T15:59:37.111236+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:59:37.111236+0000","last_undegraded":"2023-12-01T15:59:37.111236+0000","last_fullsized":"2023-12-01T15:59:37.111236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3451,"log_dups_size":0,"ondisk_log_size":3451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13638832000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.10","version":"42'1384","reported_seq":1425,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:32.209748+0000","last_change":"2023-12-01T15:43:45.207762+0000","last_active":"2023-12-01T15:59:32.209748+0000","last_peered":"2023-12-01T15:59:32.209748+0000","last_clean":"2023-12-01T15:59:32.209748+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T15:59:32.209748+0000","last_undegraded":"2023-12-01T15:59:32.209748+0000","last_fullsized":"2023-12-01T15:59:32.209748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1392,"num_write_kb":12529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'1276","reported_seq":1318,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:34.527920+0000","last_change":"2023-12-01T15:43:45.203999+0000","last_active":"2023-12-01T15:59:34.527920+0000","last_peered":"2023-12-01T15:59:34.527920+0000","last_clean":"2023-12-01T15:59:34.527920+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T15:59:34.527920+0000","last_undegraded":"2023-12-01T15:59:34.527920+0000","last_fullsized":"2023-12-01T15:59:34.527920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1276,"log_dups_size":0,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":12495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'3658","reported_seq":3044,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.154849+0000","last_change":"2023-12-01T15:59:36.976848+0000","last_active":"2023-12-01T15:59:37.154849+0000","last_peered":"2023-12-01T15:59:37.154849+0000","last_clean":"2023-12-01T15:59:37.154849+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:59:37.154849+0000","last_undegraded":"2023-12-01T15:59:37.154849+0000","last_fullsized":"2023-12-01T15:59:37.154849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:40:12.233063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.172903538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.e","version":"35'1240","reported_seq":1282,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.526561+0000","last_change":"2023-12-01T15:43:45.201303+0000","last_active":"2023-12-01T15:59:29.526561+0000","last_peered":"2023-12-01T15:59:29.526561+0000","last_clean":"2023-12-01T15:59:29.526561+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T15:59:29.526561+0000","last_undegraded":"2023-12-01T15:59:29.526561+0000","last_fullsized":"2023-12-01T15:59:29.526561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1238,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'3442","reported_seq":2867,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.080995+0000","last_change":"2023-12-01T15:59:36.906470+0000","last_active":"2023-12-01T15:59:37.080995+0000","last_peered":"2023-12-01T15:59:37.080995+0000","last_clean":"2023-12-01T15:59:37.080995+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:59:37.080995+0000","last_undegraded":"2023-12-01T15:59:37.080995+0000","last_fullsized":"2023-12-01T15:59:37.080995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3442,"log_dups_size":0,"ondisk_log_size":3442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090755167999999997,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1186,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.d","version":"39'4742","reported_seq":4784,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.481999+0000","last_change":"2023-12-01T15:43:45.207098+0000","last_active":"2023-12-01T15:59:29.481999+0000","last_peered":"2023-12-01T15:59:29.481999+0000","last_clean":"2023-12-01T15:59:29.481999+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T15:59:29.481999+0000","last_undegraded":"2023-12-01T15:59:29.481999+0000","last_fullsized":"2023-12-01T15:59:29.481999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4742,"log_dups_size":0,"ondisk_log_size":4742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4735,"num_write_kb":27522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'3359","reported_seq":2781,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.145987+0000","last_change":"2023-12-01T15:59:36.907684+0000","last_active":"2023-12-01T15:59:37.145987+0000","last_peered":"2023-12-01T15:59:37.145987+0000","last_clean":"2023-12-01T15:59:37.145987+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:59:37.145987+0000","last_undegraded":"2023-12-01T15:59:37.145987+0000","last_fullsized":"2023-12-01T15:59:37.145987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:32:00.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090274558000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.c","version":"36'1988","reported_seq":2030,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.481918+0000","last_change":"2023-12-01T15:43:45.206777+0000","last_active":"2023-12-01T15:59:29.481918+0000","last_peered":"2023-12-01T15:59:29.481918+0000","last_clean":"2023-12-01T15:59:29.481918+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T15:59:29.481918+0000","last_undegraded":"2023-12-01T15:59:29.481918+0000","last_fullsized":"2023-12-01T15:59:29.481918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1988,"log_dups_size":0,"ondisk_log_size":1988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1987,"num_write_kb":25538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"43'3403","reported_seq":2894,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.112373+0000","last_change":"2023-12-01T15:59:36.962413+0000","last_active":"2023-12-01T15:59:37.112373+0000","last_peered":"2023-12-01T15:59:37.112373+0000","last_clean":"2023-12-01T15:59:37.112373+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:59:37.112373+0000","last_undegraded":"2023-12-01T15:59:37.112373+0000","last_fullsized":"2023-12-01T15:59:37.112373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13034463499999999,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1138,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.b","version":"39'4348","reported_seq":4390,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.931337+0000","last_change":"2023-12-01T15:43:45.204182+0000","last_active":"2023-12-01T15:59:29.931337+0000","last_peered":"2023-12-01T15:59:29.931337+0000","last_clean":"2023-12-01T15:59:29.931337+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T15:59:29.931337+0000","last_undegraded":"2023-12-01T15:59:29.931337+0000","last_fullsized":"2023-12-01T15:59:29.931337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4348,"log_dups_size":0,"ondisk_log_size":4348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4337,"num_write_kb":30065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"43'3797","reported_seq":3176,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.094738+0000","last_change":"2023-12-01T15:59:36.966407+0000","last_active":"2023-12-01T15:59:37.094738+0000","last_peered":"2023-12-01T15:59:37.094738+0000","last_clean":"2023-12-01T15:59:37.094738+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T15:59:37.094738+0000","last_undegraded":"2023-12-01T15:59:37.094738+0000","last_fullsized":"2023-12-01T15:59:37.094738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.165714477,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.a","version":"41'2491","reported_seq":2533,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531502+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:59:28.531502+0000","last_peered":"2023-12-01T15:59:28.531502+0000","last_clean":"2023-12-01T15:59:28.531502+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:59:28.531502+0000","last_undegraded":"2023-12-01T15:59:28.531502+0000","last_fullsized":"2023-12-01T15:59:28.531502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2491,"log_dups_size":0,"ondisk_log_size":2491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2494,"num_write_kb":26915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'3462","reported_seq":2929,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181399+0000","last_change":"2023-12-01T15:59:36.980979+0000","last_active":"2023-12-01T15:59:37.181399+0000","last_peered":"2023-12-01T15:59:37.181399+0000","last_clean":"2023-12-01T15:59:37.181399+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:59:37.181399+0000","last_undegraded":"2023-12-01T15:59:37.181399+0000","last_fullsized":"2023-12-01T15:59:37.181399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:51.219271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15615646,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1160,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.9","version":"40'2352","reported_seq":2394,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531275+0000","last_change":"2023-12-01T15:43:45.206261+0000","last_active":"2023-12-01T15:59:28.531275+0000","last_peered":"2023-12-01T15:59:28.531275+0000","last_clean":"2023-12-01T15:59:28.531275+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T15:59:28.531275+0000","last_undegraded":"2023-12-01T15:59:28.531275+0000","last_fullsized":"2023-12-01T15:59:28.531275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2354,"num_write_kb":17078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'3597","reported_seq":2980,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.098070+0000","last_change":"2023-12-01T15:59:36.901256+0000","last_active":"2023-12-01T15:59:37.098070+0000","last_peered":"2023-12-01T15:59:37.098070+0000","last_clean":"2023-12-01T15:59:37.098070+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T15:59:37.098070+0000","last_undegraded":"2023-12-01T15:59:37.098070+0000","last_fullsized":"2023-12-01T15:59:37.098070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086977656,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.8","version":"36'1538","reported_seq":1580,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.387769+0000","last_change":"2023-12-01T15:43:45.200481+0000","last_active":"2023-12-01T15:59:28.387769+0000","last_peered":"2023-12-01T15:59:28.387769+0000","last_clean":"2023-12-01T15:59:28.387769+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T15:59:28.387769+0000","last_undegraded":"2023-12-01T15:59:28.387769+0000","last_fullsized":"2023-12-01T15:59:28.387769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1538,"log_dups_size":0,"ondisk_log_size":1538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1538,"num_write_kb":10132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3475","reported_seq":2901,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.447779+0000","last_change":"2023-12-01T15:59:37.462768+0000","last_active":"2023-12-01T15:59:37.447779+0000","last_peered":"2023-12-01T15:59:37.447779+0000","last_clean":"2023-12-01T15:59:37.447779+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:59:37.447779+0000","last_undegraded":"2023-12-01T15:59:37.447779+0000","last_fullsized":"2023-12-01T15:59:37.447779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.64740572200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"12'117","reported_seq":198,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531461+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:59:28.531461+0000","last_peered":"2023-12-01T15:59:28.531461+0000","last_clean":"2023-12-01T15:59:28.531461+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:59:28.531461+0000","last_undegraded":"2023-12-01T15:59:28.531461+0000","last_fullsized":"2023-12-01T15:59:28.531461+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:09:18.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.532269+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:59:28.532269+0000","last_peered":"2023-12-01T15:59:28.532269+0000","last_clean":"2023-12-01T15:59:28.532269+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:59:28.532269+0000","last_undegraded":"2023-12-01T15:59:28.532269+0000","last_fullsized":"2023-12-01T15:59:28.532269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:10:37.881379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"39'4414","reported_seq":4456,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.389387+0000","last_change":"2023-12-01T15:43:45.201766+0000","last_active":"2023-12-01T15:59:28.389387+0000","last_peered":"2023-12-01T15:59:28.389387+0000","last_clean":"2023-12-01T15:59:28.389387+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T15:59:28.389387+0000","last_undegraded":"2023-12-01T15:59:28.389387+0000","last_fullsized":"2023-12-01T15:59:28.389387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4414,"log_dups_size":0,"ondisk_log_size":4414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4406,"num_write_kb":30219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"43'3657","reported_seq":3067,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.181820+0000","last_change":"2023-12-01T15:59:36.978939+0000","last_active":"2023-12-01T15:59:37.181820+0000","last_peered":"2023-12-01T15:59:37.181820+0000","last_clean":"2023-12-01T15:59:37.181820+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:59:37.181820+0000","last_undegraded":"2023-12-01T15:59:37.181820+0000","last_fullsized":"2023-12-01T15:59:37.181820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3657,"log_dups_size":0,"ondisk_log_size":3657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.144833777,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531242+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:59:28.531242+0000","last_peered":"2023-12-01T15:59:28.531242+0000","last_clean":"2023-12-01T15:59:28.531242+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:59:28.531242+0000","last_undegraded":"2023-12-01T15:59:28.531242+0000","last_fullsized":"2023-12-01T15:59:28.531242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'2295","reported_seq":2537,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:38.213756+0000","last_change":"2023-12-01T15:43:45.209138+0000","last_active":"2023-12-01T15:59:38.213756+0000","last_peered":"2023-12-01T15:59:38.213756+0000","last_clean":"2023-12-01T15:59:38.213756+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T15:59:38.213756+0000","last_undegraded":"2023-12-01T15:59:38.213756+0000","last_fullsized":"2023-12-01T15:59:38.213756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3359983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":3419,"num_write":2296,"num_write_kb":16044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'3370","reported_seq":2808,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.096150+0000","last_change":"2023-12-01T15:59:36.960605+0000","last_active":"2023-12-01T15:59:37.096150+0000","last_peered":"2023-12-01T15:59:37.096150+0000","last_clean":"2023-12-01T15:59:37.096150+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T15:59:37.096150+0000","last_undegraded":"2023-12-01T15:59:37.096150+0000","last_fullsized":"2023-12-01T15:59:37.096150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3370,"log_dups_size":0,"ondisk_log_size":3370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13848359499999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1137,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.388444+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:59:28.388444+0000","last_peered":"2023-12-01T15:59:28.388444+0000","last_clean":"2023-12-01T15:59:28.388444+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:59:28.388444+0000","last_undegraded":"2023-12-01T15:59:28.388444+0000","last_fullsized":"2023-12-01T15:59:28.388444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:05:36.049760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"42'2706","reported_seq":2748,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:30.346534+0000","last_change":"2023-12-01T15:43:45.204466+0000","last_active":"2023-12-01T15:59:30.346534+0000","last_peered":"2023-12-01T15:59:30.346534+0000","last_clean":"2023-12-01T15:59:30.346534+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T15:59:30.346534+0000","last_undegraded":"2023-12-01T15:59:30.346534+0000","last_fullsized":"2023-12-01T15:59:30.346534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2706,"log_dups_size":0,"ondisk_log_size":2706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2697,"num_write_kb":25331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'3392","reported_seq":2863,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.452643+0000","last_change":"2023-12-01T15:59:37.459988+0000","last_active":"2023-12-01T15:59:37.452643+0000","last_peered":"2023-12-01T15:59:37.452643+0000","last_clean":"2023-12-01T15:59:37.452643+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:59:37.452643+0000","last_undegraded":"2023-12-01T15:59:37.452643+0000","last_fullsized":"2023-12-01T15:59:37.452643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.644502672,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1119,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.531578+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:59:28.531578+0000","last_peered":"2023-12-01T15:59:28.531578+0000","last_clean":"2023-12-01T15:59:28.531578+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:59:28.531578+0000","last_undegraded":"2023-12-01T15:59:28.531578+0000","last_fullsized":"2023-12-01T15:59:28.531578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:11:42.240939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"42'3556","reported_seq":3598,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:30.344225+0000","last_change":"2023-12-01T15:43:45.207506+0000","last_active":"2023-12-01T15:59:30.344225+0000","last_peered":"2023-12-01T15:59:30.344225+0000","last_clean":"2023-12-01T15:59:30.344225+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T15:59:30.344225+0000","last_undegraded":"2023-12-01T15:59:30.344225+0000","last_fullsized":"2023-12-01T15:59:30.344225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3556,"log_dups_size":0,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3556,"num_write_kb":20852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"43'3572","reported_seq":2961,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.485563+0000","last_change":"2023-12-01T15:59:37.493069+0000","last_active":"2023-12-01T15:59:37.485563+0000","last_peered":"2023-12-01T15:59:37.485563+0000","last_clean":"2023-12-01T15:59:37.485563+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:37.485563+0000","last_undegraded":"2023-12-01T15:59:37.485563+0000","last_fullsized":"2023-12-01T15:59:37.485563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3572,"log_dups_size":0,"ondisk_log_size":3572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65789627900000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.5","version":"43'2830","reported_seq":2872,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.217388+0000","last_change":"2023-12-01T15:43:45.210575+0000","last_active":"2023-12-01T15:59:37.217388+0000","last_peered":"2023-12-01T15:59:37.217388+0000","last_clean":"2023-12-01T15:59:37.217388+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T15:59:37.217388+0000","last_undegraded":"2023-12-01T15:59:37.217388+0000","last_fullsized":"2023-12-01T15:59:37.217388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2830,"log_dups_size":0,"ondisk_log_size":2830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2820,"num_write_kb":26865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.391178+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:59:28.391178+0000","last_peered":"2023-12-01T15:59:28.391178+0000","last_clean":"2023-12-01T15:59:28.391178+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:59:28.391178+0000","last_undegraded":"2023-12-01T15:59:28.391178+0000","last_fullsized":"2023-12-01T15:59:28.391178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3759","reported_seq":3194,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.439827+0000","last_change":"2023-12-01T15:59:37.447706+0000","last_active":"2023-12-01T15:59:37.439827+0000","last_peered":"2023-12-01T15:59:37.439827+0000","last_clean":"2023-12-01T15:59:37.439827+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:59:37.439827+0000","last_undegraded":"2023-12-01T15:59:37.439827+0000","last_fullsized":"2023-12-01T15:59:37.439827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.64064258500000004,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.4","version":"43'723","reported_seq":765,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.835279+0000","last_change":"2023-12-01T15:43:45.200408+0000","last_active":"2023-12-01T15:59:36.835279+0000","last_peered":"2023-12-01T15:59:36.835279+0000","last_clean":"2023-12-01T15:59:36.835279+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T15:59:36.835279+0000","last_undegraded":"2023-12-01T15:59:36.835279+0000","last_fullsized":"2023-12-01T15:59:36.835279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":8308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.534317+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:59:28.534317+0000","last_peered":"2023-12-01T15:59:28.534317+0000","last_clean":"2023-12-01T15:59:28.534317+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:59:28.534317+0000","last_undegraded":"2023-12-01T15:59:28.534317+0000","last_fullsized":"2023-12-01T15:59:28.534317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:50:39.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"43'3558","reported_seq":2959,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.125309+0000","last_change":"2023-12-01T15:59:36.962654+0000","last_active":"2023-12-01T15:59:37.125309+0000","last_peered":"2023-12-01T15:59:37.125309+0000","last_clean":"2023-12-01T15:59:37.125309+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T15:59:37.125309+0000","last_undegraded":"2023-12-01T15:59:37.125309+0000","last_fullsized":"2023-12-01T15:59:37.125309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:19.706992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13059393599999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1243,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.7","version":"36'1637","reported_seq":1679,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.391945+0000","last_change":"2023-12-01T15:43:45.203186+0000","last_active":"2023-12-01T15:59:28.391945+0000","last_peered":"2023-12-01T15:59:28.391945+0000","last_clean":"2023-12-01T15:59:28.391945+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T15:59:28.391945+0000","last_undegraded":"2023-12-01T15:59:28.391945+0000","last_fullsized":"2023-12-01T15:59:28.391945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1642,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.390379+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:59:28.390379+0000","last_peered":"2023-12-01T15:59:28.390379+0000","last_clean":"2023-12-01T15:59:28.390379+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:59:28.390379+0000","last_undegraded":"2023-12-01T15:59:28.390379+0000","last_fullsized":"2023-12-01T15:59:28.390379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:40:03.704778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'3696","reported_seq":3059,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.128697+0000","last_change":"2023-12-01T15:59:36.953191+0000","last_active":"2023-12-01T15:59:37.128697+0000","last_peered":"2023-12-01T15:59:37.128697+0000","last_clean":"2023-12-01T15:59:37.128697+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:59:37.128697+0000","last_undegraded":"2023-12-01T15:59:37.128697+0000","last_fullsized":"2023-12-01T15:59:37.128697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3696,"log_dups_size":0,"ondisk_log_size":3696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13319146700000001,"stat_sum":{"num_bytes":4118,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.6","version":"43'1993","reported_seq":2035,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.824773+0000","last_change":"2023-12-01T15:43:45.205286+0000","last_active":"2023-12-01T15:59:36.824773+0000","last_peered":"2023-12-01T15:59:36.824773+0000","last_clean":"2023-12-01T15:59:36.824773+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T15:59:36.824773+0000","last_undegraded":"2023-12-01T15:59:36.824773+0000","last_fullsized":"2023-12-01T15:59:36.824773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2261,"num_write_kb":16414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.534613+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:59:28.534613+0000","last_peered":"2023-12-01T15:59:28.534613+0000","last_clean":"2023-12-01T15:59:28.534613+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:59:28.534613+0000","last_undegraded":"2023-12-01T15:59:28.534613+0000","last_fullsized":"2023-12-01T15:59:28.534613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:55:21.181781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"43'3405","reported_seq":2816,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.094097+0000","last_change":"2023-12-01T15:59:36.902129+0000","last_active":"2023-12-01T15:59:37.094097+0000","last_peered":"2023-12-01T15:59:37.094097+0000","last_clean":"2023-12-01T15:59:37.094097+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T15:59:37.094097+0000","last_undegraded":"2023-12-01T15:59:37.094097+0000","last_fullsized":"2023-12-01T15:59:37.094097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3405,"log_dups_size":0,"ondisk_log_size":3405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.087179219000000002,"stat_sum":{"num_bytes":12302,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.13","version":"43'3613","reported_seq":3016,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.131832+0000","last_change":"2023-12-01T15:59:36.912052+0000","last_active":"2023-12-01T15:59:37.131832+0000","last_peered":"2023-12-01T15:59:37.131832+0000","last_clean":"2023-12-01T15:59:37.131832+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:59:37.131832+0000","last_undegraded":"2023-12-01T15:59:37.131832+0000","last_fullsized":"2023-12-01T15:59:37.131832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:21:55.500677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.084182759999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.14","version":"42'3711","reported_seq":3752,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:31.213338+0000","last_change":"2023-12-01T15:43:45.208015+0000","last_active":"2023-12-01T15:59:31.213338+0000","last_peered":"2023-12-01T15:59:31.213338+0000","last_clean":"2023-12-01T15:59:31.213338+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T15:59:31.213338+0000","last_undegraded":"2023-12-01T15:59:31.213338+0000","last_fullsized":"2023-12-01T15:59:31.213338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3711,"num_write_kb":29795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"43'3508","reported_seq":2924,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.420142+0000","last_change":"2023-12-01T15:59:37.439759+0000","last_active":"2023-12-01T15:59:37.420142+0000","last_peered":"2023-12-01T15:59:37.420142+0000","last_clean":"2023-12-01T15:59:37.420142+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T15:59:37.420142+0000","last_undegraded":"2023-12-01T15:59:37.420142+0000","last_fullsized":"2023-12-01T15:59:37.420142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63296622700000005,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.15","version":"43'2457","reported_seq":2498,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.224645+0000","last_change":"2023-12-01T15:43:45.210538+0000","last_active":"2023-12-01T15:59:37.224645+0000","last_peered":"2023-12-01T15:59:37.224645+0000","last_clean":"2023-12-01T15:59:37.224645+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T15:59:37.224645+0000","last_undegraded":"2023-12-01T15:59:37.224645+0000","last_fullsized":"2023-12-01T15:59:37.224645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2457,"log_dups_size":0,"ondisk_log_size":2457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2453,"num_write_kb":21278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"43'1339","reported_seq":1380,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.814374+0000","last_change":"2023-12-01T15:43:45.204325+0000","last_active":"2023-12-01T15:59:36.814374+0000","last_peered":"2023-12-01T15:59:36.814374+0000","last_clean":"2023-12-01T15:59:36.814374+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T15:59:36.814374+0000","last_undegraded":"2023-12-01T15:59:36.814374+0000","last_fullsized":"2023-12-01T15:59:36.814374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1339,"log_dups_size":0,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1338,"num_write_kb":26066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'3641","reported_seq":3001,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.099603+0000","last_change":"2023-12-01T15:59:36.952311+0000","last_active":"2023-12-01T15:59:37.099603+0000","last_peered":"2023-12-01T15:59:37.099603+0000","last_clean":"2023-12-01T15:59:37.099603+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T15:59:37.099603+0000","last_undegraded":"2023-12-01T15:59:37.099603+0000","last_fullsized":"2023-12-01T15:59:37.099603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:36.724287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13235097200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.17","version":"43'900","reported_seq":941,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.217107+0000","last_change":"2023-12-01T15:43:45.203624+0000","last_active":"2023-12-01T15:59:37.217107+0000","last_peered":"2023-12-01T15:59:37.217107+0000","last_clean":"2023-12-01T15:59:37.217107+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T15:59:37.217107+0000","last_undegraded":"2023-12-01T15:59:37.217107+0000","last_fullsized":"2023-12-01T15:59:37.217107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'3458","reported_seq":2866,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.382919+0000","last_change":"2023-12-01T15:59:37.396927+0000","last_active":"2023-12-01T15:59:37.382919+0000","last_peered":"2023-12-01T15:59:37.382919+0000","last_clean":"2023-12-01T15:59:37.382919+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:59:37.382919+0000","last_undegraded":"2023-12-01T15:59:37.382919+0000","last_fullsized":"2023-12-01T15:59:37.382919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3458,"log_dups_size":0,"ondisk_log_size":3458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.59367497300000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1187,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.1f","version":"43'3413","reported_seq":2906,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.115077+0000","last_change":"2023-12-01T15:59:36.971349+0000","last_active":"2023-12-01T15:59:37.115077+0000","last_peered":"2023-12-01T15:59:37.115077+0000","last_clean":"2023-12-01T15:59:37.115077+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:59:37.115077+0000","last_undegraded":"2023-12-01T15:59:37.115077+0000","last_fullsized":"2023-12-01T15:59:37.115077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:20.675396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17121966999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.18","version":"43'4973","reported_seq":5014,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.803258+0000","last_change":"2023-12-01T15:43:45.205650+0000","last_active":"2023-12-01T15:59:36.803258+0000","last_peered":"2023-12-01T15:59:36.803258+0000","last_clean":"2023-12-01T15:59:36.803258+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:59:36.803258+0000","last_undegraded":"2023-12-01T15:59:36.803258+0000","last_fullsized":"2023-12-01T15:59:36.803258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4973,"log_dups_size":0,"ondisk_log_size":4973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4962,"num_write_kb":39191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3226","reported_seq":2693,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.116439+0000","last_change":"2023-12-01T15:59:36.959488+0000","last_active":"2023-12-01T15:59:37.116439+0000","last_peered":"2023-12-01T15:59:37.116439+0000","last_clean":"2023-12-01T15:59:37.116439+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T15:59:37.116439+0000","last_undegraded":"2023-12-01T15:59:37.116439+0000","last_fullsized":"2023-12-01T15:59:37.116439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3226,"log_dups_size":0,"ondisk_log_size":3226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13751970099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.19","version":"36'490","reported_seq":531,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.388301+0000","last_change":"2023-12-01T15:43:45.200400+0000","last_active":"2023-12-01T15:59:28.388301+0000","last_peered":"2023-12-01T15:59:28.388301+0000","last_clean":"2023-12-01T15:59:28.388301+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:59:28.388301+0000","last_undegraded":"2023-12-01T15:59:28.388301+0000","last_fullsized":"2023-12-01T15:59:28.388301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":17875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'3421","reported_seq":2858,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.051612+0000","last_change":"2023-12-01T15:59:36.955244+0000","last_active":"2023-12-01T15:59:37.051612+0000","last_peered":"2023-12-01T15:59:37.051612+0000","last_clean":"2023-12-01T15:59:37.051612+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:59:37.051612+0000","last_undegraded":"2023-12-01T15:59:37.051612+0000","last_fullsized":"2023-12-01T15:59:37.051612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134588554,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"43'3616","reported_seq":3657,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.817642+0000","last_change":"2023-12-01T15:43:45.200975+0000","last_active":"2023-12-01T15:59:36.817642+0000","last_peered":"2023-12-01T15:59:36.817642+0000","last_clean":"2023-12-01T15:59:36.817642+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:59:36.817642+0000","last_undegraded":"2023-12-01T15:59:36.817642+0000","last_fullsized":"2023-12-01T15:59:36.817642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3616,"log_dups_size":0,"ondisk_log_size":3616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3601,"num_write_kb":33849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"43'3891","reported_seq":3214,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.471375+0000","last_change":"2023-12-01T15:59:37.485420+0000","last_active":"2023-12-01T15:59:37.471375+0000","last_peered":"2023-12-01T15:59:37.471375+0000","last_clean":"2023-12-01T15:59:37.471375+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T15:59:37.471375+0000","last_undegraded":"2023-12-01T15:59:37.471375+0000","last_fullsized":"2023-12-01T15:59:37.471375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3891,"log_dups_size":0,"ondisk_log_size":3891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65050901000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1b","version":"40'2098","reported_seq":2139,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.584412+0000","last_change":"2023-12-01T15:43:45.208899+0000","last_active":"2023-12-01T15:59:28.584412+0000","last_peered":"2023-12-01T15:59:28.584412+0000","last_clean":"2023-12-01T15:59:28.584412+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T15:59:28.584412+0000","last_undegraded":"2023-12-01T15:59:28.584412+0000","last_fullsized":"2023-12-01T15:59:28.584412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2089,"num_write_kb":16989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"43'3665","reported_seq":3073,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.912047+0000","last_change":"2023-12-01T15:59:36.912047+0000","last_active":"2023-12-01T15:59:36.912047+0000","last_peered":"2023-12-01T15:59:36.912047+0000","last_clean":"2023-12-01T15:59:36.912047+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T15:59:36.912047+0000","last_undegraded":"2023-12-01T15:59:36.912047+0000","last_fullsized":"2023-12-01T15:59:36.912047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.084960400000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1169,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1c","version":"43'637","reported_seq":678,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.321599+0000","last_change":"2023-12-01T15:43:45.203471+0000","last_active":"2023-12-01T15:59:37.321599+0000","last_peered":"2023-12-01T15:59:37.321599+0000","last_clean":"2023-12-01T15:59:37.321599+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T15:59:37.321599+0000","last_undegraded":"2023-12-01T15:59:37.321599+0000","last_fullsized":"2023-12-01T15:59:37.321599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1876097,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":640,"num_write_kb":6069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"43'3570","reported_seq":2963,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.129073+0000","last_change":"2023-12-01T15:59:36.912038+0000","last_active":"2023-12-01T15:59:37.129073+0000","last_peered":"2023-12-01T15:59:37.129073+0000","last_clean":"2023-12-01T15:59:37.129073+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:59:37.129073+0000","last_undegraded":"2023-12-01T15:59:37.129073+0000","last_fullsized":"2023-12-01T15:59:37.129073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.094045403999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"36'5936","reported_seq":5977,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.533385+0000","last_change":"2023-12-01T15:43:45.208222+0000","last_active":"2023-12-01T15:59:28.533385+0000","last_peered":"2023-12-01T15:59:28.533385+0000","last_clean":"2023-12-01T15:59:28.533385+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:59:28.533385+0000","last_undegraded":"2023-12-01T15:59:28.533385+0000","last_fullsized":"2023-12-01T15:59:28.533385+0000","mapping_epoch":16,"log_start":"21'300","ondisk_log_start":"21'300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":5636,"log_dups_size":0,"ondisk_log_size":5636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5940,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'3525","reported_seq":2985,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.125486+0000","last_change":"2023-12-01T15:59:36.954665+0000","last_active":"2023-12-01T15:59:37.125486+0000","last_peered":"2023-12-01T15:59:37.125486+0000","last_clean":"2023-12-01T15:59:37.125486+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:59:37.125486+0000","last_undegraded":"2023-12-01T15:59:37.125486+0000","last_fullsized":"2023-12-01T15:59:37.125486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134288985,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1e","version":"39'3426","reported_seq":3468,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.584478+0000","last_change":"2023-12-01T15:43:45.208256+0000","last_active":"2023-12-01T15:59:28.584478+0000","last_peered":"2023-12-01T15:59:28.584478+0000","last_clean":"2023-12-01T15:59:28.584478+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T15:59:28.584478+0000","last_undegraded":"2023-12-01T15:59:28.584478+0000","last_fullsized":"2023-12-01T15:59:28.584478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3411,"num_write_kb":30086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'4049","reported_seq":3327,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.182492+0000","last_change":"2023-12-01T15:59:36.912664+0000","last_active":"2023-12-01T15:59:37.182492+0000","last_peered":"2023-12-01T15:59:37.182492+0000","last_clean":"2023-12-01T15:59:37.182492+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:59:37.182492+0000","last_undegraded":"2023-12-01T15:59:37.182492+0000","last_fullsized":"2023-12-01T15:59:37.182492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":4049,"log_dups_size":0,"ondisk_log_size":4049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.091841191000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1f","version":"39'1803","reported_seq":1845,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.585180+0000","last_change":"2023-12-01T15:43:45.204599+0000","last_active":"2023-12-01T15:59:28.585180+0000","last_peered":"2023-12-01T15:59:28.585180+0000","last_clean":"2023-12-01T15:59:28.585180+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T15:59:28.585180+0000","last_undegraded":"2023-12-01T15:59:28.585180+0000","last_fullsized":"2023-12-01T15:59:28.585180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1803,"log_dups_size":0,"ondisk_log_size":1803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1812,"num_write_kb":15324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":76140,"num_write_kb":40588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225506,"ondisk_log_size":225506,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":277867455,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":223,"num_read_kb":3419,"num_write":76829,"num_write_kb":641147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":555802624,"data_stored":555734910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76345,"ondisk_log_size":76345,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705861,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":682744,"kb_used_data":134064,"kb_used_omap":0,"kb_used_meta":548672,"kb_avail":93689096,"statfs":{"total":96636764160,"available":95937634304,"internally_reserved":0,"allocated":137281536,"data_stored":136927884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":561840128},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.68500000000000005,"15min":0.63400000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.1799999999999999,"5min":10.84,"15min":10.84},"last":0.627},{"interface":"front","average":{"1min":1.129,"5min":0.88900000000000001,"15min":0.70899999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":11.926,"5min":11.926,"15min":11.926},"last":0.75900000000000001}]},{"osd":1,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.71799999999999997,"15min":0.66800000000000004},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.246},"max":{"1min":0.77200000000000002,"5min":10.807,"15min":10.807},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":3.552,"5min":3.552,"15min":3.552},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.72699999999999998,"15min":0.63},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.8700000000000001,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.68000000000000005,"15min":0.64700000000000002},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.71599999999999997,"5min":10.715999999999999,"15min":10.715999999999999},"last":0.46100000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705862,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":801868,"kb_used_data":157252,"kb_used_omap":0,"kb_used_meta":644608,"kb_avail":93569972,"statfs":{"total":96636764160,"available":95815651328,"internally_reserved":0,"allocated":161026048,"data_stored":160664268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":660078592},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.23000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.798,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.60699999999999998,"15min":0.65500000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.84099999999999997,"5min":0.91200000000000003,"15min":2.657},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.68600000000000005,"15min":0.66300000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.8240000000000001,"5min":8.0779999999999994,"15min":8.0779999999999994},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.439,"5min":0.60799999999999998,"15min":0.627},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80500000000000005,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.53300000000000003,"15min":0.56499999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52200000000000002,"5min":2.048,"15min":7.5289999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.70799999999999996,"15min":0.67200000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.845,"5min":8.0370000000000008,"15min":9.8949999999999996},"last":0.42099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705861,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589232,"kb_used_data":98856,"kb_used_omap":0,"kb_used_meta":490368,"kb_avail":93782608,"statfs":{"total":96636764160,"available":96033390592,"internally_reserved":0,"allocated":101228544,"data_stored":100901390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502136832},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.45600000000000002,"15min":0.50800000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17299999999999999},"max":{"1min":0.73299999999999998,"5min":0.749,"15min":8.4589999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.22,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.7729999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63800000000000001,"15min":0.64500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.25900000000000001},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.501},{"interface":"front","average":{"1min":0.501,"5min":0.63,"15min":0.68300000000000005},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.754,"5min":2.6640000000000001,"15min":10.914999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.251},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.36699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":3.1539999999999999,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.62}]}]},{"osd":0,"up_from":9,"seq":38654705861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814556,"kb_used_data":155988,"kb_used_omap":0,"kb_used_meta":658560,"kb_avail":93557284,"statfs":{"total":96636764160,"available":95802658816,"internally_reserved":0,"allocated":159731712,"data_stored":159382664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":674365440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47399999999999998,"15min":0.49099999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.1890000000000001,"5min":1.595,"15min":1.595},"last":0.502},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.51800000000000002,"15min":0.623},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.70499999999999996,"5min":3.3639999999999999,"15min":30.995000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61399999999999999,"15min":0.73099999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":24.504000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.64600000000000002,"15min":0.76400000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":24.524999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64800000000000002,"15min":0.75600000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.859,"5min":2.859,"15min":31.038},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.63400000000000001,"15min":0.69799999999999995},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.95799999999999996,"15min":7.9420000000000002},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":158564352,"data_stored":158550118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":160452608,"data_stored":160426146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":136122368,"data_stored":136095350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T15:59:42.935 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T15:59:43.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8d4fc700 1 Processor -- start 2023-12-01T15:59:43.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8d4fc700 1 -- start start 2023-12-01T15:59:43.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8d4fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a881418c0 0x7f1a88143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:43.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8d4fc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8809c240 con 0x7f1a881376e0 2023-12-01T15:59:43.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8d4fc700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8806c870 con 0x7f1a88137ac0 2023-12-01T15:59:43.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8d4fc700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8809bc90 con 0x7f1a881418c0 2023-12-01T15:59:43.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a87fff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1a881376e0 0x7f1a8806ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45192/0 (socket says 172.21.15.63:45192) 2023-12-01T15:59:43.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a87fff700 1 -- 172.21.15.63:0/2019075738 learned_addr learned my addr 172.21.15.63:0/2019075738 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:43.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8ccfb700 1 --2- 172.21.15.63:0/2019075738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a881418c0 0x7f1a88143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:43.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a86ffd700 1 -- 172.21.15.63:0/2019075738 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802210141 0 0) 0x7f1a8806c870 con 0x7f1a88137ac0 2023-12-01T15:59:43.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a86ffd700 1 -- 172.21.15.63:0/2019075738 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a700035d0 con 0x7f1a88137ac0 2023-12-01T15:59:43.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a86ffd700 1 -- 172.21.15.63:0/2019075738 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659247622 0 0) 0x7f1a8809c240 con 0x7f1a881376e0 2023-12-01T15:59:43.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a86ffd700 1 -- 172.21.15.63:0/2019075738 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a8806c870 con 0x7f1a881376e0 2023-12-01T15:59:43.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8ccfb700 1 -- 172.21.15.63:0/2019075738 >> v1:172.21.15.66:6789/0 conn(0x7f1a88137ac0 legacy=0x7f1a8806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:43.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8ccfb700 1 -- 172.21.15.63:0/2019075738 >> v1:172.21.15.63:6789/0 conn(0x7f1a881376e0 legacy=0x7f1a8806ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:43.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8ccfb700 1 -- 172.21.15.63:0/2019075738 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8809bf80 con 0x7f1a881418c0 2023-12-01T15:59:43.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8ccfb700 1 --2- 172.21.15.63:0/2019075738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a881418c0 0x7f1a88143cb0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009dc0 tx=0x7f1a8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=702cc282d47afe2d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:43.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a86ffd700 1 -- 172.21.15.63:0/2019075738 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8000e070 con 0x7f1a881418c0 2023-12-01T15:59:43.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a86ffd700 1 -- 172.21.15.63:0/2019075738 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8000bb20 con 0x7f1a881418c0 2023-12-01T15:59:43.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a86ffd700 1 -- 172.21.15.63:0/2019075738 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a80012430 con 0x7f1a881418c0 2023-12-01T15:59:43.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2019075738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a881418c0 msgr2=0x7f1a88143cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:43.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.036+0000 7f1a8d4fc700 1 --2- 172.21.15.63:0/2019075738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a881418c0 0x7f1a88143cb0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009dc0 tx=0x7f1a8000b330 comp rx=0 tx=0).stop 2023-12-01T15:59:43.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2019075738 shutdown_connections 2023-12-01T15:59:43.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 --2- 172.21.15.63:0/2019075738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a881418c0 0x7f1a88143cb0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:43.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2019075738 >> 172.21.15.63:0/2019075738 conn(0x7f1a880737a0 msgr2=0x7f1a880ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:43.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2019075738 shutdown_connections 2023-12-01T15:59:43.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2019075738 wait complete. 2023-12-01T15:59:43.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 Processor -- start 2023-12-01T15:59:43.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 -- start start 2023-12-01T15:59:43.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881376e0 0x7f1a881cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:43.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a88137ac0 0x7f1a881cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:43.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881418c0 0x7f1a881cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:43.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8813dd60 con 0x7f1a881376e0 2023-12-01T15:59:43.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8813c370 con 0x7f1a881418c0 2023-12-01T15:59:43.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8813ebc0 con 0x7f1a88137ac0 2023-12-01T15:59:43.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a87fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881376e0 0x7f1a881cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:43.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a87fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881376e0 0x7f1a881cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38570/0 (socket says 172.21.15.63:38570) 2023-12-01T15:59:43.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a87fff700 1 -- 172.21.15.63:0/2654302578 learned_addr learned my addr 172.21.15.63:0/2654302578 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:43.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8ccfb700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881418c0 0x7f1a881cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:43.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a877fe700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a88137ac0 0x7f1a881cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:43.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a87fff700 1 -- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a88137ac0 msgr2=0x7f1a881cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:43.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a87fff700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a88137ac0 0x7f1a881cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:43.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a87fff700 1 -- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881418c0 msgr2=0x7f1a881cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:43.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a87fff700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881418c0 0x7f1a881cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:43.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a87fff700 1 -- 172.21.15.63:0/2654302578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80009a70 con 0x7f1a881376e0 2023-12-01T15:59:43.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a87fff700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881376e0 0x7f1a881cbe40 secure :-1 s=READY pgs=2932 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00c700 tx=0x7f1a7c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:43.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a84ff9700 1 -- 172.21.15.63:0/2654302578 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c005d90 con 0x7f1a881376e0 2023-12-01T15:59:43.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a84ff9700 1 -- 172.21.15.63:0/2654302578 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0070d0 con 0x7f1a881376e0 2023-12-01T15:59:43.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2654302578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8813cde0 con 0x7f1a881376e0 2023-12-01T15:59:43.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a84ff9700 1 -- 172.21.15.63:0/2654302578 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c007480 con 0x7f1a881376e0 2023-12-01T15:59:43.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.040+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2654302578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a881cbbe0 con 0x7f1a881376e0 2023-12-01T15:59:43.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.044+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2654302578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a88065fb0 con 0x7f1a881376e0 2023-12-01T15:59:43.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.044+0000 7f1a84ff9700 1 -- 172.21.15.63:0/2654302578 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1a7c0075e0 con 0x7f1a881376e0 2023-12-01T15:59:43.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.044+0000 7f1a84ff9700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1a74065ad0 0x7f1a74067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:43.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.044+0000 7f1a84ff9700 1 -- 172.21.15.63:0/2654302578 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4419+0+0 (secure 0 0 0) 0x7f1a7c081ff0 con 0x7f1a881376e0 2023-12-01T15:59:43.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.044+0000 7f1a877fe700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1a74065ad0 0x7f1a74067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:43.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.044+0000 7f1a877fe700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1a74065ad0 0x7f1a74067f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1a880ab730 tx=0x7f1a78009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:43.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.052+0000 7f1a84ff9700 1 -- 172.21.15.63:0/2654302578 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1a7c0b3070 con 0x7f1a881376e0 2023-12-01T15:59:43.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.216+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2654302578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a88061d90 con 0x7f1a881376e0 2023-12-01T15:59:43.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a84ff9700 1 -- 172.21.15.63:0/2654302578 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+13340 (secure 0 0 0) 0x7f1a7c017020 con 0x7f1a881376e0 2023-12-01T15:59:43.234 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:59:43.234 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":43,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:59:36.778737+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"new_removed_snaps":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T15:59:43.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1a74065ad0 msgr2=0x7f1a74067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:43.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1a74065ad0 0x7f1a74067f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1a880ab730 tx=0x7f1a78009040 comp rx=0 tx=0).stop 2023-12-01T15:59:43.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2654302578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881376e0 msgr2=0x7f1a881cbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:43.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881376e0 0x7f1a881cbe40 secure :-1 s=READY pgs=2932 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00c700 tx=0x7f1a7c00ca10 comp rx=0 tx=0).stop 2023-12-01T15:59:43.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2654302578 shutdown_connections 2023-12-01T15:59:43.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1a74065ad0 0x7f1a74067f90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:43.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a88137ac0 0x7f1a881cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:43.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881418c0 0x7f1a881cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:43.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 --2- 172.21.15.63:0/2654302578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881376e0 0x7f1a881cbe40 unknown :-1 s=CLOSED pgs=2932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:43.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2654302578 >> 172.21.15.63:0/2654302578 conn(0x7f1a880737a0 msgr2=0x7f1a881368d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:43.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2654302578 shutdown_connections 2023-12-01T15:59:43.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:43.220+0000 7f1a8d4fc700 1 -- 172.21.15.63:0/2654302578 wait complete. 2023-12-01T15:59:44.251 INFO:tasks.ceph:Scrubbing osd.0 2023-12-01T15:59:44.251 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-01T15:59:44.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 Processor -- start 2023-12-01T15:59:44.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 -- start start 2023-12-01T15:59:44.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a9c06e880 0x7f1a9c134bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1a9c137d40 0x7f1a9c069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9c134610 con 0x7f1a9c1347d0 2023-12-01T15:59:44.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c070010 con 0x7f1a9c06e880 2023-12-01T15:59:44.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c06f360 con 0x7f1a9c137d40 2023-12-01T15:59:44.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa1a9f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a9c06e880 0x7f1a9c134bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa22a0700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1a9c1347d0 0x7f1a9c137630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45202/0 (socket says 172.21.15.63:45202) 2023-12-01T15:59:44.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa22a0700 1 -- 172.21.15.63:0/1840860373 learned_addr learned my addr 172.21.15.63:0/1840860373 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:44.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa2aa1700 1 --2- 172.21.15.63:0/1840860373 >> v2:172.21.15.66:3300/0 conn(0x7f1a9c137d40 0x7f1a9c069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa1a9f700 1 -- 172.21.15.63:0/1840860373 >> v2:172.21.15.66:3300/0 conn(0x7f1a9c137d40 msgr2=0x7f1a9c069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:44.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa1a9f700 1 --2- 172.21.15.63:0/1840860373 >> v2:172.21.15.66:3300/0 conn(0x7f1a9c137d40 0x7f1a9c069ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa1a9f700 1 -- 172.21.15.63:0/1840860373 >> v1:172.21.15.63:6789/0 conn(0x7f1a9c1347d0 legacy=0x7f1a9c137630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa1a9f700 1 -- 172.21.15.63:0/1840860373 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c06db00 con 0x7f1a9c06e880 2023-12-01T15:59:44.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa1a9f700 1 --2- 172.21.15.63:0/1840860373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a9c06e880 0x7f1a9c134bb0 secure :-1 s=READY pgs=2934 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0a75b0 tx=0x7f1a98009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee83cea4e4dbf17d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:44.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa129e700 1 -- 172.21.15.63:0/1840860373 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98011830 con 0x7f1a9c06e880 2023-12-01T15:59:44.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa129e700 1 -- 172.21.15.63:0/1840860373 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a98011990 con 0x7f1a9c06e880 2023-12-01T15:59:44.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa129e700 1 -- 172.21.15.63:0/1840860373 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98011d20 con 0x7f1a9c06e880 2023-12-01T15:59:44.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 -- 172.21.15.63:0/1840860373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a9c06e880 msgr2=0x7f1a9c134bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 --2- 172.21.15.63:0/1840860373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a9c06e880 0x7f1a9c134bb0 secure :-1 s=READY pgs=2934 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0a75b0 tx=0x7f1a98009b30 comp rx=0 tx=0).stop 2023-12-01T15:59:44.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 -- 172.21.15.63:0/1840860373 shutdown_connections 2023-12-01T15:59:44.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 --2- 172.21.15.63:0/1840860373 >> v2:172.21.15.66:3300/0 conn(0x7f1a9c137d40 0x7f1a9c069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 --2- 172.21.15.63:0/1840860373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a9c06e880 0x7f1a9c134bb0 unknown :-1 s=CLOSED pgs=2934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 -- 172.21.15.63:0/1840860373 >> 172.21.15.63:0/1840860373 conn(0x7f1a9c0a96b0 msgr2=0x7f1a9c0a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:44.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 -- 172.21.15.63:0/1840860373 shutdown_connections 2023-12-01T15:59:44.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.368+0000 7f1aa32a2700 1 -- 172.21.15.63:0/1840860373 wait complete. 2023-12-01T15:59:44.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa32a2700 1 Processor -- start 2023-12-01T15:59:44.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa32a2700 1 -- start start 2023-12-01T15:59:44.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa32a2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a9c06e880 0x7f1a9c1331f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa32a2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a9c1347d0 0x7f1a9c133730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa32a2700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a9c137d40 0x7f1a9c09cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa32a2700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c09e740 con 0x7f1a9c137d40 2023-12-01T15:59:44.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa32a2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c09f9a0 con 0x7f1a9c1347d0 2023-12-01T15:59:44.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa32a2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c13c090 con 0x7f1a9c06e880 2023-12-01T15:59:44.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa2aa1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a9c137d40 0x7f1a9c09cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa2aa1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a9c137d40 0x7f1a9c09cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38580/0 (socket says 172.21.15.63:38580) 2023-12-01T15:59:44.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa2aa1700 1 -- 172.21.15.63:0/4128868495 learned_addr learned my addr 172.21.15.63:0/4128868495 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:44.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa22a0700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a9c06e880 0x7f1a9c1331f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa1a9f700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a9c1347d0 0x7f1a9c133730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa2aa1700 1 -- 172.21.15.63:0/4128868495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a9c06e880 msgr2=0x7f1a9c1331f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa2aa1700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a9c06e880 0x7f1a9c1331f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa2aa1700 1 -- 172.21.15.63:0/4128868495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a9c1347d0 msgr2=0x7f1a9c133730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa2aa1700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a9c1347d0 0x7f1a9c133730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa2aa1700 1 -- 172.21.15.63:0/4128868495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980094b0 con 0x7f1a9c137d40 2023-12-01T15:59:44.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa2aa1700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a9c137d40 0x7f1a9c09cf80 secure :-1 s=READY pgs=2935 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400efc0 tx=0x7f1a9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:44.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1a92ffd700 1 -- 172.21.15.63:0/4128868495 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94009ea0 con 0x7f1a9c137d40 2023-12-01T15:59:44.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1a92ffd700 1 -- 172.21.15.63:0/4128868495 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9400f040 con 0x7f1a9c137d40 2023-12-01T15:59:44.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa32a2700 1 -- 172.21.15.63:0/4128868495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c13c350 con 0x7f1a9c137d40 2023-12-01T15:59:44.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1a92ffd700 1 -- 172.21.15.63:0/4128868495 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400ced0 con 0x7f1a9c137d40 2023-12-01T15:59:44.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.372+0000 7f1aa32a2700 1 -- 172.21.15.63:0/4128868495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c09ff40 con 0x7f1a9c137d40 2023-12-01T15:59:44.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.376+0000 7f1aa32a2700 1 -- 172.21.15.63:0/4128868495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a9c06f580 con 0x7f1a9c137d40 2023-12-01T15:59:44.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.376+0000 7f1a92ffd700 1 -- 172.21.15.63:0/4128868495 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1a94014480 con 0x7f1a9c137d40 2023-12-01T15:59:44.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.376+0000 7f1a92ffd700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1a80065ad0 0x7f1a80067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.376+0000 7f1a92ffd700 1 -- 172.21.15.63:0/4128868495 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7f1a940834a0 con 0x7f1a9c137d40 2023-12-01T15:59:44.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.376+0000 7f1a92ffd700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] conn(0x7f1a8006d590 0x7f1a8006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.376+0000 7f1a92ffd700 1 -- 172.21.15.63:0/4128868495 --> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a800700e0 con 0x7f1a8006d590 2023-12-01T15:59:44.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.376+0000 7f1a92ffd700 1 -- 172.21.15.63:0/4128868495 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a94085a80 con 0x7f1a9c137d40 2023-12-01T15:59:44.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.376+0000 7f1aa22a0700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1a80065ad0 0x7f1a80067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.376+0000 7f1aa1a9f700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] conn(0x7f1a8006d590 0x7f1a8006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.380+0000 7f1aa22a0700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1a80065ad0 0x7f1a80067f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c09f8d0 tx=0x7f1a8c007f30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:44.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.380+0000 7f1aa1a9f700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] conn(0x7f1a8006d590 0x7f1a8006fa10 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:44.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.380+0000 7f1a92ffd700 1 -- 172.21.15.63:0/4128868495 <== osd.0 v2:172.21.15.63:6808/29724 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1a800700e0 con 0x7f1a8006d590 2023-12-01T15:59:44.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa32a2700 1 -- 172.21.15.63:0/4128868495 --> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1a9c09a580 con 0x7f1a8006d590 2023-12-01T15:59:44.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1a92ffd700 1 -- 172.21.15.63:0/4128868495 <== osd.0 v2:172.21.15.63:6808/29724 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1a9c09a580 con 0x7f1a8006d590 2023-12-01T15:59:44.411 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-01T15:59:44.412 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-01T15:59:44.412 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-01T15:59:44.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa32a2700 1 -- 172.21.15.63:0/4128868495 >> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] conn(0x7f1a8006d590 msgr2=0x7f1a8006fa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa32a2700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.63:6808/29724,v1:172.21.15.63:6809/29724] conn(0x7f1a8006d590 0x7f1a8006fa10 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa32a2700 1 -- 172.21.15.63:0/4128868495 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1a80065ad0 msgr2=0x7f1a80067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa32a2700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1a80065ad0 0x7f1a80067f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c09f8d0 tx=0x7f1a8c007f30 comp rx=0 tx=0).stop 2023-12-01T15:59:44.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa32a2700 1 -- 172.21.15.63:0/4128868495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a9c137d40 msgr2=0x7f1a9c09cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa32a2700 1 --2- 172.21.15.63:0/4128868495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a9c137d40 0x7f1a9c09cf80 secure :-1 s=READY pgs=2935 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400efc0 tx=0x7f1a9400c3a0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa2aa1700 1 -- 172.21.15.63:0/4128868495 reap_dead start 2023-12-01T15:59:44.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa32a2700 1 -- 172.21.15.63:0/4128868495 shutdown_connections 2023-12-01T15:59:44.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa32a2700 1 -- 172.21.15.63:0/4128868495 >> 172.21.15.63:0/4128868495 conn(0x7f1a9c0a96b0 msgr2=0x7f1a9c0a8170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:44.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa32a2700 1 -- 172.21.15.63:0/4128868495 shutdown_connections 2023-12-01T15:59:44.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.396+0000 7f1aa32a2700 1 -- 172.21.15.63:0/4128868495 wait complete. 2023-12-01T15:59:44.425 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-01T15:59:44.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc869f7700 1 Processor -- start 2023-12-01T15:59:44.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc869f7700 1 -- start start 2023-12-01T15:59:44.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc869f7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcc801346f0 0x7fcc801373b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc869f7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8006f450 con 0x7fcc80134ad0 2023-12-01T15:59:44.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc869f7700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc80099ec0 con 0x7fcc8013d6e0 2023-12-01T15:59:44.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc869f7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8006f9e0 con 0x7fcc801346f0 2023-12-01T15:59:44.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc851f4700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcc80134ad0 0x7fcc801378f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45208/0 (socket says 172.21.15.63:45208) 2023-12-01T15:59:44.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc851f4700 1 -- 172.21.15.63:0/1979090986 learned_addr learned my addr 172.21.15.63:0/1979090986 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:44.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc859f5700 1 --2- 172.21.15.63:0/1979090986 >> v2:172.21.15.63:3300/0 conn(0x7fcc801346f0 0x7fcc801373b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc849f3700 1 -- 172.21.15.63:0/1979090986 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150828617 0 0) 0x7fcc8006f450 con 0x7fcc80134ad0 2023-12-01T15:59:44.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc849f3700 1 -- 172.21.15.63:0/1979090986 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc680035d0 con 0x7fcc80134ad0 2023-12-01T15:59:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc859f5700 1 -- 172.21.15.63:0/1979090986 >> v1:172.21.15.66:6789/0 conn(0x7fcc8013d6e0 legacy=0x7fcc8013fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc849f3700 1 -- 172.21.15.63:0/1979090986 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930539884 0 0) 0x7fcc80099ec0 con 0x7fcc8013d6e0 2023-12-01T15:59:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc859f5700 1 -- 172.21.15.63:0/1979090986 >> v1:172.21.15.63:6789/0 conn(0x7fcc80134ad0 legacy=0x7fcc801378f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.532+0000 7fcc859f5700 1 -- 172.21.15.63:0/1979090986 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8006e760 con 0x7fcc801346f0 2023-12-01T15:59:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc859f5700 1 --2- 172.21.15.63:0/1979090986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc801346f0 0x7fcc801373b0 secure :-1 s=READY pgs=2937 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009850 tx=0x7fcc74009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee0119bd5c9b57b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc849f3700 1 -- 172.21.15.63:0/1979090986 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74011830 con 0x7fcc801346f0 2023-12-01T15:59:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc849f3700 1 -- 172.21.15.63:0/1979090986 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc74011990 con 0x7fcc801346f0 2023-12-01T15:59:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc849f3700 1 -- 172.21.15.63:0/1979090986 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74011d40 con 0x7fcc801346f0 2023-12-01T15:59:44.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc869f7700 1 -- 172.21.15.63:0/1979090986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc801346f0 msgr2=0x7fcc801373b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc869f7700 1 --2- 172.21.15.63:0/1979090986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc801346f0 0x7fcc801373b0 secure :-1 s=READY pgs=2937 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009850 tx=0x7fcc74009b60 comp rx=0 tx=0).stop 2023-12-01T15:59:44.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc869f7700 1 -- 172.21.15.63:0/1979090986 shutdown_connections 2023-12-01T15:59:44.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc869f7700 1 --2- 172.21.15.63:0/1979090986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc801346f0 0x7fcc801373b0 unknown :-1 s=CLOSED pgs=2937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc869f7700 1 -- 172.21.15.63:0/1979090986 >> 172.21.15.63:0/1979090986 conn(0x7fcc800a96b0 msgr2=0x7fcc800a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:44.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc869f7700 1 -- 172.21.15.63:0/1979090986 shutdown_connections 2023-12-01T15:59:44.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc869f7700 1 -- 172.21.15.63:0/1979090986 wait complete. 2023-12-01T15:59:44.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc869f7700 1 Processor -- start 2023-12-01T15:59:44.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.536+0000 7fcc869f7700 1 -- start start 2023-12-01T15:59:44.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc869f7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc801346f0 0x7fcc8011fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc869f7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcc80134ad0 0x7fcc80120240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc869f7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc8013d6e0 0x7fcc80120780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc869f7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80124b90 con 0x7fcc801346f0 2023-12-01T15:59:44.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc869f7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80124750 con 0x7fcc8013d6e0 2023-12-01T15:59:44.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc869f7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80122cb0 con 0x7fcc80134ad0 2023-12-01T15:59:44.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc859f5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc801346f0 0x7fcc8011fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc859f5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc801346f0 0x7fcc8011fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38608/0 (socket says 172.21.15.63:38608) 2023-12-01T15:59:44.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc859f5700 1 -- 172.21.15.63:0/1853278453 learned_addr learned my addr 172.21.15.63:0/1853278453 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:44.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc851f4700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcc80134ad0 0x7fcc80120240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc861f6700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc8013d6e0 0x7fcc80120780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc859f5700 1 -- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcc80134ad0 msgr2=0x7fcc80120240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc859f5700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcc80134ad0 0x7fcc80120240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc859f5700 1 -- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc8013d6e0 msgr2=0x7fcc80120780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc859f5700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc8013d6e0 0x7fcc80120780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc859f5700 1 -- 172.21.15.63:0/1853278453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc740094b0 con 0x7fcc801346f0 2023-12-01T15:59:44.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc851f4700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcc80134ad0 0x7fcc80120240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T15:59:44.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc859f5700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc801346f0 0x7fcc8011fd00 secure :-1 s=READY pgs=2938 cs=0 l=1 rev1=1 crypto rx=0x7fcc740090b0 tx=0x7fcc74004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:44.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc7e7fc700 1 -- 172.21.15.63:0/1853278453 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74019ab0 con 0x7fcc801346f0 2023-12-01T15:59:44.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc7e7fc700 1 -- 172.21.15.63:0/1853278453 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7401e070 con 0x7fcc801346f0 2023-12-01T15:59:44.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc869f7700 1 -- 172.21.15.63:0/1853278453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc80120ee0 con 0x7fcc801346f0 2023-12-01T15:59:44.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc7e7fc700 1 -- 172.21.15.63:0/1853278453 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74019e70 con 0x7fcc801346f0 2023-12-01T15:59:44.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc869f7700 1 -- 172.21.15.63:0/1853278453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc801217d0 con 0x7fcc801346f0 2023-12-01T15:59:44.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.540+0000 7fcc869f7700 1 -- 172.21.15.63:0/1853278453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc801230c0 con 0x7fcc801346f0 2023-12-01T15:59:44.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.544+0000 7fcc7e7fc700 1 -- 172.21.15.63:0/1853278453 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcc7402d450 con 0x7fcc801346f0 2023-12-01T15:59:44.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.544+0000 7fcc7e7fc700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fcc6c065ad0 0x7fcc6c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.544+0000 7fcc851f4700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fcc6c065ad0 0x7fcc6c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.544+0000 7fcc7e7fc700 1 -- 172.21.15.63:0/1853278453 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7fcc74083c30 con 0x7fcc801346f0 2023-12-01T15:59:44.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.544+0000 7fcc851f4700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fcc6c065ad0 0x7fcc6c067f90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc8006ef90 tx=0x7fcc70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:44.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.548+0000 7fcc7e7fc700 1 -- 172.21.15.63:0/1853278453 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fcc74051a80 con 0x7fcc801346f0 2023-12-01T15:59:44.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.712+0000 7fcc869f7700 1 -- 172.21.15.63:0/1853278453 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc8006f6b0 con 0x7fcc6c065ad0 2023-12-01T15:59:44.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.712+0000 7fcc7e7fc700 1 -- 172.21.15.63:0/1853278453 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcc7000e780 con 0x7fcc6c065ad0 2023-12-01T15:59:44.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 -- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fcc6c065ad0 msgr2=0x7fcc6c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fcc6c065ad0 0x7fcc6c067f90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc8006ef90 tx=0x7fcc70009040 comp rx=0 tx=0).stop 2023-12-01T15:59:44.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 -- 172.21.15.63:0/1853278453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc801346f0 msgr2=0x7fcc8011fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc801346f0 0x7fcc8011fd00 secure :-1 s=READY pgs=2938 cs=0 l=1 rev1=1 crypto rx=0x7fcc740090b0 tx=0x7fcc74004770 comp rx=0 tx=0).stop 2023-12-01T15:59:44.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 -- 172.21.15.63:0/1853278453 shutdown_connections 2023-12-01T15:59:44.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fcc6c065ad0 0x7fcc6c067f90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcc80134ad0 0x7fcc80120240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc8013d6e0 0x7fcc80120780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 --2- 172.21.15.63:0/1853278453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc801346f0 0x7fcc8011fd00 unknown :-1 s=CLOSED pgs=2938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 -- 172.21.15.63:0/1853278453 >> 172.21.15.63:0/1853278453 conn(0x7fcc800a96b0 msgr2=0x7fcc80069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:44.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 -- 172.21.15.63:0/1853278453 shutdown_connections 2023-12-01T15:59:44.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.716+0000 7fcc869f7700 1 -- 172.21.15.63:0/1853278453 wait complete. 2023-12-01T15:59:44.739 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 0 to deep-scrub 2023-12-01T15:59:44.748 INFO:tasks.ceph:Scrubbing osd.1 2023-12-01T15:59:44.748 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-01T15:59:44.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd79a7e700 1 Processor -- start 2023-12-01T15:59:44.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd79a7e700 1 -- start start 2023-12-01T15:59:44.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd79a7e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efd6c0c87e0 0x7efd6c0cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd79a7e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c0bf400 con 0x7efd6c0be910 2023-12-01T15:59:44.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd79a7e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c01ff80 con 0x7efd6c0c4cd0 2023-12-01T15:59:44.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd79a7e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6c007690 con 0x7efd6c0c87e0 2023-12-01T15:59:44.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd78a7c700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7efd6c0be910 0x7efd6c0becf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45222/0 (socket says 172.21.15.63:45222) 2023-12-01T15:59:44.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd78a7c700 1 -- 172.21.15.63:0/2775121055 learned_addr learned my addr 172.21.15.63:0/2775121055 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:44.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd7927d700 1 --2- 172.21.15.63:0/2775121055 >> v2:172.21.15.63:3300/0 conn(0x7efd6c0c87e0 0x7efd6c0cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd737fe700 1 -- 172.21.15.63:0/2775121055 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732246600 0 0) 0x7efd6c0bf400 con 0x7efd6c0be910 2023-12-01T15:59:44.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd737fe700 1 -- 172.21.15.63:0/2775121055 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd640035d0 con 0x7efd6c0be910 2023-12-01T15:59:44.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.848+0000 7efd737fe700 1 -- 172.21.15.63:0/2775121055 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710454987 0 0) 0x7efd6c01ff80 con 0x7efd6c0c4cd0 2023-12-01T15:59:44.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd737fe700 1 -- 172.21.15.63:0/2775121055 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd6c0bf400 con 0x7efd6c0c4cd0 2023-12-01T15:59:44.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd7927d700 1 -- 172.21.15.63:0/2775121055 >> v1:172.21.15.66:6789/0 conn(0x7efd6c0c4cd0 legacy=0x7efd6c0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd7927d700 1 -- 172.21.15.63:0/2775121055 >> v1:172.21.15.63:6789/0 conn(0x7efd6c0be910 legacy=0x7efd6c0becf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd7927d700 1 -- 172.21.15.63:0/2775121055 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c020a90 con 0x7efd6c0c87e0 2023-12-01T15:59:44.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd7927d700 1 --2- 172.21.15.63:0/2775121055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd6c0c87e0 0x7efd6c0cabd0 secure :-1 s=READY pgs=2940 cs=0 l=1 rev1=1 crypto rx=0x7efd74069310 tx=0x7efd740684f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29e156586a7e43f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:44.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd737fe700 1 -- 172.21.15.63:0/2775121055 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74065fb0 con 0x7efd6c0c87e0 2023-12-01T15:59:44.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd737fe700 1 -- 172.21.15.63:0/2775121055 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7409a380 con 0x7efd6c0c87e0 2023-12-01T15:59:44.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd737fe700 1 -- 172.21.15.63:0/2775121055 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd740008d0 con 0x7efd6c0c87e0 2023-12-01T15:59:44.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd79a7e700 1 -- 172.21.15.63:0/2775121055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd6c0c87e0 msgr2=0x7efd6c0cabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd79a7e700 1 --2- 172.21.15.63:0/2775121055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd6c0c87e0 0x7efd6c0cabd0 secure :-1 s=READY pgs=2940 cs=0 l=1 rev1=1 crypto rx=0x7efd74069310 tx=0x7efd740684f0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd79a7e700 1 -- 172.21.15.63:0/2775121055 shutdown_connections 2023-12-01T15:59:44.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd79a7e700 1 --2- 172.21.15.63:0/2775121055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd6c0c87e0 0x7efd6c0cabd0 unknown :-1 s=CLOSED pgs=2940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd79a7e700 1 -- 172.21.15.63:0/2775121055 >> 172.21.15.63:0/2775121055 conn(0x7efd6c0071d0 msgr2=0x7efd6c0242e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:44.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd79a7e700 1 -- 172.21.15.63:0/2775121055 shutdown_connections 2023-12-01T15:59:44.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd79a7e700 1 -- 172.21.15.63:0/2775121055 wait complete. 2023-12-01T15:59:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd79a7e700 1 Processor -- start 2023-12-01T15:59:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.852+0000 7efd79a7e700 1 -- start start 2023-12-01T15:59:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd79a7e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd6c0be910 0x7efd6c0bc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd79a7e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efd6c0c4cd0 0x7efd6c0bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd79a7e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efd6c0c87e0 0x7efd6c0bd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd79a7e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0c2eb0 con 0x7efd6c0be910 2023-12-01T15:59:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd79a7e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0bd7c0 con 0x7efd6c0c87e0 2023-12-01T15:59:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd79a7e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0c3150 con 0x7efd6c0c4cd0 2023-12-01T15:59:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd78a7c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd6c0be910 0x7efd6c0bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd78a7c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd6c0be910 0x7efd6c0bc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38634/0 (socket says 172.21.15.63:38634) 2023-12-01T15:59:44.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd78a7c700 1 -- 172.21.15.63:0/4220204720 learned_addr learned my addr 172.21.15.63:0/4220204720 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:44.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd7927d700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efd6c0c87e0 0x7efd6c0bd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd73fff700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efd6c0c4cd0 0x7efd6c0bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd78a7c700 1 -- 172.21.15.63:0/4220204720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efd6c0c4cd0 msgr2=0x7efd6c0bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd78a7c700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efd6c0c4cd0 0x7efd6c0bcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd78a7c700 1 -- 172.21.15.63:0/4220204720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efd6c0c87e0 msgr2=0x7efd6c0bd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd78a7c700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efd6c0c87e0 0x7efd6c0bd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd78a7c700 1 -- 172.21.15.63:0/4220204720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7406b8a0 con 0x7efd6c0be910 2023-12-01T15:59:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd78a7c700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd6c0be910 0x7efd6c0bc710 secure :-1 s=READY pgs=2941 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c700 tx=0x7efd6800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd717fa700 1 -- 172.21.15.63:0/4220204720 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68005d90 con 0x7efd6c0be910 2023-12-01T15:59:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd717fa700 1 -- 172.21.15.63:0/4220204720 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd680070d0 con 0x7efd6c0be910 2023-12-01T15:59:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd79a7e700 1 -- 172.21.15.63:0/4220204720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c0c3990 con 0x7efd6c0be910 2023-12-01T15:59:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd717fa700 1 -- 172.21.15.63:0/4220204720 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68007480 con 0x7efd6c0be910 2023-12-01T15:59:44.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd79a7e700 1 -- 172.21.15.63:0/4220204720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c0c3c70 con 0x7efd6c0be910 2023-12-01T15:59:44.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.856+0000 7efd79a7e700 1 -- 172.21.15.63:0/4220204720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd6c023aa0 con 0x7efd6c0be910 2023-12-01T15:59:44.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.860+0000 7efd717fa700 1 -- 172.21.15.63:0/4220204720 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efd680075e0 con 0x7efd6c0be910 2023-12-01T15:59:44.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.860+0000 7efd717fa700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7efd58065ad0 0x7efd58067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.860+0000 7efd717fa700 1 -- 172.21.15.63:0/4220204720 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7efd680827e0 con 0x7efd6c0be910 2023-12-01T15:59:44.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.860+0000 7efd717fa700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] conn(0x7efd5806d780 0x7efd5806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:44.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.860+0000 7efd717fa700 1 -- 172.21.15.63:0/4220204720 --> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd580702d0 con 0x7efd5806d780 2023-12-01T15:59:44.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.860+0000 7efd717fa700 1 -- 172.21.15.63:0/4220204720 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd68082b50 con 0x7efd6c0be910 2023-12-01T15:59:44.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.860+0000 7efd73fff700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7efd58065ad0 0x7efd58067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.860+0000 7efd7927d700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] conn(0x7efd5806d780 0x7efd5806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:44.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.860+0000 7efd7927d700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] conn(0x7efd5806d780 0x7efd5806fc00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:44.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.860+0000 7efd73fff700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7efd58065ad0 0x7efd58067f90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0c4970 tx=0x7efd60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:44.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.860+0000 7efd717fa700 1 -- 172.21.15.63:0/4220204720 <== osd.1 v2:172.21.15.63:6800/29723 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efd580702d0 con 0x7efd5806d780 2023-12-01T15:59:44.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd79a7e700 1 -- 172.21.15.63:0/4220204720 --> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efd6c026450 con 0x7efd5806d780 2023-12-01T15:59:44.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd717fa700 1 -- 172.21.15.63:0/4220204720 <== osd.1 v2:172.21.15.63:6800/29723 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efd7404f3f0 con 0x7efd5806d780 2023-12-01T15:59:44.894 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-01T15:59:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-01T15:59:44.895 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-01T15:59:44.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd79a7e700 1 -- 172.21.15.63:0/4220204720 >> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] conn(0x7efd5806d780 msgr2=0x7efd5806fc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd79a7e700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.63:6800/29723,v1:172.21.15.63:6801/29723] conn(0x7efd5806d780 0x7efd5806fc00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:44.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd79a7e700 1 -- 172.21.15.63:0/4220204720 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7efd58065ad0 msgr2=0x7efd58067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd79a7e700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7efd58065ad0 0x7efd58067f90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0c4970 tx=0x7efd60009040 comp rx=0 tx=0).stop 2023-12-01T15:59:44.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd79a7e700 1 -- 172.21.15.63:0/4220204720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd6c0be910 msgr2=0x7efd6c0bc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:44.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd79a7e700 1 --2- 172.21.15.63:0/4220204720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd6c0be910 0x7efd6c0bc710 secure :-1 s=READY pgs=2941 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c700 tx=0x7efd6800ca10 comp rx=0 tx=0).stop 2023-12-01T15:59:44.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd7927d700 1 -- 172.21.15.63:0/4220204720 reap_dead start 2023-12-01T15:59:44.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd79a7e700 1 -- 172.21.15.63:0/4220204720 shutdown_connections 2023-12-01T15:59:44.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd79a7e700 1 -- 172.21.15.63:0/4220204720 >> 172.21.15.63:0/4220204720 conn(0x7efd6c0071d0 msgr2=0x7efd6c0baad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:44.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd79a7e700 1 -- 172.21.15.63:0/4220204720 shutdown_connections 2023-12-01T15:59:44.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:44.880+0000 7efd79a7e700 1 -- 172.21.15.63:0/4220204720 wait complete. 2023-12-01T15:59:44.907 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-01T15:59:45.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.012+0000 7f7a5359e700 1 Processor -- start 2023-12-01T15:59:45.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.012+0000 7f7a5359e700 1 -- start start 2023-12-01T15:59:45.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a4c0bae30 0x7f7a4c01cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7a4c0bb210 0x7f7a4c01a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a4c0215a0 0x7f7a4c01a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c01d450 con 0x7f7a4c0bae30 2023-12-01T15:59:45.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c01fd20 con 0x7f7a4c0bb210 2023-12-01T15:59:45.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c01c910 con 0x7f7a4c0215a0 2023-12-01T15:59:45.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5259c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a4c0bae30 0x7f7a4c01cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a51d9b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7a4c0bb210 0x7f7a4c01a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a52d9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a4c0215a0 0x7f7a4c01a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a51d9b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7a4c0bb210 0x7f7a4c01a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:38734/0 (socket says 172.21.15.63:38734) 2023-12-01T15:59:45.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a51d9b700 1 -- 172.21.15.63:0/3739889680 learned_addr learned my addr 172.21.15.63:0/3739889680 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:45.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a51d9b700 1 -- 172.21.15.63:0/3739889680 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a4c0215a0 msgr2=0x7f7a4c01a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:45.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a51d9b700 1 --2- 172.21.15.63:0/3739889680 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a4c0215a0 0x7f7a4c01a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a51d9b700 1 -- 172.21.15.63:0/3739889680 >> v2:172.21.15.63:3300/0 conn(0x7f7a4c0bae30 msgr2=0x7f7a4c01cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:45.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a51d9b700 1 --2- 172.21.15.63:0/3739889680 >> v2:172.21.15.63:3300/0 conn(0x7f7a4c0bae30 0x7f7a4c01cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a51d9b700 1 -- 172.21.15.63:0/3739889680 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c01d630 con 0x7f7a4c0bb210 2023-12-01T15:59:45.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a51d9b700 1 --2- 172.21.15.63:0/3739889680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c0bb210 0x7f7a4c01a490 secure :-1 s=READY pgs=2939 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c021ef0 tx=0x7f7a44009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=679eb0af284a521e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5159a700 1 -- 172.21.15.63:0/3739889680 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44011830 con 0x7f7a4c0bb210 2023-12-01T15:59:45.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5159a700 1 -- 172.21.15.63:0/3739889680 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a44011990 con 0x7f7a4c0bb210 2023-12-01T15:59:45.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5159a700 1 -- 172.21.15.63:0/3739889680 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44011d40 con 0x7f7a4c0bb210 2023-12-01T15:59:45.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 -- 172.21.15.63:0/3739889680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c0bb210 msgr2=0x7f7a4c01a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 --2- 172.21.15.63:0/3739889680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c0bb210 0x7f7a4c01a490 secure :-1 s=READY pgs=2939 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c021ef0 tx=0x7f7a44009c20 comp rx=0 tx=0).stop 2023-12-01T15:59:45.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 -- 172.21.15.63:0/3739889680 shutdown_connections 2023-12-01T15:59:45.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 --2- 172.21.15.63:0/3739889680 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a4c0215a0 0x7f7a4c01a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 --2- 172.21.15.63:0/3739889680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c0bb210 0x7f7a4c01a490 unknown :-1 s=CLOSED pgs=2939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 --2- 172.21.15.63:0/3739889680 >> v2:172.21.15.63:3300/0 conn(0x7f7a4c0bae30 0x7f7a4c01cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 -- 172.21.15.63:0/3739889680 >> 172.21.15.63:0/3739889680 conn(0x7f7a4c006ee0 msgr2=0x7f7a4c01fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:45.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 -- 172.21.15.63:0/3739889680 shutdown_connections 2023-12-01T15:59:45.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 -- 172.21.15.63:0/3739889680 wait complete. 2023-12-01T15:59:45.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.016+0000 7f7a5359e700 1 Processor -- start 2023-12-01T15:59:45.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a5359e700 1 -- start start 2023-12-01T15:59:45.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a5359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a4c0215a0 0x7f7a4c152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a5359e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a4c0bae30 0x7f7a4c1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a5359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c0bb210 0x7f7a4c152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a5359e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c1432d0 con 0x7f7a4c0bae30 2023-12-01T15:59:45.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a5359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0bb9c0 con 0x7f7a4c0bb210 2023-12-01T15:59:45.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a5359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c1446a0 con 0x7f7a4c0215a0 2023-12-01T15:59:45.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a51d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a4c0bae30 0x7f7a4c1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a51d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a4c0bae30 0x7f7a4c1526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38646/0 (socket says 172.21.15.63:38646) 2023-12-01T15:59:45.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a51d9b700 1 -- 172.21.15.63:0/636084410 learned_addr learned my addr 172.21.15.63:0/636084410 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:45.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a52d9d700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c0bb210 0x7f7a4c152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a5259c700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a4c0215a0 0x7f7a4c152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a51d9b700 1 -- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a4c0215a0 msgr2=0x7f7a4c152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a51d9b700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a4c0215a0 0x7f7a4c152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a51d9b700 1 -- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c0bb210 msgr2=0x7f7a4c152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a51d9b700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c0bb210 0x7f7a4c152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a51d9b700 1 -- 172.21.15.63:0/636084410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a44009570 con 0x7f7a4c0bae30 2023-12-01T15:59:45.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a51d9b700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a4c0bae30 0x7f7a4c1526b0 secure :-1 s=READY pgs=2942 cs=0 l=1 rev1=1 crypto rx=0x7f7a44013000 tx=0x7f7a44004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a42ffd700 1 -- 172.21.15.63:0/636084410 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44004250 con 0x7f7a4c0bae30 2023-12-01T15:59:45.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a5359e700 1 -- 172.21.15.63:0/636084410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c143aa0 con 0x7f7a4c0bae30 2023-12-01T15:59:45.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a42ffd700 1 -- 172.21.15.63:0/636084410 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4401f070 con 0x7f7a4c0bae30 2023-12-01T15:59:45.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a5359e700 1 -- 172.21.15.63:0/636084410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c02c9f0 con 0x7f7a4c0bae30 2023-12-01T15:59:45.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.020+0000 7f7a42ffd700 1 -- 172.21.15.63:0/636084410 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440045b0 con 0x7f7a4c0bae30 2023-12-01T15:59:45.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.024+0000 7f7a5359e700 1 -- 172.21.15.63:0/636084410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c005460 con 0x7f7a4c0bae30 2023-12-01T15:59:45.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.024+0000 7f7a42ffd700 1 -- 172.21.15.63:0/636084410 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7a44021030 con 0x7f7a4c0bae30 2023-12-01T15:59:45.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.024+0000 7f7a42ffd700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7a34065ad0 0x7f7a34067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.024+0000 7f7a42ffd700 1 -- 172.21.15.63:0/636084410 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7f7a44084480 con 0x7f7a4c0bae30 2023-12-01T15:59:45.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.024+0000 7f7a5259c700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7a34065ad0 0x7f7a34067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.028+0000 7f7a5259c700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7a34065ad0 0x7f7a34067f90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800bd50 tx=0x7f7a4800b450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.032+0000 7f7a42ffd700 1 -- 172.21.15.63:0/636084410 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f7a44052350 con 0x7f7a4c0bae30 2023-12-01T15:59:45.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.196+0000 7f7a5359e700 1 -- 172.21.15.63:0/636084410 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a4c0bac10 con 0x7f7a34065ad0 2023-12-01T15:59:45.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.196+0000 7f7a42ffd700 1 -- 172.21.15.63:0/636084410 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7a48011c50 con 0x7f7a34065ad0 2023-12-01T15:59:45.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 -- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7a34065ad0 msgr2=0x7f7a34067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7a34065ad0 0x7f7a34067f90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800bd50 tx=0x7f7a4800b450 comp rx=0 tx=0).stop 2023-12-01T15:59:45.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 -- 172.21.15.63:0/636084410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a4c0bae30 msgr2=0x7f7a4c1526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a4c0bae30 0x7f7a4c1526b0 secure :-1 s=READY pgs=2942 cs=0 l=1 rev1=1 crypto rx=0x7f7a44013000 tx=0x7f7a44004770 comp rx=0 tx=0).stop 2023-12-01T15:59:45.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 -- 172.21.15.63:0/636084410 shutdown_connections 2023-12-01T15:59:45.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7a34065ad0 0x7f7a34067f90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c0bb210 0x7f7a4c152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a4c0bae30 0x7f7a4c1526b0 unknown :-1 s=CLOSED pgs=2942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 --2- 172.21.15.63:0/636084410 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a4c0215a0 0x7f7a4c152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 -- 172.21.15.63:0/636084410 >> 172.21.15.63:0/636084410 conn(0x7f7a4c006ee0 msgr2=0x7f7a4c01fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:45.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 -- 172.21.15.63:0/636084410 shutdown_connections 2023-12-01T15:59:45.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.204+0000 7f7a5359e700 1 -- 172.21.15.63:0/636084410 wait complete. 2023-12-01T15:59:45.219 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 1 to deep-scrub 2023-12-01T15:59:45.232 INFO:tasks.ceph:Scrubbing osd.2 2023-12-01T15:59:45.233 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-01T15:59:45.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.344+0000 7f69e177d700 1 Processor -- start 2023-12-01T15:59:45.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.344+0000 7f69e177d700 1 -- start start 2023-12-01T15:59:45.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69dc137920 0x7f69dc137d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f69dc13acf0 0x7f69dc142920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc06c470 con 0x7f69dc06d330 2023-12-01T15:59:45.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69dc06db30 con 0x7f69dc13acf0 2023-12-01T15:59:45.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc06bb70 con 0x7f69dc137920 2023-12-01T15:59:45.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69d37fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f69dc06d330 0x7f69dc13a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45230/0 (socket says 172.21.15.63:45230) 2023-12-01T15:59:45.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69d37fe700 1 -- 172.21.15.63:0/4242490778 learned_addr learned my addr 172.21.15.63:0/4242490778 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T15:59:45.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69dbfff700 1 --2- 172.21.15.63:0/4242490778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69dc137920 0x7f69dc137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e0f7c700 1 --2- 172.21.15.63:0/4242490778 >> v2:172.21.15.66:3300/0 conn(0x7f69dc13acf0 0x7f69dc142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69db7fe700 1 -- 172.21.15.63:0/4242490778 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968678706 0 0) 0x7f69dc06c470 con 0x7f69dc06d330 2023-12-01T15:59:45.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69db7fe700 1 -- 172.21.15.63:0/4242490778 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69bc0035d0 con 0x7f69dc06d330 2023-12-01T15:59:45.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69db7fe700 1 -- 172.21.15.63:0/4242490778 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678361490 0 0) 0x7f69bc0035d0 con 0x7f69dc06d330 2023-12-01T15:59:45.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69dbfff700 1 -- 172.21.15.63:0/4242490778 >> v2:172.21.15.66:3300/0 conn(0x7f69dc13acf0 msgr2=0x7f69dc142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:45.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69dbfff700 1 --2- 172.21.15.63:0/4242490778 >> v2:172.21.15.66:3300/0 conn(0x7f69dc13acf0 0x7f69dc142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69dbfff700 1 -- 172.21.15.63:0/4242490778 >> v1:172.21.15.63:6789/0 conn(0x7f69dc06d330 legacy=0x7f69dc13a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69dbfff700 1 -- 172.21.15.63:0/4242490778 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc06c1b0 con 0x7f69dc137920 2023-12-01T15:59:45.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e0f7c700 1 --2- 172.21.15.63:0/4242490778 >> v2:172.21.15.66:3300/0 conn(0x7f69dc13acf0 0x7f69dc142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:59:45.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69dbfff700 1 --2- 172.21.15.63:0/4242490778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69dc137920 0x7f69dc137d00 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009850 tx=0x7f69cc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2328ed121b256491 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69db7fe700 1 -- 172.21.15.63:0/4242490778 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4001670 con 0x7f69dc137920 2023-12-01T15:59:45.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69db7fe700 1 -- 172.21.15.63:0/4242490778 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc004030 con 0x7f69dc137920 2023-12-01T15:59:45.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69db7fe700 1 -- 172.21.15.63:0/4242490778 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0043e0 con 0x7f69dc137920 2023-12-01T15:59:45.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 -- 172.21.15.63:0/4242490778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69dc137920 msgr2=0x7f69dc137d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 --2- 172.21.15.63:0/4242490778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69dc137920 0x7f69dc137d00 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009850 tx=0x7f69cc009b60 comp rx=0 tx=0).stop 2023-12-01T15:59:45.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 -- 172.21.15.63:0/4242490778 shutdown_connections 2023-12-01T15:59:45.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 --2- 172.21.15.63:0/4242490778 >> v2:172.21.15.66:3300/0 conn(0x7f69dc13acf0 0x7f69dc142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 --2- 172.21.15.63:0/4242490778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69dc137920 0x7f69dc137d00 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 -- 172.21.15.63:0/4242490778 >> 172.21.15.63:0/4242490778 conn(0x7f69dc0aa830 msgr2=0x7f69dc0aac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:45.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 -- 172.21.15.63:0/4242490778 shutdown_connections 2023-12-01T15:59:45.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.348+0000 7f69e177d700 1 -- 172.21.15.63:0/4242490778 wait complete. 2023-12-01T15:59:45.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e177d700 1 Processor -- start 2023-12-01T15:59:45.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e177d700 1 -- start start 2023-12-01T15:59:45.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e177d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69dc06d330 0x7f69dc0a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e177d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc137920 0x7f69dc0a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e177d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69dc13acf0 0x7f69dc0a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e177d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc098fe0 con 0x7f69dc137920 2023-12-01T15:59:45.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e177d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0a03d0 con 0x7f69dc13acf0 2023-12-01T15:59:45.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e177d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc09e070 con 0x7f69dc06d330 2023-12-01T15:59:45.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69d37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc137920 0x7f69dc0a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69dbfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69dc06d330 0x7f69dc0a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69d37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc137920 0x7f69dc0a31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38658/0 (socket says 172.21.15.63:38658) 2023-12-01T15:59:45.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69d37fe700 1 -- 172.21.15.63:0/4050298804 learned_addr learned my addr 172.21.15.63:0/4050298804 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:45.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e0f7c700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69dc13acf0 0x7f69dc0a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69dbfff700 1 -- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69dc13acf0 msgr2=0x7f69dc0a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69dbfff700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69dc13acf0 0x7f69dc0a3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69dbfff700 1 -- 172.21.15.63:0/4050298804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc137920 msgr2=0x7f69dc0a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69dbfff700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc137920 0x7f69dc0a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69dbfff700 1 -- 172.21.15.63:0/4050298804 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d4009a70 con 0x7f69dc06d330 2023-12-01T15:59:45.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69d37fe700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc137920 0x7f69dc0a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:59:45.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69dbfff700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69dc06d330 0x7f69dc0a2c80 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f69cc015000 tx=0x7f69cc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69d97fa700 1 -- 172.21.15.63:0/4050298804 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc003cd0 con 0x7f69dc06d330 2023-12-01T15:59:45.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69d97fa700 1 -- 172.21.15.63:0/4050298804 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc01f070 con 0x7f69dc06d330 2023-12-01T15:59:45.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e177d700 1 -- 172.21.15.63:0/4050298804 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc0094b0 con 0x7f69dc06d330 2023-12-01T15:59:45.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69d97fa700 1 -- 172.21.15.63:0/4050298804 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc011870 con 0x7f69dc06d330 2023-12-01T15:59:45.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e177d700 1 -- 172.21.15.63:0/4050298804 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc09ec30 con 0x7f69dc06d330 2023-12-01T15:59:45.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.352+0000 7f69e177d700 1 -- 172.21.15.63:0/4050298804 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69dc06bdc0 con 0x7f69dc06d330 2023-12-01T15:59:45.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.356+0000 7f69d97fa700 1 -- 172.21.15.63:0/4050298804 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f69cc0119d0 con 0x7f69dc06d330 2023-12-01T15:59:45.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.356+0000 7f69d97fa700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f69c0065ad0 0x7f69c0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.356+0000 7f69d97fa700 1 -- 172.21.15.63:0/4050298804 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7f69cc021070 con 0x7f69dc06d330 2023-12-01T15:59:45.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.356+0000 7f69d97fa700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] conn(0x7f69c006d780 0x7f69c006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.356+0000 7f69d97fa700 1 -- 172.21.15.63:0/4050298804 --> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69c00702d0 con 0x7f69c006d780 2023-12-01T15:59:45.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.356+0000 7f69d97fa700 1 -- 172.21.15.63:0/4050298804 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69cc084880 con 0x7f69dc06d330 2023-12-01T15:59:45.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.356+0000 7f69d37fe700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f69c0065ad0 0x7f69c0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.356+0000 7f69e0f7c700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] conn(0x7f69c006d780 0x7f69c006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.356+0000 7f69e0f7c700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] conn(0x7f69c006d780 0x7f69c006fc00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.356+0000 7f69d37fe700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f69c0065ad0 0x7f69c0067f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f69c4001820 tx=0x7f69c4001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.360+0000 7f69d97fa700 1 -- 172.21.15.63:0/4050298804 <== osd.2 v2:172.21.15.66:6808/29906 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f69c00702d0 con 0x7f69c006d780 2023-12-01T15:59:45.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.372+0000 7f69e177d700 1 -- 172.21.15.63:0/4050298804 --> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f69dc09a580 con 0x7f69c006d780 2023-12-01T15:59:45.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69d97fa700 1 -- 172.21.15.63:0/4050298804 <== osd.2 v2:172.21.15.66:6808/29906 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f69dc09a580 con 0x7f69c006d780 2023-12-01T15:59:45.389 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-01T15:59:45.390 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-01T15:59:45.390 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-01T15:59:45.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69e177d700 1 -- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] conn(0x7f69c006d780 msgr2=0x7f69c006fc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69e177d700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:6808/29906,v1:172.21.15.66:6809/29906] conn(0x7f69c006d780 0x7f69c006fc00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69e177d700 1 -- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f69c0065ad0 msgr2=0x7f69c0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69e177d700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f69c0065ad0 0x7f69c0067f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f69c4001820 tx=0x7f69c4001230 comp rx=0 tx=0).stop 2023-12-01T15:59:45.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69e177d700 1 -- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69dc06d330 msgr2=0x7f69dc0a2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69e177d700 1 --2- 172.21.15.63:0/4050298804 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69dc06d330 0x7f69dc0a2c80 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f69cc015000 tx=0x7f69cc004770 comp rx=0 tx=0).stop 2023-12-01T15:59:45.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69e0f7c700 1 -- 172.21.15.63:0/4050298804 reap_dead start 2023-12-01T15:59:45.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69e177d700 1 -- 172.21.15.63:0/4050298804 shutdown_connections 2023-12-01T15:59:45.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69e177d700 1 -- 172.21.15.63:0/4050298804 >> 172.21.15.63:0/4050298804 conn(0x7f69dc0aa830 msgr2=0x7f69dc0a9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:45.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69e177d700 1 -- 172.21.15.63:0/4050298804 shutdown_connections 2023-12-01T15:59:45.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.376+0000 7f69e177d700 1 -- 172.21.15.63:0/4050298804 wait complete. 2023-12-01T15:59:45.402 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-01T15:59:45.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f3781850700 1 Processor -- start 2023-12-01T15:59:45.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f3781850700 1 -- start start 2023-12-01T15:59:45.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f3781850700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f377c13da10 0x7f377c13fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f3781850700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f377c140340 0x7f377c142730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f3781850700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c06d590 con 0x7f377c1342a0 2023-12-01T15:59:45.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f3781850700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c06c6d0 con 0x7f377c13da10 2023-12-01T15:59:45.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f3781850700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c06d7b0 con 0x7f377c140340 2023-12-01T15:59:45.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f377bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f377c13da10 0x7f377c13fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f377bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f377c13da10 0x7f377c13fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38674/0 (socket says 172.21.15.63:38674) 2023-12-01T15:59:45.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f377bfff700 1 -- 172.21.15.63:0/1779716321 learned_addr learned my addr 172.21.15.63:0/1779716321 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:45.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f378084e700 1 --1- 172.21.15.63:0/1779716321 >> v1:172.21.15.63:6789/0 conn(0x7f377c1342a0 0x7f377c134680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45244/0 (socket says 172.21.15.63:45244) 2023-12-01T15:59:45.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f378104f700 1 --2- 172.21.15.63:0/1779716321 >> v2:172.21.15.66:3300/0 conn(0x7f377c140340 0x7f377c142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f377bfff700 1 -- 172.21.15.63:0/1779716321 >> v2:172.21.15.66:3300/0 conn(0x7f377c140340 msgr2=0x7f377c142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:45.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f377bfff700 1 --2- 172.21.15.63:0/1779716321 >> v2:172.21.15.66:3300/0 conn(0x7f377c140340 0x7f377c142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f377bfff700 1 -- 172.21.15.63:0/1779716321 >> v1:172.21.15.63:6789/0 conn(0x7f377c1342a0 legacy=0x7f377c134680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f377bfff700 1 -- 172.21.15.63:0/1779716321 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c06c410 con 0x7f377c13da10 2023-12-01T15:59:45.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f377bfff700 1 --2- 172.21.15.63:0/1779716321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c13da10 0x7f377c13fe00 secure :-1 s=READY pgs=2945 cs=0 l=1 rev1=1 crypto rx=0x7f377c06c5a0 tx=0x7f376c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385422a4d60d2fc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f377b7fe700 1 -- 172.21.15.63:0/1779716321 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c004230 con 0x7f377c13da10 2023-12-01T15:59:45.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f377b7fe700 1 -- 172.21.15.63:0/1779716321 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c004390 con 0x7f377c13da10 2023-12-01T15:59:45.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.504+0000 7f377b7fe700 1 -- 172.21.15.63:0/1779716321 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0036c0 con 0x7f377c13da10 2023-12-01T15:59:45.530 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 -- 172.21.15.63:0/1779716321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c13da10 msgr2=0x7f377c13fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 --2- 172.21.15.63:0/1779716321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c13da10 0x7f377c13fe00 secure :-1 s=READY pgs=2945 cs=0 l=1 rev1=1 crypto rx=0x7f377c06c5a0 tx=0x7f376c009bf0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 -- 172.21.15.63:0/1779716321 shutdown_connections 2023-12-01T15:59:45.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 --2- 172.21.15.63:0/1779716321 >> v2:172.21.15.66:3300/0 conn(0x7f377c140340 0x7f377c142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 --2- 172.21.15.63:0/1779716321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c13da10 0x7f377c13fe00 unknown :-1 s=CLOSED pgs=2945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 -- 172.21.15.63:0/1779716321 >> 172.21.15.63:0/1779716321 conn(0x7f377c0a7730 msgr2=0x7f377c0aa600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:45.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 -- 172.21.15.63:0/1779716321 shutdown_connections 2023-12-01T15:59:45.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 -- 172.21.15.63:0/1779716321 wait complete. 2023-12-01T15:59:45.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 Processor -- start 2023-12-01T15:59:45.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 -- start start 2023-12-01T15:59:45.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c1342a0 0x7f377c137a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f377c13da10 0x7f377c131100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f377c140340 0x7f377c131640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c06bb00 con 0x7f377c1342a0 2023-12-01T15:59:45.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0a3940 con 0x7f377c13da10 2023-12-01T15:59:45.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f3781850700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c1382f0 con 0x7f377c140340 2023-12-01T15:59:45.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f378084e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c1342a0 0x7f377c137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f378084e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c1342a0 0x7f377c137a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38690/0 (socket says 172.21.15.63:38690) 2023-12-01T15:59:45.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f378084e700 1 -- 172.21.15.63:0/3888844532 learned_addr learned my addr 172.21.15.63:0/3888844532 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:45.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f377bfff700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f377c13da10 0x7f377c131100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.508+0000 7f378104f700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f377c140340 0x7f377c131640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f378084e700 1 -- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f377c140340 msgr2=0x7f377c131640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f378084e700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f377c140340 0x7f377c131640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f378084e700 1 -- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f377c13da10 msgr2=0x7f377c131100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f378084e700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f377c13da10 0x7f377c131100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f378084e700 1 -- 172.21.15.63:0/3888844532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c009570 con 0x7f377c1342a0 2023-12-01T15:59:45.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f378084e700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c1342a0 0x7f377c137a50 secure :-1 s=READY pgs=2946 cs=0 l=1 rev1=1 crypto rx=0x7f377000c530 tx=0x7f377000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f37797fa700 1 -- 172.21.15.63:0/3888844532 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770005cd0 con 0x7f377c1342a0 2023-12-01T15:59:45.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f37797fa700 1 -- 172.21.15.63:0/3888844532 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770005e30 con 0x7f377c1342a0 2023-12-01T15:59:45.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f3781850700 1 -- 172.21.15.63:0/3888844532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c0a2bb0 con 0x7f377c1342a0 2023-12-01T15:59:45.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f37797fa700 1 -- 172.21.15.63:0/3888844532 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37700072f0 con 0x7f377c1342a0 2023-12-01T15:59:45.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f3781850700 1 -- 172.21.15.63:0/3888844532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c131b80 con 0x7f377c1342a0 2023-12-01T15:59:45.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f3781850700 1 -- 172.21.15.63:0/3888844532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c065fb0 con 0x7f377c1342a0 2023-12-01T15:59:45.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.512+0000 7f37797fa700 1 -- 172.21.15.63:0/3888844532 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3770007450 con 0x7f377c1342a0 2023-12-01T15:59:45.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.516+0000 7f37797fa700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3768065ad0 0x7f3768067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.516+0000 7f37797fa700 1 -- 172.21.15.63:0/3888844532 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7f3770081f40 con 0x7f377c1342a0 2023-12-01T15:59:45.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.516+0000 7f377bfff700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3768065ad0 0x7f3768067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.516+0000 7f377bfff700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3768065ad0 0x7f3768067f90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f377c06c5a0 tx=0x7f376c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.520+0000 7f37797fa700 1 -- 172.21.15.63:0/3888844532 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f377004feb0 con 0x7f377c1342a0 2023-12-01T15:59:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.684+0000 7f3781850700 1 -- 172.21.15.63:0/3888844532 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f377c0ab240 con 0x7f3768065ad0 2023-12-01T15:59:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f37797fa700 1 -- 172.21.15.63:0/3888844532 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f376c004130 con 0x7f3768065ad0 2023-12-01T15:59:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 -- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3768065ad0 msgr2=0x7f3768067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3768065ad0 0x7f3768067f90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f377c06c5a0 tx=0x7f376c008030 comp rx=0 tx=0).stop 2023-12-01T15:59:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 -- 172.21.15.63:0/3888844532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c1342a0 msgr2=0x7f377c137a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c1342a0 0x7f377c137a50 secure :-1 s=READY pgs=2946 cs=0 l=1 rev1=1 crypto rx=0x7f377000c530 tx=0x7f377000c840 comp rx=0 tx=0).stop 2023-12-01T15:59:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 -- 172.21.15.63:0/3888844532 shutdown_connections 2023-12-01T15:59:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3768065ad0 0x7f3768067f90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f377c140340 0x7f377c131640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f377c13da10 0x7f377c131100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 --2- 172.21.15.63:0/3888844532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c1342a0 0x7f377c137a50 unknown :-1 s=CLOSED pgs=2946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 -- 172.21.15.63:0/3888844532 >> 172.21.15.63:0/3888844532 conn(0x7f377c0a7730 msgr2=0x7f377c131fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 -- 172.21.15.63:0/3888844532 shutdown_connections 2023-12-01T15:59:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.688+0000 7f3781850700 1 -- 172.21.15.63:0/3888844532 wait complete. 2023-12-01T15:59:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 2 to deep-scrub 2023-12-01T15:59:45.716 INFO:tasks.ceph:Scrubbing osd.3 2023-12-01T15:59:45.717 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-01T15:59:45.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99a41e700 1 Processor -- start 2023-12-01T15:59:45.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99a41e700 1 -- start start 2023-12-01T15:59:45.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99a41e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd9941377b0 0x7fd994137b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99a41e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9940ab9c0 con 0x7fd99413a3e0 2023-12-01T15:59:45.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99a41e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9940aafc0 con 0x7fd99413af00 2023-12-01T15:59:45.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99a41e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9940aab40 con 0x7fd9941377b0 2023-12-01T15:59:45.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99941c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd9941377b0 0x7fd994137b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99941c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd9941377b0 0x7fd994137b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38704/0 (socket says 172.21.15.63:38704) 2023-12-01T15:59:45.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99941c700 1 -- 172.21.15.63:0/478865868 learned_addr learned my addr 172.21.15.63:0/478865868 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:45.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd998c1b700 1 --1- 172.21.15.63:0/478865868 >> v1:172.21.15.63:6789/0 conn(0x7fd99413a3e0 0x7fd99413a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45248/0 (socket says 172.21.15.63:45248) 2023-12-01T15:59:45.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99941c700 1 -- 172.21.15.63:0/478865868 >> v1:172.21.15.66:6789/0 conn(0x7fd99413af00 legacy=0x7fd994142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99941c700 1 -- 172.21.15.63:0/478865868 >> v1:172.21.15.63:6789/0 conn(0x7fd99413a3e0 legacy=0x7fd99413a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99941c700 1 -- 172.21.15.63:0/478865868 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9940ab6e0 con 0x7fd9941377b0 2023-12-01T15:59:45.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd99941c700 1 --2- 172.21.15.63:0/478865868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9941377b0 0x7fd994137b90 secure :-1 s=READY pgs=2948 cs=0 l=1 rev1=1 crypto rx=0x7fd984009e50 tx=0x7fd98400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52cdaf93304e5506 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd993fff700 1 -- 172.21.15.63:0/478865868 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400e070 con 0x7fd9941377b0 2023-12-01T15:59:45.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd993fff700 1 -- 172.21.15.63:0/478865868 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98400b9c0 con 0x7fd9941377b0 2023-12-01T15:59:45.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.824+0000 7fd993fff700 1 -- 172.21.15.63:0/478865868 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400bd70 con 0x7fd9941377b0 2023-12-01T15:59:45.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 -- 172.21.15.63:0/478865868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9941377b0 msgr2=0x7fd994137b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 --2- 172.21.15.63:0/478865868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9941377b0 0x7fd994137b90 secure :-1 s=READY pgs=2948 cs=0 l=1 rev1=1 crypto rx=0x7fd984009e50 tx=0x7fd98400b330 comp rx=0 tx=0).stop 2023-12-01T15:59:45.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 -- 172.21.15.63:0/478865868 shutdown_connections 2023-12-01T15:59:45.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 --2- 172.21.15.63:0/478865868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9941377b0 0x7fd994137b90 unknown :-1 s=CLOSED pgs=2948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 -- 172.21.15.63:0/478865868 >> 172.21.15.63:0/478865868 conn(0x7fd994073710 msgr2=0x7fd9940ac9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:45.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 -- 172.21.15.63:0/478865868 shutdown_connections 2023-12-01T15:59:45.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 -- 172.21.15.63:0/478865868 wait complete. 2023-12-01T15:59:45.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 Processor -- start 2023-12-01T15:59:45.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 -- start start 2023-12-01T15:59:45.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9941377b0 0x7fd9941cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd99413a3e0 0x7fd9941cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd99413af00 0x7fd9941d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9941368c0 con 0x7fd9941377b0 2023-12-01T15:59:45.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940a54c0 con 0x7fd99413a3e0 2023-12-01T15:59:45.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99a41e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940a41d0 con 0x7fd99413af00 2023-12-01T15:59:45.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99941c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9941377b0 0x7fd9941cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99941c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9941377b0 0x7fd9941cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38708/0 (socket says 172.21.15.63:38708) 2023-12-01T15:59:45.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd998c1b700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd99413a3e0 0x7fd9941cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99941c700 1 -- 172.21.15.63:0/3339069130 learned_addr learned my addr 172.21.15.63:0/3339069130 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:45.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd999c1d700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd99413af00 0x7fd9941d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99941c700 1 -- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd99413af00 msgr2=0x7fd9941d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99941c700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd99413af00 0x7fd9941d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99941c700 1 -- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd99413a3e0 msgr2=0x7fd9941cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99941c700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd99413a3e0 0x7fd9941cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99941c700 1 -- 172.21.15.63:0/3339069130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd984009b30 con 0x7fd9941377b0 2023-12-01T15:59:45.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.828+0000 7fd99941c700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9941377b0 0x7fd9941cf650 secure :-1 s=READY pgs=2949 cs=0 l=1 rev1=1 crypto rx=0x7fd98400b730 tx=0x7fd984004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd991ffb700 1 -- 172.21.15.63:0/3339069130 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840048b0 con 0x7fd9941377b0 2023-12-01T15:59:45.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd991ffb700 1 -- 172.21.15.63:0/3339069130 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9840092e0 con 0x7fd9941377b0 2023-12-01T15:59:45.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd99a41e700 1 -- 172.21.15.63:0/3339069130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9940a34b0 con 0x7fd9941377b0 2023-12-01T15:59:45.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd991ffb700 1 -- 172.21.15.63:0/3339069130 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98401c660 con 0x7fd9941377b0 2023-12-01T15:59:45.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd99a41e700 1 -- 172.21.15.63:0/3339069130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9940a3e30 con 0x7fd9941377b0 2023-12-01T15:59:45.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd99a41e700 1 -- 172.21.15.63:0/3339069130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd994099bc0 con 0x7fd9941377b0 2023-12-01T15:59:45.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd991ffb700 1 -- 172.21.15.63:0/3339069130 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd98401c7c0 con 0x7fd9941377b0 2023-12-01T15:59:45.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd991ffb700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd980065ad0 0x7fd980067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd991ffb700 1 -- 172.21.15.63:0/3339069130 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7fd984084fd0 con 0x7fd9941377b0 2023-12-01T15:59:45.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd998c1b700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd980065ad0 0x7fd980067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd991ffb700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] conn(0x7fd98006d700 0x7fd98006fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd991ffb700 1 -- 172.21.15.63:0/3339069130 --> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd980070250 con 0x7fd98006d700 2023-12-01T15:59:45.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd991ffb700 1 -- 172.21.15.63:0/3339069130 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd984085420 con 0x7fd9941377b0 2023-12-01T15:59:45.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd999c1d700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] conn(0x7fd98006d700 0x7fd98006fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:45.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.832+0000 7fd998c1b700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd980065ad0 0x7fd980067f90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd9940a7ab0 tx=0x7fd988007ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.836+0000 7fd999c1d700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] conn(0x7fd98006d700 0x7fd98006fb80 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:45.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.836+0000 7fd991ffb700 1 -- 172.21.15.63:0/3339069130 <== osd.3 v2:172.21.15.66:6800/29907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd980070250 con 0x7fd98006d700 2023-12-01T15:59:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd99a41e700 1 -- 172.21.15.63:0/3339069130 --> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd99409a580 con 0x7fd98006d700 2023-12-01T15:59:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd991ffb700 1 -- 172.21.15.63:0/3339069130 <== osd.3 v2:172.21.15.66:6800/29907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd99409a580 con 0x7fd98006d700 2023-12-01T15:59:45.868 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-01T15:59:45.869 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-01T15:59:45.869 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-01T15:59:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd99a41e700 1 -- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] conn(0x7fd98006d700 msgr2=0x7fd98006fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd99a41e700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:6800/29907,v1:172.21.15.66:6801/29907] conn(0x7fd98006d700 0x7fd98006fb80 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd99a41e700 1 -- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd980065ad0 msgr2=0x7fd980067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd99a41e700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd980065ad0 0x7fd980067f90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd9940a7ab0 tx=0x7fd988007ef0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd99a41e700 1 -- 172.21.15.63:0/3339069130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9941377b0 msgr2=0x7fd9941cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd99a41e700 1 --2- 172.21.15.63:0/3339069130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9941377b0 0x7fd9941cf650 secure :-1 s=READY pgs=2949 cs=0 l=1 rev1=1 crypto rx=0x7fd98400b730 tx=0x7fd984004af0 comp rx=0 tx=0).stop 2023-12-01T15:59:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd999c1d700 1 -- 172.21.15.63:0/3339069130 reap_dead start 2023-12-01T15:59:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd99a41e700 1 -- 172.21.15.63:0/3339069130 shutdown_connections 2023-12-01T15:59:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd99a41e700 1 -- 172.21.15.63:0/3339069130 >> 172.21.15.63:0/3339069130 conn(0x7fd994073710 msgr2=0x7fd9940a85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd99a41e700 1 -- 172.21.15.63:0/3339069130 shutdown_connections 2023-12-01T15:59:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.852+0000 7fd99a41e700 1 -- 172.21.15.63:0/3339069130 wait complete. 2023-12-01T15:59:45.880 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-01T15:59:45.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.980+0000 7fb68b59e700 1 Processor -- start 2023-12-01T15:59:45.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.980+0000 7fb68b59e700 1 -- start start 2023-12-01T15:59:45.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.980+0000 7fb68b59e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb68c1376e0 0x7fb68c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:45.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.980+0000 7fb68b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb68c06c5b0 0x7fb68c1428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:46.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.980+0000 7fb68b59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68c09c240 con 0x7fb68c06ba50 2023-12-01T15:59:46.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.980+0000 7fb68b59e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c138000 con 0x7fb68c1376e0 2023-12-01T15:59:46.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.980+0000 7fb68b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c09bc90 con 0x7fb68c06c5b0 2023-12-01T15:59:46.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb68c1376e0 0x7fb68c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68a59c700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb68c1376e0 0x7fb68c137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38716/0 (socket says 172.21.15.63:38716) 2023-12-01T15:59:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68a59c700 1 -- 172.21.15.63:0/2056835939 learned_addr learned my addr 172.21.15.63:0/2056835939 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68ad9d700 1 --2- 172.21.15.63:0/2056835939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb68c06c5b0 0x7fb68c1428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68a59c700 1 -- 172.21.15.63:0/2056835939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb68c06c5b0 msgr2=0x7fb68c1428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68a59c700 1 --2- 172.21.15.63:0/2056835939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb68c06c5b0 0x7fb68c1428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68a59c700 1 -- 172.21.15.63:0/2056835939 >> v1:172.21.15.66:6789/0 conn(0x7fb68c06ba50 legacy=0x7fb68c06bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:46.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68a59c700 1 -- 172.21.15.63:0/2056835939 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c09bf80 con 0x7fb68c1376e0 2023-12-01T15:59:46.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68ad9d700 1 --2- 172.21.15.63:0/2056835939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb68c06c5b0 0x7fb68c1428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T15:59:46.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68a59c700 1 --2- 172.21.15.63:0/2056835939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c1376e0 0x7fb68c137ac0 secure :-1 s=READY pgs=2950 cs=0 l=1 rev1=1 crypto rx=0x7fb680009910 tx=0x7fb680009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e4b78cfc10d96 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:46.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68959a700 1 -- 172.21.15.63:0/2056835939 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680011830 con 0x7fb68c1376e0 2023-12-01T15:59:46.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68959a700 1 -- 172.21.15.63:0/2056835939 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680011990 con 0x7fb68c1376e0 2023-12-01T15:59:46.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68959a700 1 -- 172.21.15.63:0/2056835939 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680011d40 con 0x7fb68c1376e0 2023-12-01T15:59:46.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68b59e700 1 -- 172.21.15.63:0/2056835939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c1376e0 msgr2=0x7fb68c137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:46.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68b59e700 1 --2- 172.21.15.63:0/2056835939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c1376e0 0x7fb68c137ac0 secure :-1 s=READY pgs=2950 cs=0 l=1 rev1=1 crypto rx=0x7fb680009910 tx=0x7fb680009c20 comp rx=0 tx=0).stop 2023-12-01T15:59:46.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68b59e700 1 -- 172.21.15.63:0/2056835939 shutdown_connections 2023-12-01T15:59:46.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68b59e700 1 --2- 172.21.15.63:0/2056835939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb68c06c5b0 0x7fb68c1428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68b59e700 1 --2- 172.21.15.63:0/2056835939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c1376e0 0x7fb68c137ac0 unknown :-1 s=CLOSED pgs=2950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68b59e700 1 -- 172.21.15.63:0/2056835939 >> 172.21.15.63:0/2056835939 conn(0x7fb68c0737a0 msgr2=0x7fb68c0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:46.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68b59e700 1 -- 172.21.15.63:0/2056835939 shutdown_connections 2023-12-01T15:59:46.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.984+0000 7fb68b59e700 1 -- 172.21.15.63:0/2056835939 wait complete. 2023-12-01T15:59:46.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68b59e700 1 Processor -- start 2023-12-01T15:59:46.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68b59e700 1 -- start start 2023-12-01T15:59:46.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb68c06ba50 0x7fb68c0a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:46.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68b59e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c06c5b0 0x7fb68c0a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:46.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68b59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb68c1376e0 0x7fb68c0a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:46.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68b59e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0a2740 con 0x7fb68c06c5b0 2023-12-01T15:59:46.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68b59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0a15f0 con 0x7fb68c1376e0 2023-12-01T15:59:46.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0a3320 con 0x7fb68c06ba50 2023-12-01T15:59:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb689d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c06c5b0 0x7fb68c0a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb689d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c06c5b0 0x7fb68c0a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38732/0 (socket says 172.21.15.63:38732) 2023-12-01T15:59:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb689d9b700 1 -- 172.21.15.63:0/2412918531 learned_addr learned my addr 172.21.15.63:0/2412918531 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68a59c700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb68c06ba50 0x7fb68c0a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68ad9d700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb68c1376e0 0x7fb68c0a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb689d9b700 1 -- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb68c06ba50 msgr2=0x7fb68c0a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb689d9b700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb68c06ba50 0x7fb68c0a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb689d9b700 1 -- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb68c1376e0 msgr2=0x7fb68c0a0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb689d9b700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb68c1376e0 0x7fb68c0a0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb689d9b700 1 -- 172.21.15.63:0/2412918531 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb684009a70 con 0x7fb68c06c5b0 2023-12-01T15:59:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb689d9b700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c06c5b0 0x7fb68c0a0a70 secure :-1 s=READY pgs=2951 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00c500 tx=0x7fb67c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb67affd700 1 -- 172.21.15.63:0/2412918531 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00cea0 con 0x7fb68c06c5b0 2023-12-01T15:59:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb67affd700 1 -- 172.21.15.63:0/2412918531 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c0052d0 con 0x7fb68c06c5b0 2023-12-01T15:59:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68b59e700 1 -- 172.21.15.63:0/2412918531 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb680009570 con 0x7fb68c06c5b0 2023-12-01T15:59:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb67affd700 1 -- 172.21.15.63:0/2412918531 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0036a0 con 0x7fb68c06c5b0 2023-12-01T15:59:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.988+0000 7fb68b59e700 1 -- 172.21.15.63:0/2412918531 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c0a38c0 con 0x7fb68c06c5b0 2023-12-01T15:59:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.992+0000 7fb68b59e700 1 -- 172.21.15.63:0/2412918531 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68c1c3680 con 0x7fb68c06c5b0 2023-12-01T15:59:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.992+0000 7fb67affd700 1 -- 172.21.15.63:0/2412918531 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb67c003800 con 0x7fb68c06c5b0 2023-12-01T15:59:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.992+0000 7fb67affd700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb66c065ad0 0x7fb66c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.992+0000 7fb67affd700 1 -- 172.21.15.63:0/2412918531 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7fb67c081f90 con 0x7fb68c06c5b0 2023-12-01T15:59:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.992+0000 7fb68a59c700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb66c065ad0 0x7fb66c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:45.992+0000 7fb68a59c700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb66c065ad0 0x7fb66c067f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb680000c00 tx=0x7fb680008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:46.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.000+0000 7fb67affd700 1 -- 172.21.15.63:0/2412918531 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb67c04fe60 con 0x7fb68c06c5b0 2023-12-01T15:59:46.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.164+0000 7fb68b59e700 1 -- 172.21.15.63:0/2412918531 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb68c0a1eb0 con 0x7fb66c065ad0 2023-12-01T15:59:46.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.168+0000 7fb67affd700 1 -- 172.21.15.63:0/2412918531 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb68c0a1eb0 con 0x7fb66c065ad0 2023-12-01T15:59:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 -- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb66c065ad0 msgr2=0x7fb66c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb66c065ad0 0x7fb66c067f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb680000c00 tx=0x7fb680008030 comp rx=0 tx=0).stop 2023-12-01T15:59:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 -- 172.21.15.63:0/2412918531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c06c5b0 msgr2=0x7fb68c0a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c06c5b0 0x7fb68c0a0a70 secure :-1 s=READY pgs=2951 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00c500 tx=0x7fb67c00c810 comp rx=0 tx=0).stop 2023-12-01T15:59:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 -- 172.21.15.63:0/2412918531 shutdown_connections 2023-12-01T15:59:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb66c065ad0 0x7fb66c067f90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb68c1376e0 0x7fb68c0a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c06c5b0 0x7fb68c0a0a70 unknown :-1 s=CLOSED pgs=2951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 --2- 172.21.15.63:0/2412918531 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb68c06ba50 0x7fb68c0a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 -- 172.21.15.63:0/2412918531 >> 172.21.15.63:0/2412918531 conn(0x7fb68c0737a0 msgr2=0x7fb68c0ab060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:46.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 -- 172.21.15.63:0/2412918531 shutdown_connections 2023-12-01T15:59:46.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.172+0000 7fb68b59e700 1 -- 172.21.15.63:0/2412918531 wait complete. 2023-12-01T15:59:46.187 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 3 to deep-scrub 2023-12-01T15:59:46.203 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T15:59:46.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 Processor -- start 2023-12-01T15:59:46.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 -- start start 2023-12-01T15:59:46.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff07c071600 0x7ff07c0719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:46.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff07c13ea40 0x7ff07c13eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:46.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c06f7e0 con 0x7ff07c13f3f0 2023-12-01T15:59:46.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c071f20 con 0x7ff07c13ea40 2023-12-01T15:59:46.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c06f4f0 con 0x7ff07c071600 2023-12-01T15:59:46.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff080986700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff07c13ea40 0x7ff07c13eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff080986700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff07c13ea40 0x7ff07c13eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47898/0 (socket says 172.21.15.63:47898) 2023-12-01T15:59:46.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff080986700 1 -- 172.21.15.63:0/1088537149 learned_addr learned my addr 172.21.15.63:0/1088537149 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:46.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff081187700 1 --2- 172.21.15.63:0/1088537149 >> v2:172.21.15.66:3300/0 conn(0x7ff07c071600 0x7ff07c0719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff080986700 1 -- 172.21.15.63:0/1088537149 >> v2:172.21.15.66:3300/0 conn(0x7ff07c071600 msgr2=0x7ff07c0719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:46.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff080986700 1 --2- 172.21.15.63:0/1088537149 >> v2:172.21.15.66:3300/0 conn(0x7ff07c071600 0x7ff07c0719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff080986700 1 -- 172.21.15.63:0/1088537149 >> v1:172.21.15.66:6789/0 conn(0x7ff07c13f3f0 legacy=0x7ff07c145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T15:59:46.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff080986700 1 -- 172.21.15.63:0/1088537149 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c13f860 con 0x7ff07c13ea40 2023-12-01T15:59:46.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff080986700 1 --2- 172.21.15.63:0/1088537149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff07c13ea40 0x7ff07c13eeb0 secure :-1 s=READY pgs=2952 cs=0 l=1 rev1=1 crypto rx=0x7ff07c06def0 tx=0x7ff07800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79996efe2a28160b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:46.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff06ffff700 1 -- 172.21.15.63:0/1088537149 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07800e070 con 0x7ff07c13ea40 2023-12-01T15:59:46.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff06ffff700 1 -- 172.21.15.63:0/1088537149 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff078003a40 con 0x7ff07c13ea40 2023-12-01T15:59:46.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff06ffff700 1 -- 172.21.15.63:0/1088537149 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078003df0 con 0x7ff07c13ea40 2023-12-01T15:59:46.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 -- 172.21.15.63:0/1088537149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff07c13ea40 msgr2=0x7ff07c13eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:46.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 --2- 172.21.15.63:0/1088537149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff07c13ea40 0x7ff07c13eeb0 secure :-1 s=READY pgs=2952 cs=0 l=1 rev1=1 crypto rx=0x7ff07c06def0 tx=0x7ff07800b330 comp rx=0 tx=0).stop 2023-12-01T15:59:46.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 -- 172.21.15.63:0/1088537149 shutdown_connections 2023-12-01T15:59:46.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 --2- 172.21.15.63:0/1088537149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff07c13ea40 0x7ff07c13eeb0 unknown :-1 s=CLOSED pgs=2952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 --2- 172.21.15.63:0/1088537149 >> v2:172.21.15.66:3300/0 conn(0x7ff07c071600 0x7ff07c0719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 -- 172.21.15.63:0/1088537149 >> 172.21.15.63:0/1088537149 conn(0x7ff07c0a8bd0 msgr2=0x7ff07c098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:46.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 -- 172.21.15.63:0/1088537149 shutdown_connections 2023-12-01T15:59:46.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 -- 172.21.15.63:0/1088537149 wait complete. 2023-12-01T15:59:46.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.304+0000 7ff082189700 1 Processor -- start 2023-12-01T15:59:46.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff082189700 1 -- start start 2023-12-01T15:59:46.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff082189700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff07c071600 0x7ff07c1d3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:46.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff082189700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c13ea40 0x7ff07c1d4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:46.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff082189700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c13f3f0 0x7ff07c1d4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:46.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff082189700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0a5dd0 con 0x7ff07c071600 2023-12-01T15:59:46.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff082189700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0a5b80 con 0x7ff07c13f3f0 2023-12-01T15:59:46.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff082189700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c1277b0 con 0x7ff07c13ea40 2023-12-01T15:59:46.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff081187700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff07c071600 0x7ff07c1d3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff081187700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff07c071600 0x7ff07c1d3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47902/0 (socket says 172.21.15.63:47902) 2023-12-01T15:59:46.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff081187700 1 -- 172.21.15.63:0/1364413777 learned_addr learned my addr 172.21.15.63:0/1364413777 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T15:59:46.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff081988700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c13f3f0 0x7ff07c1d4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff080986700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c13ea40 0x7ff07c1d4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff081187700 1 -- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c13ea40 msgr2=0x7ff07c1d4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:46.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff081187700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c13ea40 0x7ff07c1d4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff081187700 1 -- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c13f3f0 msgr2=0x7ff07c1d4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:46.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff081187700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c13f3f0 0x7ff07c1d4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff081187700 1 -- 172.21.15.63:0/1364413777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff078009b30 con 0x7ff07c071600 2023-12-01T15:59:46.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff081187700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff07c071600 0x7ff07c1d3dd0 secure :-1 s=READY pgs=2953 cs=0 l=1 rev1=1 crypto rx=0x7ff07000d800 tx=0x7ff07000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:46.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff06dffb700 1 -- 172.21.15.63:0/1364413777 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700125f0 con 0x7ff07c071600 2023-12-01T15:59:46.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff06dffb700 1 -- 172.21.15.63:0/1364413777 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff070012750 con 0x7ff07c071600 2023-12-01T15:59:46.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff082189700 1 -- 172.21.15.63:0/1364413777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c127a90 con 0x7ff07c071600 2023-12-01T15:59:46.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff06dffb700 1 -- 172.21.15.63:0/1364413777 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070012ac0 con 0x7ff07c071600 2023-12-01T15:59:46.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.308+0000 7ff082189700 1 -- 172.21.15.63:0/1364413777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c128670 con 0x7ff07c071600 2023-12-01T15:59:46.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.312+0000 7ff082189700 1 -- 172.21.15.63:0/1364413777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c065fb0 con 0x7ff07c071600 2023-12-01T15:59:46.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.312+0000 7ff06dffb700 1 -- 172.21.15.63:0/1364413777 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff070012c20 con 0x7ff07c071600 2023-12-01T15:59:46.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.312+0000 7ff06dffb700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff060065ad0 0x7ff060067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T15:59:46.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.312+0000 7ff06dffb700 1 -- 172.21.15.63:0/1364413777 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7ff070082bd0 con 0x7ff07c071600 2023-12-01T15:59:46.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.312+0000 7ff080986700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff060065ad0 0x7ff060067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T15:59:46.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.312+0000 7ff080986700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff060065ad0 0x7ff060067f90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff078000f80 tx=0x7ff078009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T15:59:46.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.316+0000 7ff06dffb700 1 -- 172.21.15.63:0/1364413777 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff070050b40 con 0x7ff07c071600 2023-12-01T15:59:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.480+0000 7ff082189700 1 -- 172.21.15.63:0/1364413777 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff07c0711b0 con 0x7ff060065ad0 2023-12-01T15:59:46.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.500+0000 7ff06dffb700 1 -- 172.21.15.63:0/1364413777 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280002 (secure 0 0 0) 0x7ff0780092e0 con 0x7ff060065ad0 2023-12-01T15:59:46.516 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T15:59:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 -- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff060065ad0 msgr2=0x7ff060067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff060065ad0 0x7ff060067f90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff078000f80 tx=0x7ff078009000 comp rx=0 tx=0).stop 2023-12-01T15:59:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 -- 172.21.15.63:0/1364413777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff07c071600 msgr2=0x7ff07c1d3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T15:59:46.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff07c071600 0x7ff07c1d3dd0 secure :-1 s=READY pgs=2953 cs=0 l=1 rev1=1 crypto rx=0x7ff07000d800 tx=0x7ff07000db10 comp rx=0 tx=0).stop 2023-12-01T15:59:46.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 -- 172.21.15.63:0/1364413777 shutdown_connections 2023-12-01T15:59:46.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7ff060065ad0 0x7ff060067f90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c13ea40 0x7ff07c1d4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c13f3f0 0x7ff07c1d4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 --2- 172.21.15.63:0/1364413777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff07c071600 0x7ff07c1d3dd0 unknown :-1 s=CLOSED pgs=2953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T15:59:46.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 -- 172.21.15.63:0/1364413777 >> 172.21.15.63:0/1364413777 conn(0x7ff07c0a8bd0 msgr2=0x7ff07c13c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T15:59:46.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 -- 172.21.15.63:0/1364413777 shutdown_connections 2023-12-01T15:59:46.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T15:59:46.504+0000 7ff082189700 1 -- 172.21.15.63:0/1364413777 wait complete. 2023-12-01T15:59:46.521 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T15:59:46.533 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":526,"stamp":"2023-12-01T15:59:44.701592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":278587564,"num_objects":242,"num_object_clones":28,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":15,"num_read":370,"num_read_kb":3540,"num_write":153132,"num_write_kb":684155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301971,"ondisk_log_size":301971,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":2888436,"kb_used_data":546196,"kb_used_omap":0,"kb_used_meta":2342208,"kb_avail":374598924,"statfs":{"total":386547056640,"available":383589298176,"internally_reserved":0,"allocated":559304704,"data_stored":557895169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2398420992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1361637,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":3,"num_read":5,"num_read_kb":6,"num_write":88,"num_write_kb":1380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002477"},"pg_stats":[{"pgid":"4.3f","version":"43'3303","reported_seq":2798,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480878+0000","last_change":"2023-12-01T15:59:36.960583+0000","last_active":"2023-12-01T15:59:43.480878+0000","last_peered":"2023-12-01T15:59:43.480878+0000","last_clean":"2023-12-01T15:59:43.480878+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:59:43.480878+0000","last_undegraded":"2023-12-01T15:59:43.480878+0000","last_fullsized":"2023-12-01T15:59:43.480878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13670799,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"43'3496","reported_seq":2955,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.397406+0000","last_change":"2023-12-01T15:59:36.899161+0000","last_active":"2023-12-01T15:59:43.397406+0000","last_peered":"2023-12-01T15:59:43.397406+0000","last_clean":"2023-12-01T15:59:43.397406+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T15:59:43.397406+0000","last_undegraded":"2023-12-01T15:59:43.397406+0000","last_fullsized":"2023-12-01T15:59:43.397406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.085048589999999993,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'3434","reported_seq":2896,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478855+0000","last_change":"2023-12-01T15:59:36.980200+0000","last_active":"2023-12-01T15:59:43.478855+0000","last_peered":"2023-12-01T15:59:43.478855+0000","last_clean":"2023-12-01T15:59:43.478855+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:59:43.478855+0000","last_undegraded":"2023-12-01T15:59:43.478855+0000","last_fullsized":"2023-12-01T15:59:43.478855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:52:46.242732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15483981599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"43'3687","reported_seq":3039,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395994+0000","last_change":"2023-12-01T15:59:36.901834+0000","last_active":"2023-12-01T15:59:43.395994+0000","last_peered":"2023-12-01T15:59:43.395994+0000","last_clean":"2023-12-01T15:59:43.395994+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:59:43.395994+0000","last_undegraded":"2023-12-01T15:59:43.395994+0000","last_fullsized":"2023-12-01T15:59:43.395994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3687,"log_dups_size":0,"ondisk_log_size":3687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086572531999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"43'3485","reported_seq":2917,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.481557+0000","last_change":"2023-12-01T15:59:36.962909+0000","last_active":"2023-12-01T15:59:43.481557+0000","last_peered":"2023-12-01T15:59:43.481557+0000","last_clean":"2023-12-01T15:59:43.481557+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T15:59:43.481557+0000","last_undegraded":"2023-12-01T15:59:43.481557+0000","last_fullsized":"2023-12-01T15:59:43.481557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13014335599999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'3419","reported_seq":2860,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478136+0000","last_change":"2023-12-01T15:59:36.980233+0000","last_active":"2023-12-01T15:59:43.478136+0000","last_peered":"2023-12-01T15:59:43.478136+0000","last_clean":"2023-12-01T15:59:43.478136+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T15:59:43.478136+0000","last_undegraded":"2023-12-01T15:59:43.478136+0000","last_fullsized":"2023-12-01T15:59:43.478136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.133828119,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'3764","reported_seq":3218,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477259+0000","last_change":"2023-12-01T15:59:36.977002+0000","last_active":"2023-12-01T15:59:43.477259+0000","last_peered":"2023-12-01T15:59:43.477259+0000","last_clean":"2023-12-01T15:59:43.477259+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T15:59:43.477259+0000","last_undegraded":"2023-12-01T15:59:43.477259+0000","last_fullsized":"2023-12-01T15:59:43.477259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3764,"log_dups_size":0,"ondisk_log_size":3764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16251290900000001,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'3433","reported_seq":2837,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477287+0000","last_change":"2023-12-01T15:59:36.975843+0000","last_active":"2023-12-01T15:59:43.477287+0000","last_peered":"2023-12-01T15:59:43.477287+0000","last_clean":"2023-12-01T15:59:43.477287+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:59:43.477287+0000","last_undegraded":"2023-12-01T15:59:43.477287+0000","last_fullsized":"2023-12-01T15:59:43.477287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3433,"log_dups_size":0,"ondisk_log_size":3433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:31:59.832465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.173046373,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"43'3524","reported_seq":2942,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479198+0000","last_change":"2023-12-01T15:59:36.960250+0000","last_active":"2023-12-01T15:59:43.479198+0000","last_peered":"2023-12-01T15:59:43.479198+0000","last_clean":"2023-12-01T15:59:43.479198+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:59:43.479198+0000","last_undegraded":"2023-12-01T15:59:43.479198+0000","last_fullsized":"2023-12-01T15:59:43.479198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13648046599999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'3320","reported_seq":2809,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480237+0000","last_change":"2023-12-01T15:59:36.978454+0000","last_active":"2023-12-01T15:59:43.480237+0000","last_peered":"2023-12-01T15:59:43.480237+0000","last_clean":"2023-12-01T15:59:43.480237+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:59:43.480237+0000","last_undegraded":"2023-12-01T15:59:43.480237+0000","last_fullsized":"2023-12-01T15:59:43.480237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:00:15.540017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.160523057,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"43'3407","reported_seq":2868,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.396121+0000","last_change":"2023-12-01T15:59:36.894457+0000","last_active":"2023-12-01T15:59:43.396121+0000","last_peered":"2023-12-01T15:59:43.396121+0000","last_clean":"2023-12-01T15:59:43.396121+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:59:43.396121+0000","last_undegraded":"2023-12-01T15:59:43.396121+0000","last_fullsized":"2023-12-01T15:59:43.396121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3407,"log_dups_size":0,"ondisk_log_size":3407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.080275320999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"43'3529","reported_seq":2900,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.462843+0000","last_change":"2023-12-01T15:59:37.474340+0000","last_active":"2023-12-01T15:59:37.462843+0000","last_peered":"2023-12-01T15:59:37.462843+0000","last_clean":"2023-12-01T15:59:37.462843+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T15:59:37.462843+0000","last_undegraded":"2023-12-01T15:59:37.462843+0000","last_fullsized":"2023-12-01T15:59:37.462843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63957533600000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.33","version":"43'3178","reported_seq":2649,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477418+0000","last_change":"2023-12-01T15:59:36.959529+0000","last_active":"2023-12-01T15:59:43.477418+0000","last_peered":"2023-12-01T15:59:43.477418+0000","last_clean":"2023-12-01T15:59:43.477418+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T15:59:43.477418+0000","last_undegraded":"2023-12-01T15:59:43.477418+0000","last_fullsized":"2023-12-01T15:59:43.477418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3178,"log_dups_size":0,"ondisk_log_size":3178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138334033,"stat_sum":{"num_bytes":12297,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"43'3508","reported_seq":2932,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394786+0000","last_change":"2023-12-01T15:59:36.908392+0000","last_active":"2023-12-01T15:59:43.394786+0000","last_peered":"2023-12-01T15:59:43.394786+0000","last_clean":"2023-12-01T15:59:43.394786+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T15:59:43.394786+0000","last_undegraded":"2023-12-01T15:59:43.394786+0000","last_fullsized":"2023-12-01T15:59:43.394786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:54.419790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.091404182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"43'3600","reported_seq":3007,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394244+0000","last_change":"2023-12-01T15:59:36.901530+0000","last_active":"2023-12-01T15:59:43.394244+0000","last_peered":"2023-12-01T15:59:43.394244+0000","last_clean":"2023-12-01T15:59:43.394244+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:43.394244+0000","last_undegraded":"2023-12-01T15:59:43.394244+0000","last_fullsized":"2023-12-01T15:59:43.394244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086861997999999996,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1247,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"43'3533","reported_seq":2942,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477732+0000","last_change":"2023-12-01T15:59:36.976205+0000","last_active":"2023-12-01T15:59:43.477732+0000","last_peered":"2023-12-01T15:59:43.477732+0000","last_clean":"2023-12-01T15:59:43.477732+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T15:59:43.477732+0000","last_undegraded":"2023-12-01T15:59:43.477732+0000","last_fullsized":"2023-12-01T15:59:43.477732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3533,"log_dups_size":0,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:23.641161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17327173600000001,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"43'3588","reported_seq":2964,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479697+0000","last_change":"2023-12-01T15:59:36.959847+0000","last_active":"2023-12-01T15:59:43.479697+0000","last_peered":"2023-12-01T15:59:43.479697+0000","last_clean":"2023-12-01T15:59:43.479697+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T15:59:43.479697+0000","last_undegraded":"2023-12-01T15:59:43.479697+0000","last_fullsized":"2023-12-01T15:59:43.479697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13630616600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'3282","reported_seq":2784,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480268+0000","last_change":"2023-12-01T15:59:36.977461+0000","last_active":"2023-12-01T15:59:43.480268+0000","last_peered":"2023-12-01T15:59:43.480268+0000","last_clean":"2023-12-01T15:59:43.480268+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T15:59:43.480268+0000","last_undegraded":"2023-12-01T15:59:43.480268+0000","last_fullsized":"2023-12-01T15:59:43.480268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:46:31.135544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.159652814,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1044,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"43'3337","reported_seq":2777,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478604+0000","last_change":"2023-12-01T15:59:36.954938+0000","last_active":"2023-12-01T15:59:43.478604+0000","last_peered":"2023-12-01T15:59:43.478604+0000","last_clean":"2023-12-01T15:59:43.478604+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T15:59:43.478604+0000","last_undegraded":"2023-12-01T15:59:43.478604+0000","last_fullsized":"2023-12-01T15:59:43.478604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134439324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"43'3655","reported_seq":3091,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477814+0000","last_change":"2023-12-01T15:59:36.963898+0000","last_active":"2023-12-01T15:59:43.477814+0000","last_peered":"2023-12-01T15:59:43.477814+0000","last_clean":"2023-12-01T15:59:43.477814+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:59:43.477814+0000","last_undegraded":"2023-12-01T15:59:43.477814+0000","last_fullsized":"2023-12-01T15:59:43.477814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3655,"log_dups_size":0,"ondisk_log_size":3655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:50.215328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16502647100000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"43'3592","reported_seq":3029,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395408+0000","last_change":"2023-12-01T15:59:36.908706+0000","last_active":"2023-12-01T15:59:43.395408+0000","last_peered":"2023-12-01T15:59:43.395408+0000","last_clean":"2023-12-01T15:59:43.395408+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T15:59:43.395408+0000","last_undegraded":"2023-12-01T15:59:43.395408+0000","last_fullsized":"2023-12-01T15:59:43.395408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.082049368999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"43'3494","reported_seq":2867,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477393+0000","last_change":"2023-12-01T15:59:36.954854+0000","last_active":"2023-12-01T15:59:43.477393+0000","last_peered":"2023-12-01T15:59:43.477393+0000","last_clean":"2023-12-01T15:59:43.477393+0000","last_became_active":"2023-12-01T15:44:30.528283+0000","last_became_peered":"2023-12-01T15:44:30.528283+0000","last_unstale":"2023-12-01T15:59:43.477393+0000","last_undegraded":"2023-12-01T15:59:43.477393+0000","last_fullsized":"2023-12-01T15:59:43.477393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3494,"log_dups_size":0,"ondisk_log_size":3494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:49:07.227935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13495370100000001,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'3466","reported_seq":2921,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.421995+0000","last_change":"2023-12-01T15:59:37.440864+0000","last_active":"2023-12-01T15:59:37.421995+0000","last_peered":"2023-12-01T15:59:37.421995+0000","last_clean":"2023-12-01T15:59:37.421995+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T15:59:37.421995+0000","last_undegraded":"2023-12-01T15:59:37.421995+0000","last_fullsized":"2023-12-01T15:59:37.421995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3466,"log_dups_size":0,"ondisk_log_size":3466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.62816057700000005,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.28","version":"43'3577","reported_seq":2948,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477774+0000","last_change":"2023-12-01T15:59:36.976374+0000","last_active":"2023-12-01T15:59:43.477774+0000","last_peered":"2023-12-01T15:59:43.477774+0000","last_clean":"2023-12-01T15:59:43.477774+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:59:43.477774+0000","last_undegraded":"2023-12-01T15:59:43.477774+0000","last_fullsized":"2023-12-01T15:59:43.477774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:16:11.702379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17330785400000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"43'3344","reported_seq":2820,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.440997+0000","last_change":"2023-12-01T15:59:37.452527+0000","last_active":"2023-12-01T15:59:37.440997+0000","last_peered":"2023-12-01T15:59:37.440997+0000","last_clean":"2023-12-01T15:59:37.440997+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T15:59:37.440997+0000","last_undegraded":"2023-12-01T15:59:37.440997+0000","last_fullsized":"2023-12-01T15:59:37.440997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63729295699999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.26","version":"43'3411","reported_seq":2861,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.414457+0000","last_change":"2023-12-01T15:59:37.421961+0000","last_active":"2023-12-01T15:59:37.414457+0000","last_peered":"2023-12-01T15:59:37.414457+0000","last_clean":"2023-12-01T15:59:37.414457+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T15:59:37.414457+0000","last_undegraded":"2023-12-01T15:59:37.414457+0000","last_fullsized":"2023-12-01T15:59:37.414457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3411,"log_dups_size":0,"ondisk_log_size":3411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.611917673,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.25","version":"43'3312","reported_seq":2738,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480846+0000","last_change":"2023-12-01T15:59:36.980913+0000","last_active":"2023-12-01T15:59:43.480846+0000","last_peered":"2023-12-01T15:59:43.480846+0000","last_clean":"2023-12-01T15:59:43.480846+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T15:59:43.480846+0000","last_undegraded":"2023-12-01T15:59:43.480846+0000","last_fullsized":"2023-12-01T15:59:43.480846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:34:06.793940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.146734475,"stat_sum":{"num_bytes":4116,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'3312","reported_seq":2770,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.481996+0000","last_change":"2023-12-01T15:59:37.489547+0000","last_active":"2023-12-01T15:59:37.481996+0000","last_peered":"2023-12-01T15:59:37.481996+0000","last_clean":"2023-12-01T15:59:37.481996+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T15:59:37.481996+0000","last_undegraded":"2023-12-01T15:59:37.481996+0000","last_fullsized":"2023-12-01T15:59:37.481996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:51:08.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65414528699999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.23","version":"43'3662","reported_seq":3038,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478027+0000","last_change":"2023-12-01T15:59:36.959770+0000","last_active":"2023-12-01T15:59:43.478027+0000","last_peered":"2023-12-01T15:59:43.478027+0000","last_clean":"2023-12-01T15:59:43.478027+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T15:59:43.478027+0000","last_undegraded":"2023-12-01T15:59:43.478027+0000","last_fullsized":"2023-12-01T15:59:43.478027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13835824199999999,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"43'3520","reported_seq":2991,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478316+0000","last_change":"2023-12-01T15:59:36.981606+0000","last_active":"2023-12-01T15:59:43.478316+0000","last_peered":"2023-12-01T15:59:43.478316+0000","last_clean":"2023-12-01T15:59:43.478316+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:59:43.478316+0000","last_undegraded":"2023-12-01T15:59:43.478316+0000","last_fullsized":"2023-12-01T15:59:43.478316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3520,"log_dups_size":0,"ondisk_log_size":3520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13490588100000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"43'3994","reported_seq":3317,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.460079+0000","last_change":"2023-12-01T15:59:37.471324+0000","last_active":"2023-12-01T15:59:37.460079+0000","last_peered":"2023-12-01T15:59:37.460079+0000","last_clean":"2023-12-01T15:59:37.460079+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T15:59:37.460079+0000","last_undegraded":"2023-12-01T15:59:37.460079+0000","last_fullsized":"2023-12-01T15:59:37.460079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3994,"log_dups_size":0,"ondisk_log_size":3994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65412195699999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.20","version":"43'3592","reported_seq":2994,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394231+0000","last_change":"2023-12-01T15:59:36.911013+0000","last_active":"2023-12-01T15:59:43.394231+0000","last_peered":"2023-12-01T15:59:43.394231+0000","last_clean":"2023-12-01T15:59:43.394231+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T15:59:43.394231+0000","last_undegraded":"2023-12-01T15:59:43.394231+0000","last_fullsized":"2023-12-01T15:59:43.394231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090414480000000005,"stat_sum":{"num_bytes":4118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"43'3661","reported_seq":3059,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.474372+0000","last_change":"2023-12-01T15:59:37.481885+0000","last_active":"2023-12-01T15:59:37.474372+0000","last_peered":"2023-12-01T15:59:37.474372+0000","last_clean":"2023-12-01T15:59:37.474372+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:59:37.474372+0000","last_undegraded":"2023-12-01T15:59:37.474372+0000","last_fullsized":"2023-12-01T15:59:37.474372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3661,"log_dups_size":0,"ondisk_log_size":3661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.646838511,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.13","version":"39'2734","reported_seq":2776,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.798563+0000","last_change":"2023-12-01T15:43:45.205685+0000","last_active":"2023-12-01T15:59:36.798563+0000","last_peered":"2023-12-01T15:59:36.798563+0000","last_clean":"2023-12-01T15:59:36.798563+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T15:59:36.798563+0000","last_undegraded":"2023-12-01T15:59:36.798563+0000","last_fullsized":"2023-12-01T15:59:36.798563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2734,"log_dups_size":0,"ondisk_log_size":2734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2729,"num_write_kb":18350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"43'3426","reported_seq":2844,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479486+0000","last_change":"2023-12-01T15:59:36.979597+0000","last_active":"2023-12-01T15:59:43.479486+0000","last_peered":"2023-12-01T15:59:43.479486+0000","last_clean":"2023-12-01T15:59:43.479486+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:59:43.479486+0000","last_undegraded":"2023-12-01T15:59:43.479486+0000","last_fullsized":"2023-12-01T15:59:43.479486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T15:53:22.216155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15458043599999999,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"35'5","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.822809+0000","last_change":"2023-12-01T15:43:45.203521+0000","last_active":"2023-12-01T15:59:36.822809+0000","last_peered":"2023-12-01T15:59:36.822809+0000","last_clean":"2023-12-01T15:59:36.822809+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T15:59:36.822809+0000","last_undegraded":"2023-12-01T15:59:36.822809+0000","last_fullsized":"2023-12-01T15:59:36.822809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"43'3628","reported_seq":3077,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480277+0000","last_change":"2023-12-01T15:59:36.960912+0000","last_active":"2023-12-01T15:59:43.480277+0000","last_peered":"2023-12-01T15:59:43.480277+0000","last_clean":"2023-12-01T15:59:43.480277+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:59:43.480277+0000","last_undegraded":"2023-12-01T15:59:43.480277+0000","last_fullsized":"2023-12-01T15:59:43.480277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13624631700000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"43'1007","reported_seq":1049,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:38.218643+0000","last_change":"2023-12-01T15:43:45.205291+0000","last_active":"2023-12-01T15:59:38.218643+0000","last_peered":"2023-12-01T15:59:38.218643+0000","last_clean":"2023-12-01T15:59:38.218643+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T15:59:38.218643+0000","last_undegraded":"2023-12-01T15:59:38.218643+0000","last_fullsized":"2023-12-01T15:59:38.218643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":10007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"43'3451","reported_seq":2872,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480178+0000","last_change":"2023-12-01T15:59:36.960049+0000","last_active":"2023-12-01T15:59:43.480178+0000","last_peered":"2023-12-01T15:59:43.480178+0000","last_clean":"2023-12-01T15:59:43.480178+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:59:43.480178+0000","last_undegraded":"2023-12-01T15:59:43.480178+0000","last_fullsized":"2023-12-01T15:59:43.480178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3451,"log_dups_size":0,"ondisk_log_size":3451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13638832000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"42'1384","reported_seq":1426,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.804050+0000","last_change":"2023-12-01T15:43:45.207762+0000","last_active":"2023-12-01T15:59:36.804050+0000","last_peered":"2023-12-01T15:59:36.804050+0000","last_clean":"2023-12-01T15:59:36.804050+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T15:59:36.804050+0000","last_undegraded":"2023-12-01T15:59:36.804050+0000","last_fullsized":"2023-12-01T15:59:36.804050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:05:13.618052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1392,"num_write_kb":12529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'1276","reported_seq":1319,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.814219+0000","last_change":"2023-12-01T15:43:45.203999+0000","last_active":"2023-12-01T15:59:36.814219+0000","last_peered":"2023-12-01T15:59:36.814219+0000","last_clean":"2023-12-01T15:59:36.814219+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T15:59:36.814219+0000","last_undegraded":"2023-12-01T15:59:36.814219+0000","last_fullsized":"2023-12-01T15:59:36.814219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1276,"log_dups_size":0,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:39:56.914892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":12495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'3658","reported_seq":3046,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478260+0000","last_change":"2023-12-01T15:59:36.976848+0000","last_active":"2023-12-01T15:59:43.478260+0000","last_peered":"2023-12-01T15:59:43.478260+0000","last_clean":"2023-12-01T15:59:43.478260+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:59:43.478260+0000","last_undegraded":"2023-12-01T15:59:43.478260+0000","last_fullsized":"2023-12-01T15:59:43.478260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:40:12.233063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.172903538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"35'1240","reported_seq":1283,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.814453+0000","last_change":"2023-12-01T15:43:45.201303+0000","last_active":"2023-12-01T15:59:36.814453+0000","last_peered":"2023-12-01T15:59:36.814453+0000","last_clean":"2023-12-01T15:59:36.814453+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T15:59:36.814453+0000","last_undegraded":"2023-12-01T15:59:36.814453+0000","last_fullsized":"2023-12-01T15:59:36.814453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1238,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'3442","reported_seq":2869,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395444+0000","last_change":"2023-12-01T15:59:36.906470+0000","last_active":"2023-12-01T15:59:43.395444+0000","last_peered":"2023-12-01T15:59:43.395444+0000","last_clean":"2023-12-01T15:59:43.395444+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:59:43.395444+0000","last_undegraded":"2023-12-01T15:59:43.395444+0000","last_fullsized":"2023-12-01T15:59:43.395444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3442,"log_dups_size":0,"ondisk_log_size":3442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090755167999999997,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1186,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"39'4742","reported_seq":4785,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.834078+0000","last_change":"2023-12-01T15:43:45.207098+0000","last_active":"2023-12-01T15:59:36.834078+0000","last_peered":"2023-12-01T15:59:36.834078+0000","last_clean":"2023-12-01T15:59:36.834078+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T15:59:36.834078+0000","last_undegraded":"2023-12-01T15:59:36.834078+0000","last_fullsized":"2023-12-01T15:59:36.834078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4742,"log_dups_size":0,"ondisk_log_size":4742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:35.719575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4735,"num_write_kb":27522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'3359","reported_seq":2783,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395581+0000","last_change":"2023-12-01T15:59:36.907684+0000","last_active":"2023-12-01T15:59:43.395581+0000","last_peered":"2023-12-01T15:59:43.395581+0000","last_clean":"2023-12-01T15:59:43.395581+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:59:43.395581+0000","last_undegraded":"2023-12-01T15:59:43.395581+0000","last_fullsized":"2023-12-01T15:59:43.395581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:32:00.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090274558000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'1988","reported_seq":2031,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.800694+0000","last_change":"2023-12-01T15:43:45.206777+0000","last_active":"2023-12-01T15:59:36.800694+0000","last_peered":"2023-12-01T15:59:36.800694+0000","last_clean":"2023-12-01T15:59:36.800694+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T15:59:36.800694+0000","last_undegraded":"2023-12-01T15:59:36.800694+0000","last_fullsized":"2023-12-01T15:59:36.800694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1988,"log_dups_size":0,"ondisk_log_size":1988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:56:08.503532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1987,"num_write_kb":25538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"43'3403","reported_seq":2896,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478528+0000","last_change":"2023-12-01T15:59:36.962413+0000","last_active":"2023-12-01T15:59:43.478528+0000","last_peered":"2023-12-01T15:59:43.478528+0000","last_clean":"2023-12-01T15:59:43.478528+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:59:43.478528+0000","last_undegraded":"2023-12-01T15:59:43.478528+0000","last_fullsized":"2023-12-01T15:59:43.478528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13034463499999999,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1138,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"39'4348","reported_seq":4390,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:29.931337+0000","last_change":"2023-12-01T15:43:45.204182+0000","last_active":"2023-12-01T15:59:29.931337+0000","last_peered":"2023-12-01T15:59:29.931337+0000","last_clean":"2023-12-01T15:59:29.931337+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T15:59:29.931337+0000","last_undegraded":"2023-12-01T15:59:29.931337+0000","last_fullsized":"2023-12-01T15:59:29.931337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4348,"log_dups_size":0,"ondisk_log_size":4348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:46.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4337,"num_write_kb":30065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"43'3797","reported_seq":3178,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478090+0000","last_change":"2023-12-01T15:59:36.966407+0000","last_active":"2023-12-01T15:59:43.478090+0000","last_peered":"2023-12-01T15:59:43.478090+0000","last_clean":"2023-12-01T15:59:43.478090+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T15:59:43.478090+0000","last_undegraded":"2023-12-01T15:59:43.478090+0000","last_fullsized":"2023-12-01T15:59:43.478090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.165714477,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"41'2491","reported_seq":2534,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.846763+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:59:36.846763+0000","last_peered":"2023-12-01T15:59:36.846763+0000","last_clean":"2023-12-01T15:59:36.846763+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:59:36.846763+0000","last_undegraded":"2023-12-01T15:59:36.846763+0000","last_fullsized":"2023-12-01T15:59:36.846763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2491,"log_dups_size":0,"ondisk_log_size":2491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:45:37.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2494,"num_write_kb":26915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'3462","reported_seq":2931,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479185+0000","last_change":"2023-12-01T15:59:36.980979+0000","last_active":"2023-12-01T15:59:43.479185+0000","last_peered":"2023-12-01T15:59:43.479185+0000","last_clean":"2023-12-01T15:59:43.479185+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:59:43.479185+0000","last_undegraded":"2023-12-01T15:59:43.479185+0000","last_fullsized":"2023-12-01T15:59:43.479185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:51.219271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15615646,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1160,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'2352","reported_seq":2395,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.814748+0000","last_change":"2023-12-01T15:43:45.206261+0000","last_active":"2023-12-01T15:59:36.814748+0000","last_peered":"2023-12-01T15:59:36.814748+0000","last_clean":"2023-12-01T15:59:36.814748+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T15:59:36.814748+0000","last_undegraded":"2023-12-01T15:59:36.814748+0000","last_fullsized":"2023-12-01T15:59:36.814748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:28.566360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2354,"num_write_kb":17078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'3597","reported_seq":2982,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.397198+0000","last_change":"2023-12-01T15:59:36.901256+0000","last_active":"2023-12-01T15:59:43.397198+0000","last_peered":"2023-12-01T15:59:43.397198+0000","last_clean":"2023-12-01T15:59:43.397198+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T15:59:43.397198+0000","last_undegraded":"2023-12-01T15:59:43.397198+0000","last_fullsized":"2023-12-01T15:59:43.397198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086977656,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"36'1538","reported_seq":1580,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.387769+0000","last_change":"2023-12-01T15:43:45.200481+0000","last_active":"2023-12-01T15:59:28.387769+0000","last_peered":"2023-12-01T15:59:28.387769+0000","last_clean":"2023-12-01T15:59:28.387769+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T15:59:28.387769+0000","last_undegraded":"2023-12-01T15:59:28.387769+0000","last_fullsized":"2023-12-01T15:59:28.387769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1538,"log_dups_size":0,"ondisk_log_size":1538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1538,"num_write_kb":10132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3475","reported_seq":2901,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.447779+0000","last_change":"2023-12-01T15:59:37.462768+0000","last_active":"2023-12-01T15:59:37.447779+0000","last_peered":"2023-12-01T15:59:37.447779+0000","last_clean":"2023-12-01T15:59:37.447779+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:59:37.447779+0000","last_undegraded":"2023-12-01T15:59:37.447779+0000","last_fullsized":"2023-12-01T15:59:37.447779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:41.784377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.64740572200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"12'117","reported_seq":200,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478927+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:59:43.478927+0000","last_peered":"2023-12-01T15:59:43.478927+0000","last_clean":"2023-12-01T15:59:43.478927+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:59:43.478927+0000","last_undegraded":"2023-12-01T15:59:43.478927+0000","last_fullsized":"2023-12-01T15:59:43.478927+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:09:18.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.798635+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:59:36.798635+0000","last_peered":"2023-12-01T15:59:36.798635+0000","last_clean":"2023-12-01T15:59:36.798635+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:59:36.798635+0000","last_undegraded":"2023-12-01T15:59:36.798635+0000","last_fullsized":"2023-12-01T15:59:36.798635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:10:37.881379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"39'4414","reported_seq":4456,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.389387+0000","last_change":"2023-12-01T15:43:45.201766+0000","last_active":"2023-12-01T15:59:28.389387+0000","last_peered":"2023-12-01T15:59:28.389387+0000","last_clean":"2023-12-01T15:59:28.389387+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T15:59:28.389387+0000","last_undegraded":"2023-12-01T15:59:28.389387+0000","last_fullsized":"2023-12-01T15:59:28.389387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4414,"log_dups_size":0,"ondisk_log_size":4414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4406,"num_write_kb":30219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"43'3657","reported_seq":3069,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480606+0000","last_change":"2023-12-01T15:59:36.978939+0000","last_active":"2023-12-01T15:59:43.480606+0000","last_peered":"2023-12-01T15:59:43.480606+0000","last_clean":"2023-12-01T15:59:43.480606+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:59:43.480606+0000","last_undegraded":"2023-12-01T15:59:43.480606+0000","last_fullsized":"2023-12-01T15:59:43.480606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3657,"log_dups_size":0,"ondisk_log_size":3657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.144833777,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.804121+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:59:36.804121+0000","last_peered":"2023-12-01T15:59:36.804121+0000","last_clean":"2023-12-01T15:59:36.804121+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:59:36.804121+0000","last_undegraded":"2023-12-01T15:59:36.804121+0000","last_fullsized":"2023-12-01T15:59:36.804121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'2295","reported_seq":2538,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:38.214011+0000","last_change":"2023-12-01T15:43:45.209138+0000","last_active":"2023-12-01T15:59:38.214011+0000","last_peered":"2023-12-01T15:59:38.214011+0000","last_clean":"2023-12-01T15:59:38.214011+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T15:59:38.214011+0000","last_undegraded":"2023-12-01T15:59:38.214011+0000","last_fullsized":"2023-12-01T15:59:38.214011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3359983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":3419,"num_write":2296,"num_write_kb":16044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'3370","reported_seq":2810,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479628+0000","last_change":"2023-12-01T15:59:36.960605+0000","last_active":"2023-12-01T15:59:43.479628+0000","last_peered":"2023-12-01T15:59:43.479628+0000","last_clean":"2023-12-01T15:59:43.479628+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T15:59:43.479628+0000","last_undegraded":"2023-12-01T15:59:43.479628+0000","last_fullsized":"2023-12-01T15:59:43.479628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3370,"log_dups_size":0,"ondisk_log_size":3370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:28:52.635540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13848359499999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1137,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.388444+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:59:28.388444+0000","last_peered":"2023-12-01T15:59:28.388444+0000","last_clean":"2023-12-01T15:59:28.388444+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:59:28.388444+0000","last_undegraded":"2023-12-01T15:59:28.388444+0000","last_fullsized":"2023-12-01T15:59:28.388444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:05:36.049760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"42'2706","reported_seq":2748,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:30.346534+0000","last_change":"2023-12-01T15:43:45.204466+0000","last_active":"2023-12-01T15:59:30.346534+0000","last_peered":"2023-12-01T15:59:30.346534+0000","last_clean":"2023-12-01T15:59:30.346534+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T15:59:30.346534+0000","last_undegraded":"2023-12-01T15:59:30.346534+0000","last_fullsized":"2023-12-01T15:59:30.346534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2706,"log_dups_size":0,"ondisk_log_size":2706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:06:18.400657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2697,"num_write_kb":25331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'3392","reported_seq":2863,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.452643+0000","last_change":"2023-12-01T15:59:37.459988+0000","last_active":"2023-12-01T15:59:37.452643+0000","last_peered":"2023-12-01T15:59:37.452643+0000","last_clean":"2023-12-01T15:59:37.452643+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:59:37.452643+0000","last_undegraded":"2023-12-01T15:59:37.452643+0000","last_fullsized":"2023-12-01T15:59:37.452643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.644502672,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1119,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.846839+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:59:36.846839+0000","last_peered":"2023-12-01T15:59:36.846839+0000","last_clean":"2023-12-01T15:59:36.846839+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:59:36.846839+0000","last_undegraded":"2023-12-01T15:59:36.846839+0000","last_fullsized":"2023-12-01T15:59:36.846839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:11:42.240939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"42'3556","reported_seq":3599,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.827806+0000","last_change":"2023-12-01T15:43:45.207506+0000","last_active":"2023-12-01T15:59:36.827806+0000","last_peered":"2023-12-01T15:59:36.827806+0000","last_clean":"2023-12-01T15:59:36.827806+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T15:59:36.827806+0000","last_undegraded":"2023-12-01T15:59:36.827806+0000","last_fullsized":"2023-12-01T15:59:36.827806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3556,"log_dups_size":0,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3556,"num_write_kb":20852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"43'3572","reported_seq":2961,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.485563+0000","last_change":"2023-12-01T15:59:37.493069+0000","last_active":"2023-12-01T15:59:37.485563+0000","last_peered":"2023-12-01T15:59:37.485563+0000","last_clean":"2023-12-01T15:59:37.485563+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:37.485563+0000","last_undegraded":"2023-12-01T15:59:37.485563+0000","last_fullsized":"2023-12-01T15:59:37.485563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3572,"log_dups_size":0,"ondisk_log_size":3572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:22.890897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65789627900000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.5","version":"43'2830","reported_seq":2873,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.220072+0000","last_change":"2023-12-01T15:43:45.210575+0000","last_active":"2023-12-01T15:59:37.220072+0000","last_peered":"2023-12-01T15:59:37.220072+0000","last_clean":"2023-12-01T15:59:37.220072+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T15:59:37.220072+0000","last_undegraded":"2023-12-01T15:59:37.220072+0000","last_fullsized":"2023-12-01T15:59:37.220072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2830,"log_dups_size":0,"ondisk_log_size":2830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2820,"num_write_kb":26865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.391178+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:59:28.391178+0000","last_peered":"2023-12-01T15:59:28.391178+0000","last_clean":"2023-12-01T15:59:28.391178+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:59:28.391178+0000","last_undegraded":"2023-12-01T15:59:28.391178+0000","last_fullsized":"2023-12-01T15:59:28.391178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:59:53.061346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3759","reported_seq":3194,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.439827+0000","last_change":"2023-12-01T15:59:37.447706+0000","last_active":"2023-12-01T15:59:37.439827+0000","last_peered":"2023-12-01T15:59:37.439827+0000","last_clean":"2023-12-01T15:59:37.439827+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:59:37.439827+0000","last_undegraded":"2023-12-01T15:59:37.439827+0000","last_fullsized":"2023-12-01T15:59:37.439827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.64064258500000004,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.4","version":"43'723","reported_seq":765,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.835279+0000","last_change":"2023-12-01T15:43:45.200408+0000","last_active":"2023-12-01T15:59:36.835279+0000","last_peered":"2023-12-01T15:59:36.835279+0000","last_clean":"2023-12-01T15:59:36.835279+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T15:59:36.835279+0000","last_undegraded":"2023-12-01T15:59:36.835279+0000","last_fullsized":"2023-12-01T15:59:36.835279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:56:18.773531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":8308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.834209+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:59:36.834209+0000","last_peered":"2023-12-01T15:59:36.834209+0000","last_clean":"2023-12-01T15:59:36.834209+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:59:36.834209+0000","last_undegraded":"2023-12-01T15:59:36.834209+0000","last_fullsized":"2023-12-01T15:59:36.834209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:50:39.790988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"43'3558","reported_seq":2961,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.481565+0000","last_change":"2023-12-01T15:59:36.962654+0000","last_active":"2023-12-01T15:59:43.481565+0000","last_peered":"2023-12-01T15:59:43.481565+0000","last_clean":"2023-12-01T15:59:43.481565+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T15:59:43.481565+0000","last_undegraded":"2023-12-01T15:59:43.481565+0000","last_fullsized":"2023-12-01T15:59:43.481565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:19.706992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13059393599999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1243,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"36'1637","reported_seq":1679,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.391945+0000","last_change":"2023-12-01T15:43:45.203186+0000","last_active":"2023-12-01T15:59:28.391945+0000","last_peered":"2023-12-01T15:59:28.391945+0000","last_clean":"2023-12-01T15:59:28.391945+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T15:59:28.391945+0000","last_undegraded":"2023-12-01T15:59:28.391945+0000","last_fullsized":"2023-12-01T15:59:28.391945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:48:58.320307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1642,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.390379+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:59:28.390379+0000","last_peered":"2023-12-01T15:59:28.390379+0000","last_clean":"2023-12-01T15:59:28.390379+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:59:28.390379+0000","last_undegraded":"2023-12-01T15:59:28.390379+0000","last_fullsized":"2023-12-01T15:59:28.390379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:40:03.704778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'3696","reported_seq":3061,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477309+0000","last_change":"2023-12-01T15:59:36.953191+0000","last_active":"2023-12-01T15:59:43.477309+0000","last_peered":"2023-12-01T15:59:43.477309+0000","last_clean":"2023-12-01T15:59:43.477309+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:59:43.477309+0000","last_undegraded":"2023-12-01T15:59:43.477309+0000","last_fullsized":"2023-12-01T15:59:43.477309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3696,"log_dups_size":0,"ondisk_log_size":3696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:11:57.153567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13319146700000001,"stat_sum":{"num_bytes":4118,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"43'1994","reported_seq":2037,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:41.211840+0000","last_change":"2023-12-01T15:43:45.205286+0000","last_active":"2023-12-01T15:59:41.211840+0000","last_peered":"2023-12-01T15:59:41.211840+0000","last_clean":"2023-12-01T15:59:41.211840+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T15:59:41.211840+0000","last_undegraded":"2023-12-01T15:59:41.211840+0000","last_fullsized":"2023-12-01T15:59:41.211840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:26:46.031875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2263,"num_write_kb":16414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.800409+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:59:36.800409+0000","last_peered":"2023-12-01T15:59:36.800409+0000","last_clean":"2023-12-01T15:59:36.800409+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:59:36.800409+0000","last_undegraded":"2023-12-01T15:59:36.800409+0000","last_fullsized":"2023-12-01T15:59:36.800409+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:55:21.181781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"43'3405","reported_seq":2818,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394516+0000","last_change":"2023-12-01T15:59:36.902129+0000","last_active":"2023-12-01T15:59:43.394516+0000","last_peered":"2023-12-01T15:59:43.394516+0000","last_clean":"2023-12-01T15:59:43.394516+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T15:59:43.394516+0000","last_undegraded":"2023-12-01T15:59:43.394516+0000","last_fullsized":"2023-12-01T15:59:43.394516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3405,"log_dups_size":0,"ondisk_log_size":3405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:09:11.503242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.087179219000000002,"stat_sum":{"num_bytes":12302,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"43'3613","reported_seq":3018,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395801+0000","last_change":"2023-12-01T15:59:36.912052+0000","last_active":"2023-12-01T15:59:43.395801+0000","last_peered":"2023-12-01T15:59:43.395801+0000","last_clean":"2023-12-01T15:59:43.395801+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:59:43.395801+0000","last_undegraded":"2023-12-01T15:59:43.395801+0000","last_fullsized":"2023-12-01T15:59:43.395801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:21:55.500677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.084182759999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"42'3711","reported_seq":3753,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.800612+0000","last_change":"2023-12-01T15:43:45.208015+0000","last_active":"2023-12-01T15:59:36.800612+0000","last_peered":"2023-12-01T15:59:36.800612+0000","last_clean":"2023-12-01T15:59:36.800612+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T15:59:36.800612+0000","last_undegraded":"2023-12-01T15:59:36.800612+0000","last_fullsized":"2023-12-01T15:59:36.800612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3711,"num_write_kb":29795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"43'3508","reported_seq":2924,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.420142+0000","last_change":"2023-12-01T15:59:37.439759+0000","last_active":"2023-12-01T15:59:37.420142+0000","last_peered":"2023-12-01T15:59:37.420142+0000","last_clean":"2023-12-01T15:59:37.420142+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T15:59:37.420142+0000","last_undegraded":"2023-12-01T15:59:37.420142+0000","last_fullsized":"2023-12-01T15:59:37.420142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:10:20.479107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63296622700000005,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.15","version":"43'2457","reported_seq":2499,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:38.224191+0000","last_change":"2023-12-01T15:43:45.210538+0000","last_active":"2023-12-01T15:59:38.224191+0000","last_peered":"2023-12-01T15:59:38.224191+0000","last_clean":"2023-12-01T15:59:38.224191+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T15:59:38.224191+0000","last_undegraded":"2023-12-01T15:59:38.224191+0000","last_fullsized":"2023-12-01T15:59:38.224191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2457,"log_dups_size":0,"ondisk_log_size":2457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:38:02.513066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2453,"num_write_kb":21278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"43'1339","reported_seq":1381,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.216091+0000","last_change":"2023-12-01T15:43:45.204325+0000","last_active":"2023-12-01T15:59:37.216091+0000","last_peered":"2023-12-01T15:59:37.216091+0000","last_clean":"2023-12-01T15:59:37.216091+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T15:59:37.216091+0000","last_undegraded":"2023-12-01T15:59:37.216091+0000","last_fullsized":"2023-12-01T15:59:37.216091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1339,"log_dups_size":0,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1338,"num_write_kb":26066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'3641","reported_seq":3003,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477578+0000","last_change":"2023-12-01T15:59:36.952311+0000","last_active":"2023-12-01T15:59:43.477578+0000","last_peered":"2023-12-01T15:59:43.477578+0000","last_clean":"2023-12-01T15:59:43.477578+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T15:59:43.477578+0000","last_undegraded":"2023-12-01T15:59:43.477578+0000","last_fullsized":"2023-12-01T15:59:43.477578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:13:36.724287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13235097200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"43'900","reported_seq":942,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:38.217263+0000","last_change":"2023-12-01T15:43:45.203624+0000","last_active":"2023-12-01T15:59:38.217263+0000","last_peered":"2023-12-01T15:59:38.217263+0000","last_clean":"2023-12-01T15:59:38.217263+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T15:59:38.217263+0000","last_undegraded":"2023-12-01T15:59:38.217263+0000","last_fullsized":"2023-12-01T15:59:38.217263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:48:11.172446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'3458","reported_seq":2866,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.382919+0000","last_change":"2023-12-01T15:59:37.396927+0000","last_active":"2023-12-01T15:59:37.382919+0000","last_peered":"2023-12-01T15:59:37.382919+0000","last_clean":"2023-12-01T15:59:37.382919+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:59:37.382919+0000","last_undegraded":"2023-12-01T15:59:37.382919+0000","last_fullsized":"2023-12-01T15:59:37.382919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3458,"log_dups_size":0,"ondisk_log_size":3458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:59:30.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.59367497300000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1187,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.1f","version":"43'3413","reported_seq":2908,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480148+0000","last_change":"2023-12-01T15:59:36.971349+0000","last_active":"2023-12-01T15:59:43.480148+0000","last_peered":"2023-12-01T15:59:43.480148+0000","last_clean":"2023-12-01T15:59:43.480148+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:59:43.480148+0000","last_undegraded":"2023-12-01T15:59:43.480148+0000","last_fullsized":"2023-12-01T15:59:43.480148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:10:20.675396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17121966999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"43'4973","reported_seq":5014,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.803258+0000","last_change":"2023-12-01T15:43:45.205650+0000","last_active":"2023-12-01T15:59:36.803258+0000","last_peered":"2023-12-01T15:59:36.803258+0000","last_clean":"2023-12-01T15:59:36.803258+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:59:36.803258+0000","last_undegraded":"2023-12-01T15:59:36.803258+0000","last_fullsized":"2023-12-01T15:59:36.803258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4973,"log_dups_size":0,"ondisk_log_size":4973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:16:12.490302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4962,"num_write_kb":39191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3226","reported_seq":2695,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479206+0000","last_change":"2023-12-01T15:59:36.959488+0000","last_active":"2023-12-01T15:59:43.479206+0000","last_peered":"2023-12-01T15:59:43.479206+0000","last_clean":"2023-12-01T15:59:43.479206+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T15:59:43.479206+0000","last_undegraded":"2023-12-01T15:59:43.479206+0000","last_fullsized":"2023-12-01T15:59:43.479206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3226,"log_dups_size":0,"ondisk_log_size":3226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:44:24.798982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13751970099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'490","reported_seq":531,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-01T15:59:28.388301+0000","last_change":"2023-12-01T15:43:45.200400+0000","last_active":"2023-12-01T15:59:28.388301+0000","last_peered":"2023-12-01T15:59:28.388301+0000","last_clean":"2023-12-01T15:59:28.388301+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:59:28.388301+0000","last_undegraded":"2023-12-01T15:59:28.388301+0000","last_fullsized":"2023-12-01T15:59:28.388301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:10:55.013070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":17875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'3421","reported_seq":2860,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479143+0000","last_change":"2023-12-01T15:59:36.955244+0000","last_active":"2023-12-01T15:59:43.479143+0000","last_peered":"2023-12-01T15:59:43.479143+0000","last_clean":"2023-12-01T15:59:43.479143+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:59:43.479143+0000","last_undegraded":"2023-12-01T15:59:43.479143+0000","last_fullsized":"2023-12-01T15:59:43.479143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:49:07.172774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134588554,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"43'3616","reported_seq":3658,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:38.221024+0000","last_change":"2023-12-01T15:43:45.200975+0000","last_active":"2023-12-01T15:59:38.221024+0000","last_peered":"2023-12-01T15:59:38.221024+0000","last_clean":"2023-12-01T15:59:38.221024+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:59:38.221024+0000","last_undegraded":"2023-12-01T15:59:38.221024+0000","last_fullsized":"2023-12-01T15:59:38.221024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3616,"log_dups_size":0,"ondisk_log_size":3616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:42:07.487467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3601,"num_write_kb":33849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"43'3891","reported_seq":3214,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:37.471375+0000","last_change":"2023-12-01T15:59:37.485420+0000","last_active":"2023-12-01T15:59:37.471375+0000","last_peered":"2023-12-01T15:59:37.471375+0000","last_clean":"2023-12-01T15:59:37.471375+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T15:59:37.471375+0000","last_undegraded":"2023-12-01T15:59:37.471375+0000","last_fullsized":"2023-12-01T15:59:37.471375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3891,"log_dups_size":0,"ondisk_log_size":3891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:28.643252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65050901000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1b","version":"40'2098","reported_seq":2140,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.832250+0000","last_change":"2023-12-01T15:43:45.208899+0000","last_active":"2023-12-01T15:59:36.832250+0000","last_peered":"2023-12-01T15:59:36.832250+0000","last_clean":"2023-12-01T15:59:36.832250+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T15:59:36.832250+0000","last_undegraded":"2023-12-01T15:59:36.832250+0000","last_fullsized":"2023-12-01T15:59:36.832250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:52:13.782715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2089,"num_write_kb":16989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"43'3665","reported_seq":3075,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395621+0000","last_change":"2023-12-01T15:59:36.912047+0000","last_active":"2023-12-01T15:59:43.395621+0000","last_peered":"2023-12-01T15:59:43.395621+0000","last_clean":"2023-12-01T15:59:43.395621+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T15:59:43.395621+0000","last_undegraded":"2023-12-01T15:59:43.395621+0000","last_fullsized":"2023-12-01T15:59:43.395621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:28:55.283620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.084960400000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1169,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"43'639","reported_seq":681,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:41.681232+0000","last_change":"2023-12-01T15:43:45.203471+0000","last_active":"2023-12-01T15:59:41.681232+0000","last_peered":"2023-12-01T15:59:41.681232+0000","last_clean":"2023-12-01T15:59:41.681232+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T15:59:41.681232+0000","last_undegraded":"2023-12-01T15:59:41.681232+0000","last_fullsized":"2023-12-01T15:59:41.681232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:02.125158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1878650,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":642,"num_write_kb":6073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"43'3570","reported_seq":2965,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.396534+0000","last_change":"2023-12-01T15:59:36.912038+0000","last_active":"2023-12-01T15:59:43.396534+0000","last_peered":"2023-12-01T15:59:43.396534+0000","last_clean":"2023-12-01T15:59:43.396534+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:59:43.396534+0000","last_undegraded":"2023-12-01T15:59:43.396534+0000","last_fullsized":"2023-12-01T15:59:43.396534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:08:26.639787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.094045403999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"36'5936","reported_seq":5978,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.833949+0000","last_change":"2023-12-01T15:43:45.208222+0000","last_active":"2023-12-01T15:59:36.833949+0000","last_peered":"2023-12-01T15:59:36.833949+0000","last_clean":"2023-12-01T15:59:36.833949+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:59:36.833949+0000","last_undegraded":"2023-12-01T15:59:36.833949+0000","last_fullsized":"2023-12-01T15:59:36.833949+0000","mapping_epoch":16,"log_start":"21'300","ondisk_log_start":"21'300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":5636,"log_dups_size":0,"ondisk_log_size":5636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:46:12.161060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5940,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'3525","reported_seq":2987,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477961+0000","last_change":"2023-12-01T15:59:36.954665+0000","last_active":"2023-12-01T15:59:43.477961+0000","last_peered":"2023-12-01T15:59:43.477961+0000","last_clean":"2023-12-01T15:59:43.477961+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:59:43.477961+0000","last_undegraded":"2023-12-01T15:59:43.477961+0000","last_fullsized":"2023-12-01T15:59:43.477961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:53:48.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134288985,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"39'3426","reported_seq":3469,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.822226+0000","last_change":"2023-12-01T15:43:45.208256+0000","last_active":"2023-12-01T15:59:36.822226+0000","last_peered":"2023-12-01T15:59:36.822226+0000","last_clean":"2023-12-01T15:59:36.822226+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T15:59:36.822226+0000","last_undegraded":"2023-12-01T15:59:36.822226+0000","last_fullsized":"2023-12-01T15:59:36.822226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:24:32.359318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3411,"num_write_kb":30086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'4049","reported_seq":3329,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394757+0000","last_change":"2023-12-01T15:59:36.912664+0000","last_active":"2023-12-01T15:59:43.394757+0000","last_peered":"2023-12-01T15:59:43.394757+0000","last_clean":"2023-12-01T15:59:43.394757+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:59:43.394757+0000","last_undegraded":"2023-12-01T15:59:43.394757+0000","last_fullsized":"2023-12-01T15:59:43.394757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":4049,"log_dups_size":0,"ondisk_log_size":4049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:04:44.492724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.091841191000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"39'1803","reported_seq":1846,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-01T15:59:36.823756+0000","last_change":"2023-12-01T15:43:45.204599+0000","last_active":"2023-12-01T15:59:36.823756+0000","last_peered":"2023-12-01T15:59:36.823756+0000","last_clean":"2023-12-01T15:59:36.823756+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T15:59:36.823756+0000","last_undegraded":"2023-12-01T15:59:36.823756+0000","last_fullsized":"2023-12-01T15:59:36.823756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1803,"log_dups_size":0,"ondisk_log_size":1803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:02.959675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1812,"num_write_kb":15324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":76140,"num_write_kb":40588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225506,"ondisk_log_size":225506,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":277870008,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":223,"num_read_kb":3419,"num_write":76833,"num_write_kb":641151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":555802624,"data_stored":555740016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76348,"ondisk_log_size":76348,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705862,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":682756,"kb_used_data":134076,"kb_used_omap":0,"kb_used_meta":548672,"kb_avail":93689084,"statfs":{"total":96636764160,"available":95937622016,"internally_reserved":0,"allocated":137293824,"data_stored":136935056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":561840128},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.68500000000000005,"15min":0.63400000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.1799999999999999,"5min":10.84,"15min":10.84},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.129,"5min":0.88900000000000001,"15min":0.70899999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":11.926,"5min":11.926,"15min":11.926},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.71799999999999997,"15min":0.66800000000000004},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.246},"max":{"1min":0.77200000000000002,"5min":10.807,"15min":10.807},"last":0.626},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":3.552,"5min":3.552,"15min":3.552},"last":0.56699999999999995}]},{"osd":2,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.72699999999999998,"15min":0.63},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.8700000000000001,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.68000000000000005,"15min":0.64700000000000002},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.71599999999999997,"5min":10.715999999999999,"15min":10.715999999999999},"last":0.70899999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705863,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":801880,"kb_used_data":157264,"kb_used_omap":0,"kb_used_meta":644608,"kb_avail":93569960,"statfs":{"total":96636764160,"available":95815639040,"internally_reserved":0,"allocated":161038336,"data_stored":160671440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":660078592},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.23000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":1.798,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.60699999999999998,"15min":0.65500000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.84099999999999997,"5min":0.91200000000000003,"15min":2.657},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.68600000000000005,"15min":0.66300000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.8240000000000001,"5min":8.0779999999999994,"15min":8.0779999999999994},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.439,"5min":0.60799999999999998,"15min":0.627},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80500000000000005,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Dec 1 15:58:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.53300000000000003,"15min":0.56499999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52200000000000002,"5min":2.048,"15min":7.5289999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.70799999999999996,"15min":0.67200000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.845,"5min":8.0370000000000008,"15min":9.8949999999999996},"last":0.42099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705861,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589232,"kb_used_data":98856,"kb_used_omap":0,"kb_used_meta":490368,"kb_avail":93782608,"statfs":{"total":96636764160,"available":96033390592,"internally_reserved":0,"allocated":101228544,"data_stored":100901390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502136832},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.45600000000000002,"15min":0.50800000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17299999999999999},"max":{"1min":0.73299999999999998,"5min":0.749,"15min":8.4589999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.22,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.7729999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63800000000000001,"15min":0.64500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.25900000000000001},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.501},{"interface":"front","average":{"1min":0.501,"5min":0.63,"15min":0.68300000000000005},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.754,"5min":2.6640000000000001,"15min":10.914999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Dec 1 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.251},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.36699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":3.1539999999999999,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.62}]}]},{"osd":0,"up_from":9,"seq":38654705862,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814568,"kb_used_data":156000,"kb_used_omap":0,"kb_used_meta":658560,"kb_avail":93557272,"statfs":{"total":96636764160,"available":95802646528,"internally_reserved":0,"allocated":159744000,"data_stored":159387283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":674365440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47399999999999998,"15min":0.49099999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.1890000000000001,"5min":1.595,"15min":1.595},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.51800000000000002,"15min":0.623},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.70499999999999996,"5min":3.3639999999999999,"15min":30.995000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61399999999999999,"15min":0.73099999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":24.504000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.64600000000000002,"15min":0.76400000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":24.524999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Dec 1 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64800000000000002,"15min":0.75600000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.859,"5min":2.859,"15min":31.038},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.504,"5min":0.63400000000000001,"15min":0.69799999999999995},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.95799999999999996,"15min":7.9420000000000002},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":158564352,"data_stored":158550118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":160452608,"data_stored":160428699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":136122368,"data_stored":136097903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T15:59:46.540 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.540 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.541 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.541 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.541 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.541 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.542 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.542 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.542 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.542 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.543 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.543 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.543 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.543 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.543 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.543 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.544 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.544 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.544 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.544 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.544 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.545 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.545 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.545 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.545 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.545 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.546 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.546 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.546 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.546 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.546 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.547 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.547 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.547 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.547 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.548 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.548 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.548 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.548 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.548 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.549 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.549 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.549 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.549 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.549 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.550 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.550 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.550 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.550 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.550 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.551 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.551 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.551 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.551 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.551 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.552 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.552 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-01T15:43:34.700727+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=34, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.552 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.552 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.552 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.553 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.553 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.553 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.553 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.553 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.554 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.554 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.554 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.554 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.554 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.555 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.555 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.555 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.555 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.555 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.556 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.556 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.556 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.556 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.556 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.556 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.557 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.557 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.557 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.557 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.557 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.558 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.558 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.558 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.558 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.558 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.559 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.559 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.559 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.559 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.559 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.560 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.560 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.560 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.560 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.560 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.560 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.561 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.561 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.561 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T15:59:46.561 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-01T16:00:06.562 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T16:00:06.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.676+0000 7f1bd359e700 1 Processor -- start 2023-12-01T16:00:06.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.676+0000 7f1bd359e700 1 -- start start 2023-12-01T16:00:06.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.676+0000 7f1bd359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bd409f830 0x7f1bd413ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:06.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1bd40a4bb0 0x7f1bd4098a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:06.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd40a3db0 con 0x7f1bd4098fa0 2023-12-01T16:00:06.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd40a5190 con 0x7f1bd40a4bb0 2023-12-01T16:00:06.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd413a590 con 0x7f1bd409f830 2023-12-01T16:00:06.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd1d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1bd40a4bb0 0x7f1bd4098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:06.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd2d9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1bd4098fa0 0x7f1bd4141920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59984/0 (socket says 172.21.15.63:59984) 2023-12-01T16:00:06.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd1d9b700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1bd40a4bb0 0x7f1bd4098a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37442/0 (socket says 172.21.15.63:37442) 2023-12-01T16:00:06.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd2d9d700 1 -- 172.21.15.63:0/2941415714 learned_addr learned my addr 172.21.15.63:0/2941415714 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T16:00:06.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd259c700 1 --2- 172.21.15.63:0/2941415714 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bd409f830 0x7f1bd413ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:06.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd1d9b700 1 -- 172.21.15.63:0/2941415714 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bd409f830 msgr2=0x7f1bd413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:00:06.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd1d9b700 1 --2- 172.21.15.63:0/2941415714 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bd409f830 0x7f1bd413ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:06.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd1d9b700 1 -- 172.21.15.63:0/2941415714 >> v1:172.21.15.63:6789/0 conn(0x7f1bd4098fa0 legacy=0x7f1bd4141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:06.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd1d9b700 1 -- 172.21.15.63:0/2941415714 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40a53e0 con 0x7f1bd40a4bb0 2023-12-01T16:00:06.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd1d9b700 1 --2- 172.21.15.63:0/2941415714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd40a4bb0 0x7f1bd4098a60 secure :-1 s=READY pgs=2955 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009850 tx=0x7f1bc4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef035be5cf16c8c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:00:06.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd159a700 1 -- 172.21.15.63:0/2941415714 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4011830 con 0x7f1bd40a4bb0 2023-12-01T16:00:06.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd159a700 1 -- 172.21.15.63:0/2941415714 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4011990 con 0x7f1bd40a4bb0 2023-12-01T16:00:06.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd159a700 1 -- 172.21.15.63:0/2941415714 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4011d20 con 0x7f1bd40a4bb0 2023-12-01T16:00:06.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 -- 172.21.15.63:0/2941415714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd40a4bb0 msgr2=0x7f1bd4098a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:06.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 --2- 172.21.15.63:0/2941415714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd40a4bb0 0x7f1bd4098a60 secure :-1 s=READY pgs=2955 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009850 tx=0x7f1bc4009b60 comp rx=0 tx=0).stop 2023-12-01T16:00:06.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 -- 172.21.15.63:0/2941415714 shutdown_connections 2023-12-01T16:00:06.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 --2- 172.21.15.63:0/2941415714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd40a4bb0 0x7f1bd4098a60 unknown :-1 s=CLOSED pgs=2955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:06.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 --2- 172.21.15.63:0/2941415714 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bd409f830 0x7f1bd413ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:06.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 -- 172.21.15.63:0/2941415714 >> 172.21.15.63:0/2941415714 conn(0x7f1bd40a58a0 msgr2=0x7f1bd40a5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:00:06.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 -- 172.21.15.63:0/2941415714 shutdown_connections 2023-12-01T16:00:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 -- 172.21.15.63:0/2941415714 wait complete. 2023-12-01T16:00:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 Processor -- start 2023-12-01T16:00:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.680+0000 7f1bd359e700 1 -- start start 2023-12-01T16:00:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bd4098fa0 0x7f1bd41cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd359e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd409f830 0x7f1bd41cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bd41d01a0 0x7f1bd4130500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd359e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4137e70 con 0x7f1bd409f830 2023-12-01T16:00:06.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41363c0 con 0x7f1bd4098fa0 2023-12-01T16:00:06.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4137760 con 0x7f1bd41d01a0 2023-12-01T16:00:06.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd1d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd409f830 0x7f1bd41cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:06.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd1d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd409f830 0x7f1bd41cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37448/0 (socket says 172.21.15.63:37448) 2023-12-01T16:00:06.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd1d9b700 1 -- 172.21.15.63:0/567112690 learned_addr learned my addr 172.21.15.63:0/567112690 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:00:06.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd2d9d700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bd41d01a0 0x7f1bd4130500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:06.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd259c700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bd4098fa0 0x7f1bd41cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:06.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd1d9b700 1 -- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bd41d01a0 msgr2=0x7f1bd4130500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:06.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd1d9b700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bd41d01a0 0x7f1bd4130500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:06.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd1d9b700 1 -- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bd4098fa0 msgr2=0x7f1bd41cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:06.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd1d9b700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bd4098fa0 0x7f1bd41cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:06.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd1d9b700 1 -- 172.21.15.63:0/567112690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40094b0 con 0x7f1bd409f830 2023-12-01T16:00:06.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd2d9d700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bd41d01a0 0x7f1bd4130500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T16:00:06.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd259c700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bd4098fa0 0x7f1bd41cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T16:00:06.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd1d9b700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd409f830 0x7f1bd41cfc60 secure :-1 s=READY pgs=2956 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009fd0 tx=0x7f1bc4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:00:06.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bc2ffd700 1 -- 172.21.15.63:0/567112690 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4004310 con 0x7f1bd409f830 2023-12-01T16:00:06.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bc2ffd700 1 -- 172.21.15.63:0/567112690 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc401f070 con 0x7f1bd409f830 2023-12-01T16:00:06.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd359e700 1 -- 172.21.15.63:0/567112690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd41379f0 con 0x7f1bd409f830 2023-12-01T16:00:06.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bc2ffd700 1 -- 172.21.15.63:0/567112690 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40036c0 con 0x7f1bd409f830 2023-12-01T16:00:06.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd359e700 1 -- 172.21.15.63:0/567112690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd41366d0 con 0x7f1bd409f830 2023-12-01T16:00:06.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.684+0000 7f1bd359e700 1 -- 172.21.15.63:0/567112690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd4065fb0 con 0x7f1bd409f830 2023-12-01T16:00:06.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.688+0000 7f1bc2ffd700 1 -- 172.21.15.63:0/567112690 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1bc4021030 con 0x7f1bd409f830 2023-12-01T16:00:06.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.688+0000 7f1bc2ffd700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1bb4065ad0 0x7f1bb4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:06.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.688+0000 7f1bc2ffd700 1 -- 172.21.15.63:0/567112690 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7f1bc40840e0 con 0x7f1bd409f830 2023-12-01T16:00:06.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.688+0000 7f1bd259c700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1bb4065ad0 0x7f1bb4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:06.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.688+0000 7f1bd259c700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1bb4065ad0 0x7f1bb4067f90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009840 tx=0x7f1bc8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:00:06.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.692+0000 7f1bc2ffd700 1 -- 172.21.15.63:0/567112690 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1bc4052050 con 0x7f1bd409f830 2023-12-01T16:00:06.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.860+0000 7f1bd359e700 1 -- 172.21.15.63:0/567112690 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bd413a7f0 con 0x7f1bb4065ad0 2023-12-01T16:00:06.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.876+0000 7f1bc2ffd700 1 -- 172.21.15.63:0/567112690 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277470 (secure 0 0 0) 0x7f1bc8004030 con 0x7f1bb4065ad0 2023-12-01T16:00:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T16:00:06.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 -- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1bb4065ad0 msgr2=0x7f1bb4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:06.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1bb4065ad0 0x7f1bb4067f90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009840 tx=0x7f1bc8008040 comp rx=0 tx=0).stop 2023-12-01T16:00:06.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 -- 172.21.15.63:0/567112690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd409f830 msgr2=0x7f1bd41cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:06.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd409f830 0x7f1bd41cfc60 secure :-1 s=READY pgs=2956 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009fd0 tx=0x7f1bc4004770 comp rx=0 tx=0).stop 2023-12-01T16:00:06.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 -- 172.21.15.63:0/567112690 shutdown_connections 2023-12-01T16:00:06.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f1bb4065ad0 0x7f1bb4067f90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:06.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bd41d01a0 0x7f1bd4130500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:06.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd409f830 0x7f1bd41cfc60 unknown :-1 s=CLOSED pgs=2956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:06.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 --2- 172.21.15.63:0/567112690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bd4098fa0 0x7f1bd41cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:06.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 -- 172.21.15.63:0/567112690 >> 172.21.15.63:0/567112690 conn(0x7f1bd40a58a0 msgr2=0x7f1bd40a7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:00:06.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 -- 172.21.15.63:0/567112690 shutdown_connections 2023-12-01T16:00:06.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:06.884+0000 7f1bd359e700 1 -- 172.21.15.63:0/567112690 wait complete. 2023-12-01T16:00:06.896 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T16:00:06.908 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2023-12-01T16:00:06.709948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":278600058,"num_objects":242,"num_object_clones":28,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":15,"num_read":370,"num_read_kb":3540,"num_write":153136,"num_write_kb":684169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":672543,"num_omap_keys":1341,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302025,"ondisk_log_size":302025,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":2888472,"kb_used_data":546232,"kb_used_omap":0,"kb_used_meta":2342208,"kb_avail":374598888,"statfs":{"total":386547056640,"available":383589261312,"internally_reserved":0,"allocated":559341568,"data_stored":557924776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2398420992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":672543,"num_omap_keys":1341,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004437"},"pg_stats":[{"pgid":"4.3f","version":"43'3303","reported_seq":2799,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480994+0000","last_change":"2023-12-01T15:59:36.960583+0000","last_active":"2023-12-01T15:59:43.480994+0000","last_peered":"2023-12-01T15:59:43.480994+0000","last_clean":"2023-12-01T15:59:43.480994+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:59:43.480994+0000","last_undegraded":"2023-12-01T15:59:43.480994+0000","last_fullsized":"2023-12-01T15:59:43.480994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13670799,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"43'3496","reported_seq":2956,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.397472+0000","last_change":"2023-12-01T15:59:36.899161+0000","last_active":"2023-12-01T15:59:43.397472+0000","last_peered":"2023-12-01T15:59:43.397472+0000","last_clean":"2023-12-01T15:59:43.397472+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T15:59:43.397472+0000","last_undegraded":"2023-12-01T15:59:43.397472+0000","last_fullsized":"2023-12-01T15:59:43.397472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.085048589999999993,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'3434","reported_seq":2897,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478931+0000","last_change":"2023-12-01T15:59:36.980200+0000","last_active":"2023-12-01T15:59:43.478931+0000","last_peered":"2023-12-01T15:59:43.478931+0000","last_clean":"2023-12-01T15:59:43.478931+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:59:43.478931+0000","last_undegraded":"2023-12-01T15:59:43.478931+0000","last_fullsized":"2023-12-01T15:59:43.478931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15483981599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"44'3688","reported_seq":3053,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.948071+0000","last_change":"2023-12-01T15:59:46.948071+0000","last_active":"2023-12-01T15:59:46.948071+0000","last_peered":"2023-12-01T15:59:46.948071+0000","last_clean":"2023-12-01T15:59:46.948071+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:59:46.948071+0000","last_undegraded":"2023-12-01T15:59:46.948071+0000","last_fullsized":"2023-12-01T15:59:46.948071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3688","last_scrub_stamp":"2023-12-01T15:59:46.947938+0000","last_deep_scrub":"44'3688","last_deep_scrub_stamp":"2023-12-01T15:59:46.947938+0000","last_clean_scrub_stamp":"2023-12-01T15:59:46.947938+0000","objects_scrubbed":1,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:14:57.265242+0000","scrub_duration":0.050574905000000003,"objects_trimmed":0,"snaptrim_duration":0.086572531999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"43'3485","reported_seq":2918,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.481658+0000","last_change":"2023-12-01T15:59:36.962909+0000","last_active":"2023-12-01T15:59:43.481658+0000","last_peered":"2023-12-01T15:59:43.481658+0000","last_clean":"2023-12-01T15:59:43.481658+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T15:59:43.481658+0000","last_undegraded":"2023-12-01T15:59:43.481658+0000","last_fullsized":"2023-12-01T15:59:43.481658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13014335599999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'3419","reported_seq":2861,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478234+0000","last_change":"2023-12-01T15:59:36.980233+0000","last_active":"2023-12-01T15:59:43.478234+0000","last_peered":"2023-12-01T15:59:43.478234+0000","last_clean":"2023-12-01T15:59:43.478234+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T15:59:43.478234+0000","last_undegraded":"2023-12-01T15:59:43.478234+0000","last_fullsized":"2023-12-01T15:59:43.478234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.133828119,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'3764","reported_seq":3219,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477306+0000","last_change":"2023-12-01T15:59:36.977002+0000","last_active":"2023-12-01T15:59:43.477306+0000","last_peered":"2023-12-01T15:59:43.477306+0000","last_clean":"2023-12-01T15:59:43.477306+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T15:59:43.477306+0000","last_undegraded":"2023-12-01T15:59:43.477306+0000","last_fullsized":"2023-12-01T15:59:43.477306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3764,"log_dups_size":0,"ondisk_log_size":3764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16251290900000001,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'3433","reported_seq":2838,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477401+0000","last_change":"2023-12-01T15:59:36.975843+0000","last_active":"2023-12-01T15:59:43.477401+0000","last_peered":"2023-12-01T15:59:43.477401+0000","last_clean":"2023-12-01T15:59:43.477401+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:59:43.477401+0000","last_undegraded":"2023-12-01T15:59:43.477401+0000","last_fullsized":"2023-12-01T15:59:43.477401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3433,"log_dups_size":0,"ondisk_log_size":3433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.173046373,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"43'3524","reported_seq":2943,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479316+0000","last_change":"2023-12-01T15:59:36.960250+0000","last_active":"2023-12-01T15:59:43.479316+0000","last_peered":"2023-12-01T15:59:43.479316+0000","last_clean":"2023-12-01T15:59:43.479316+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:59:43.479316+0000","last_undegraded":"2023-12-01T15:59:43.479316+0000","last_fullsized":"2023-12-01T15:59:43.479316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13648046599999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'3320","reported_seq":2810,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480320+0000","last_change":"2023-12-01T15:59:36.978454+0000","last_active":"2023-12-01T15:59:43.480320+0000","last_peered":"2023-12-01T15:59:43.480320+0000","last_clean":"2023-12-01T15:59:43.480320+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:59:43.480320+0000","last_undegraded":"2023-12-01T15:59:43.480320+0000","last_fullsized":"2023-12-01T15:59:43.480320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.160523057,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"44'3408","reported_seq":2881,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.074279+0000","last_change":"2023-12-01T15:59:56.074578+0000","last_active":"2023-12-01T15:59:56.074279+0000","last_peered":"2023-12-01T15:59:56.074279+0000","last_clean":"2023-12-01T15:59:56.074279+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:59:56.074279+0000","last_undegraded":"2023-12-01T15:59:56.074279+0000","last_fullsized":"2023-12-01T15:59:56.074279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3408","last_scrub_stamp":"2023-12-01T15:59:56.074209+0000","last_deep_scrub":"44'3408","last_deep_scrub_stamp":"2023-12-01T15:59:56.074209+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.074209+0000","objects_scrubbed":1,"log_size":3408,"log_dups_size":0,"ondisk_log_size":3408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:17.450625+0000","scrub_duration":0.044446310000000003,"objects_trimmed":0,"snaptrim_duration":0.080275320999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"43'3529","reported_seq":2903,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395358+0000","last_change":"2023-12-01T15:59:37.474340+0000","last_active":"2023-12-01T15:59:43.395358+0000","last_peered":"2023-12-01T15:59:43.395358+0000","last_clean":"2023-12-01T15:59:43.395358+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T15:59:43.395358+0000","last_undegraded":"2023-12-01T15:59:43.395358+0000","last_fullsized":"2023-12-01T15:59:43.395358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63957533600000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"43'3178","reported_seq":2650,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477526+0000","last_change":"2023-12-01T15:59:36.959529+0000","last_active":"2023-12-01T15:59:43.477526+0000","last_peered":"2023-12-01T15:59:43.477526+0000","last_clean":"2023-12-01T15:59:43.477526+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T15:59:43.477526+0000","last_undegraded":"2023-12-01T15:59:43.477526+0000","last_fullsized":"2023-12-01T15:59:43.477526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3178,"log_dups_size":0,"ondisk_log_size":3178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138334033,"stat_sum":{"num_bytes":12297,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"43'3508","reported_seq":2933,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394908+0000","last_change":"2023-12-01T15:59:36.908392+0000","last_active":"2023-12-01T15:59:43.394908+0000","last_peered":"2023-12-01T15:59:43.394908+0000","last_clean":"2023-12-01T15:59:43.394908+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T15:59:43.394908+0000","last_undegraded":"2023-12-01T15:59:43.394908+0000","last_fullsized":"2023-12-01T15:59:43.394908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.091404182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"43'3600","reported_seq":3008,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394290+0000","last_change":"2023-12-01T15:59:36.901530+0000","last_active":"2023-12-01T15:59:43.394290+0000","last_peered":"2023-12-01T15:59:43.394290+0000","last_clean":"2023-12-01T15:59:43.394290+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:43.394290+0000","last_undegraded":"2023-12-01T15:59:43.394290+0000","last_fullsized":"2023-12-01T15:59:43.394290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086861997999999996,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1247,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"43'3533","reported_seq":2943,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477773+0000","last_change":"2023-12-01T15:59:36.976205+0000","last_active":"2023-12-01T15:59:43.477773+0000","last_peered":"2023-12-01T15:59:43.477773+0000","last_clean":"2023-12-01T15:59:43.477773+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T15:59:43.477773+0000","last_undegraded":"2023-12-01T15:59:43.477773+0000","last_fullsized":"2023-12-01T15:59:43.477773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3533,"log_dups_size":0,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17327173600000001,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"43'3588","reported_seq":2965,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479813+0000","last_change":"2023-12-01T15:59:36.959847+0000","last_active":"2023-12-01T15:59:43.479813+0000","last_peered":"2023-12-01T15:59:43.479813+0000","last_clean":"2023-12-01T15:59:43.479813+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T15:59:43.479813+0000","last_undegraded":"2023-12-01T15:59:43.479813+0000","last_fullsized":"2023-12-01T15:59:43.479813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13630616600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'3282","reported_seq":2785,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480347+0000","last_change":"2023-12-01T15:59:36.977461+0000","last_active":"2023-12-01T15:59:43.480347+0000","last_peered":"2023-12-01T15:59:43.480347+0000","last_clean":"2023-12-01T15:59:43.480347+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T15:59:43.480347+0000","last_undegraded":"2023-12-01T15:59:43.480347+0000","last_fullsized":"2023-12-01T15:59:43.480347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.159652814,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1044,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"43'3337","reported_seq":2778,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478741+0000","last_change":"2023-12-01T15:59:36.954938+0000","last_active":"2023-12-01T15:59:43.478741+0000","last_peered":"2023-12-01T15:59:43.478741+0000","last_clean":"2023-12-01T15:59:43.478741+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T15:59:43.478741+0000","last_undegraded":"2023-12-01T15:59:43.478741+0000","last_fullsized":"2023-12-01T15:59:43.478741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134439324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"43'3655","reported_seq":3092,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477915+0000","last_change":"2023-12-01T15:59:36.963898+0000","last_active":"2023-12-01T15:59:43.477915+0000","last_peered":"2023-12-01T15:59:43.477915+0000","last_clean":"2023-12-01T15:59:43.477915+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:59:43.477915+0000","last_undegraded":"2023-12-01T15:59:43.477915+0000","last_fullsized":"2023-12-01T15:59:43.477915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3655,"log_dups_size":0,"ondisk_log_size":3655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16502647100000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"43'3592","reported_seq":3030,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395455+0000","last_change":"2023-12-01T15:59:36.908706+0000","last_active":"2023-12-01T15:59:43.395455+0000","last_peered":"2023-12-01T15:59:43.395455+0000","last_clean":"2023-12-01T15:59:43.395455+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T15:59:43.395455+0000","last_undegraded":"2023-12-01T15:59:43.395455+0000","last_fullsized":"2023-12-01T15:59:43.395455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.082049368999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"43'3494","reported_seq":2868,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477650+0000","last_change":"2023-12-01T15:59:36.954854+0000","last_active":"2023-12-01T15:59:43.477650+0000","last_peered":"2023-12-01T15:59:43.477650+0000","last_clean":"2023-12-01T15:59:43.477650+0000","last_became_active":"2023-12-01T15:44:30.528283+0000","last_became_peered":"2023-12-01T15:44:30.528283+0000","last_unstale":"2023-12-01T15:59:43.477650+0000","last_undegraded":"2023-12-01T15:59:43.477650+0000","last_fullsized":"2023-12-01T15:59:43.477650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3494,"log_dups_size":0,"ondisk_log_size":3494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13495370100000001,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'3466","reported_seq":2924,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.393003+0000","last_change":"2023-12-01T15:59:37.440864+0000","last_active":"2023-12-01T15:59:43.393003+0000","last_peered":"2023-12-01T15:59:43.393003+0000","last_clean":"2023-12-01T15:59:43.393003+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T15:59:43.393003+0000","last_undegraded":"2023-12-01T15:59:43.393003+0000","last_fullsized":"2023-12-01T15:59:43.393003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3466,"log_dups_size":0,"ondisk_log_size":3466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.62816057700000005,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"44'3578","reported_seq":2961,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:55.212242+0000","last_change":"2023-12-01T15:59:55.212383+0000","last_active":"2023-12-01T15:59:55.212242+0000","last_peered":"2023-12-01T15:59:55.212242+0000","last_clean":"2023-12-01T15:59:55.212242+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:59:55.212242+0000","last_undegraded":"2023-12-01T15:59:55.212242+0000","last_fullsized":"2023-12-01T15:59:55.212242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3578","last_scrub_stamp":"2023-12-01T15:59:55.212209+0000","last_deep_scrub":"44'3578","last_deep_scrub_stamp":"2023-12-01T15:59:55.212209+0000","last_clean_scrub_stamp":"2023-12-01T15:59:55.212209+0000","objects_scrubbed":1,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:16.402349+0000","scrub_duration":0.042530062,"objects_trimmed":0,"snaptrim_duration":0.17330785400000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"43'3344","reported_seq":2823,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394984+0000","last_change":"2023-12-01T15:59:37.452527+0000","last_active":"2023-12-01T15:59:43.394984+0000","last_peered":"2023-12-01T15:59:43.394984+0000","last_clean":"2023-12-01T15:59:43.394984+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T15:59:43.394984+0000","last_undegraded":"2023-12-01T15:59:43.394984+0000","last_fullsized":"2023-12-01T15:59:43.394984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63729295699999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'3411","reported_seq":2864,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394752+0000","last_change":"2023-12-01T15:59:37.421961+0000","last_active":"2023-12-01T15:59:43.394752+0000","last_peered":"2023-12-01T15:59:43.394752+0000","last_clean":"2023-12-01T15:59:43.394752+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T15:59:43.394752+0000","last_undegraded":"2023-12-01T15:59:43.394752+0000","last_fullsized":"2023-12-01T15:59:43.394752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3411,"log_dups_size":0,"ondisk_log_size":3411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.611917673,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"43'3312","reported_seq":2739,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480956+0000","last_change":"2023-12-01T15:59:36.980913+0000","last_active":"2023-12-01T15:59:43.480956+0000","last_peered":"2023-12-01T15:59:43.480956+0000","last_clean":"2023-12-01T15:59:43.480956+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T15:59:43.480956+0000","last_undegraded":"2023-12-01T15:59:43.480956+0000","last_fullsized":"2023-12-01T15:59:43.480956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.146734475,"stat_sum":{"num_bytes":4116,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'3312","reported_seq":2773,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.396620+0000","last_change":"2023-12-01T15:59:37.489547+0000","last_active":"2023-12-01T15:59:43.396620+0000","last_peered":"2023-12-01T15:59:43.396620+0000","last_clean":"2023-12-01T15:59:43.396620+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T15:59:43.396620+0000","last_undegraded":"2023-12-01T15:59:43.396620+0000","last_fullsized":"2023-12-01T15:59:43.396620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65414528699999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"43'3662","reported_seq":3039,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478127+0000","last_change":"2023-12-01T15:59:36.959770+0000","last_active":"2023-12-01T15:59:43.478127+0000","last_peered":"2023-12-01T15:59:43.478127+0000","last_clean":"2023-12-01T15:59:43.478127+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T15:59:43.478127+0000","last_undegraded":"2023-12-01T15:59:43.478127+0000","last_fullsized":"2023-12-01T15:59:43.478127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13835824199999999,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"44'3522","reported_seq":3005,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.187646+0000","last_change":"2023-12-01T15:59:48.187910+0000","last_active":"2023-12-01T15:59:48.187646+0000","last_peered":"2023-12-01T15:59:48.187646+0000","last_clean":"2023-12-01T15:59:48.187646+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:59:48.187646+0000","last_undegraded":"2023-12-01T15:59:48.187646+0000","last_fullsized":"2023-12-01T15:59:48.187646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3522","last_scrub_stamp":"2023-12-01T15:59:48.187580+0000","last_deep_scrub":"44'3522","last_deep_scrub_stamp":"2023-12-01T15:59:48.187580+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.187580+0000","objects_scrubbed":2,"log_size":3522,"log_dups_size":0,"ondisk_log_size":3522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:21.418682+0000","scrub_duration":0.049219767999999997,"objects_trimmed":0,"snaptrim_duration":0.13490588100000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"43'3994","reported_seq":3320,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.393101+0000","last_change":"2023-12-01T15:59:37.471324+0000","last_active":"2023-12-01T15:59:43.393101+0000","last_peered":"2023-12-01T15:59:43.393101+0000","last_clean":"2023-12-01T15:59:43.393101+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T15:59:43.393101+0000","last_undegraded":"2023-12-01T15:59:43.393101+0000","last_fullsized":"2023-12-01T15:59:43.393101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3994,"log_dups_size":0,"ondisk_log_size":3994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65412195699999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"43'3592","reported_seq":2995,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394360+0000","last_change":"2023-12-01T15:59:36.911013+0000","last_active":"2023-12-01T15:59:43.394360+0000","last_peered":"2023-12-01T15:59:43.394360+0000","last_clean":"2023-12-01T15:59:43.394360+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T15:59:43.394360+0000","last_undegraded":"2023-12-01T15:59:43.394360+0000","last_fullsized":"2023-12-01T15:59:43.394360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090414480000000005,"stat_sum":{"num_bytes":4118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"44'3662","reported_seq":3074,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:58.388113+0000","last_change":"2023-12-01T15:59:58.388349+0000","last_active":"2023-12-01T15:59:58.388113+0000","last_peered":"2023-12-01T15:59:58.388113+0000","last_clean":"2023-12-01T15:59:58.388113+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:59:58.388113+0000","last_undegraded":"2023-12-01T15:59:58.388113+0000","last_fullsized":"2023-12-01T15:59:58.388113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3662","last_scrub_stamp":"2023-12-01T15:59:58.388055+0000","last_deep_scrub":"44'3662","last_deep_scrub_stamp":"2023-12-01T15:59:58.388055+0000","last_clean_scrub_stamp":"2023-12-01T15:59:58.388055+0000","objects_scrubbed":1,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:31.619158+0000","scrub_duration":0.048690542000000003,"objects_trimmed":0,"snaptrim_duration":0.646838511,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"39'2734","reported_seq":2778,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174284+0000","last_change":"2023-12-01T15:43:45.205685+0000","last_active":"2023-12-01T15:59:46.174284+0000","last_peered":"2023-12-01T15:59:46.174284+0000","last_clean":"2023-12-01T15:59:46.174284+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T15:59:46.174284+0000","last_undegraded":"2023-12-01T15:59:46.174284+0000","last_fullsized":"2023-12-01T15:59:46.174284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2734,"log_dups_size":0,"ondisk_log_size":2734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2729,"num_write_kb":18350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"43'3426","reported_seq":2845,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479561+0000","last_change":"2023-12-01T15:59:36.979597+0000","last_active":"2023-12-01T15:59:43.479561+0000","last_peered":"2023-12-01T15:59:43.479561+0000","last_clean":"2023-12-01T15:59:43.479561+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:59:43.479561+0000","last_undegraded":"2023-12-01T15:59:43.479561+0000","last_fullsized":"2023-12-01T15:59:43.479561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15458043599999999,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"35'5","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.719547+0000","last_change":"2023-12-01T15:43:45.203521+0000","last_active":"2023-12-01T15:59:44.719547+0000","last_peered":"2023-12-01T15:59:44.719547+0000","last_clean":"2023-12-01T15:59:44.719547+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T15:59:44.719547+0000","last_undegraded":"2023-12-01T15:59:44.719547+0000","last_fullsized":"2023-12-01T15:59:44.719547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3629","reported_seq":3090,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.506559+0000","last_change":"2023-12-01T15:59:48.506683+0000","last_active":"2023-12-01T15:59:48.506559+0000","last_peered":"2023-12-01T15:59:48.506559+0000","last_clean":"2023-12-01T15:59:48.506559+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:59:48.506559+0000","last_undegraded":"2023-12-01T15:59:48.506559+0000","last_fullsized":"2023-12-01T15:59:48.506559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3629","last_scrub_stamp":"2023-12-01T15:59:48.506533+0000","last_deep_scrub":"44'3629","last_deep_scrub_stamp":"2023-12-01T15:59:48.506533+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.506533+0000","objects_scrubbed":1,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:08:56.880573+0000","scrub_duration":0.046519142999999999,"objects_trimmed":0,"snaptrim_duration":0.13624631700000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"43'1007","reported_seq":1051,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174225+0000","last_change":"2023-12-01T15:43:45.205291+0000","last_active":"2023-12-01T15:59:46.174225+0000","last_peered":"2023-12-01T15:59:46.174225+0000","last_clean":"2023-12-01T15:59:46.174225+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T15:59:46.174225+0000","last_undegraded":"2023-12-01T15:59:46.174225+0000","last_fullsized":"2023-12-01T15:59:46.174225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":10007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"44'3453","reported_seq":2886,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.543603+0000","last_change":"2023-12-01T15:59:49.543735+0000","last_active":"2023-12-01T15:59:49.543603+0000","last_peered":"2023-12-01T15:59:49.543603+0000","last_clean":"2023-12-01T15:59:49.543603+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:59:49.543603+0000","last_undegraded":"2023-12-01T15:59:49.543603+0000","last_fullsized":"2023-12-01T15:59:49.543603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3453","last_scrub_stamp":"2023-12-01T15:59:49.543577+0000","last_deep_scrub":"44'3453","last_deep_scrub_stamp":"2023-12-01T15:59:49.543577+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.543577+0000","objects_scrubbed":2,"log_size":3453,"log_dups_size":0,"ondisk_log_size":3453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:22.774680+0000","scrub_duration":0.045727260999999998,"objects_trimmed":0,"snaptrim_duration":0.13638832000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"42'1384","reported_seq":1428,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174340+0000","last_change":"2023-12-01T15:43:45.207762+0000","last_active":"2023-12-01T15:59:46.174340+0000","last_peered":"2023-12-01T15:59:46.174340+0000","last_clean":"2023-12-01T15:59:46.174340+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T15:59:46.174340+0000","last_undegraded":"2023-12-01T15:59:46.174340+0000","last_fullsized":"2023-12-01T15:59:46.174340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1392,"num_write_kb":12529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'1276","reported_seq":1320,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.397695+0000","last_change":"2023-12-01T15:43:45.203999+0000","last_active":"2023-12-01T15:59:43.397695+0000","last_peered":"2023-12-01T15:59:43.397695+0000","last_clean":"2023-12-01T15:59:43.397695+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T15:59:43.397695+0000","last_undegraded":"2023-12-01T15:59:43.397695+0000","last_fullsized":"2023-12-01T15:59:43.397695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1276,"log_dups_size":0,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":12495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'3658","reported_seq":3058,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:53.147914+0000","last_change":"2023-12-01T15:59:53.148041+0000","last_active":"2023-12-01T15:59:53.147914+0000","last_peered":"2023-12-01T15:59:53.147914+0000","last_clean":"2023-12-01T15:59:53.147914+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:59:53.147914+0000","last_undegraded":"2023-12-01T15:59:53.147914+0000","last_fullsized":"2023-12-01T15:59:53.147914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3658","last_scrub_stamp":"2023-12-01T15:59:53.147892+0000","last_deep_scrub":"43'3658","last_deep_scrub_stamp":"2023-12-01T15:59:53.147892+0000","last_clean_scrub_stamp":"2023-12-01T15:59:53.147892+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:26.141896+0000","scrub_duration":0.039317244000000001,"objects_trimmed":0,"snaptrim_duration":0.172903538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"35'1240","reported_seq":1284,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.397681+0000","last_change":"2023-12-01T15:43:45.201303+0000","last_active":"2023-12-01T15:59:43.397681+0000","last_peered":"2023-12-01T15:59:43.397681+0000","last_clean":"2023-12-01T15:59:43.397681+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T15:59:43.397681+0000","last_undegraded":"2023-12-01T15:59:43.397681+0000","last_fullsized":"2023-12-01T15:59:43.397681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1238,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'3445","reported_seq":2884,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:57.046416+0000","last_change":"2023-12-01T15:59:57.046543+0000","last_active":"2023-12-01T15:59:57.046416+0000","last_peered":"2023-12-01T15:59:57.046416+0000","last_clean":"2023-12-01T15:59:57.046416+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:59:57.046416+0000","last_undegraded":"2023-12-01T15:59:57.046416+0000","last_fullsized":"2023-12-01T15:59:57.046416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3445","last_scrub_stamp":"2023-12-01T15:59:57.046388+0000","last_deep_scrub":"44'3445","last_deep_scrub_stamp":"2023-12-01T15:59:57.046388+0000","last_clean_scrub_stamp":"2023-12-01T15:59:57.046388+0000","objects_scrubbed":3,"log_size":3445,"log_dups_size":0,"ondisk_log_size":3445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:06:40.083816+0000","scrub_duration":0.046119563000000002,"objects_trimmed":0,"snaptrim_duration":0.090755167999999997,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1186,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"39'4742","reported_seq":4786,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479970+0000","last_change":"2023-12-01T15:43:45.207098+0000","last_active":"2023-12-01T15:59:43.479970+0000","last_peered":"2023-12-01T15:59:43.479970+0000","last_clean":"2023-12-01T15:59:43.479970+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T15:59:43.479970+0000","last_undegraded":"2023-12-01T15:59:43.479970+0000","last_fullsized":"2023-12-01T15:59:43.479970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4742,"log_dups_size":0,"ondisk_log_size":4742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4735,"num_write_kb":27522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3360","reported_seq":2796,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.985855+0000","last_change":"2023-12-01T15:59:49.985964+0000","last_active":"2023-12-01T15:59:49.985855+0000","last_peered":"2023-12-01T15:59:49.985855+0000","last_clean":"2023-12-01T15:59:49.985855+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:59:49.985855+0000","last_undegraded":"2023-12-01T15:59:49.985855+0000","last_fullsized":"2023-12-01T15:59:49.985855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3360","last_scrub_stamp":"2023-12-01T15:59:49.985801+0000","last_deep_scrub":"44'3360","last_deep_scrub_stamp":"2023-12-01T15:59:49.985801+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.985801+0000","objects_scrubbed":1,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:22:12.421111+0000","scrub_duration":0.040212074,"objects_trimmed":0,"snaptrim_duration":0.090274558000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'1988","reported_seq":2032,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478455+0000","last_change":"2023-12-01T15:43:45.206777+0000","last_active":"2023-12-01T15:59:43.478455+0000","last_peered":"2023-12-01T15:59:43.478455+0000","last_clean":"2023-12-01T15:59:43.478455+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T15:59:43.478455+0000","last_undegraded":"2023-12-01T15:59:43.478455+0000","last_fullsized":"2023-12-01T15:59:43.478455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1988,"log_dups_size":0,"ondisk_log_size":1988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1987,"num_write_kb":25538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"44'3405","reported_seq":2910,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:59.668323+0000","last_change":"2023-12-01T15:59:59.668525+0000","last_active":"2023-12-01T15:59:59.668323+0000","last_peered":"2023-12-01T15:59:59.668323+0000","last_clean":"2023-12-01T15:59:59.668323+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:59:59.668323+0000","last_undegraded":"2023-12-01T15:59:59.668323+0000","last_fullsized":"2023-12-01T15:59:59.668323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3405","last_scrub_stamp":"2023-12-01T15:59:59.668279+0000","last_deep_scrub":"44'3405","last_deep_scrub_stamp":"2023-12-01T15:59:59.668279+0000","last_clean_scrub_stamp":"2023-12-01T15:59:59.668279+0000","objects_scrubbed":2,"log_size":3405,"log_dups_size":0,"ondisk_log_size":3405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:09.752731+0000","scrub_duration":0.045721932,"objects_trimmed":0,"snaptrim_duration":0.13034463499999999,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1138,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'4352","reported_seq":4407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:04.502682+0000","last_change":"2023-12-01T16:00:04.502810+0000","last_active":"2023-12-01T16:00:04.502682+0000","last_peered":"2023-12-01T16:00:04.502682+0000","last_clean":"2023-12-01T16:00:04.502682+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T16:00:04.502682+0000","last_undegraded":"2023-12-01T16:00:04.502682+0000","last_fullsized":"2023-12-01T16:00:04.502682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4352","last_scrub_stamp":"2023-12-01T16:00:04.502658+0000","last_deep_scrub":"44'4352","last_deep_scrub_stamp":"2023-12-01T16:00:04.502658+0000","last_clean_scrub_stamp":"2023-12-01T16:00:04.502658+0000","objects_scrubbed":4,"log_size":4352,"log_dups_size":0,"ondisk_log_size":4352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:37.496662+0000","scrub_duration":0.054000375000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4337,"num_write_kb":30065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1415,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"43'3797","reported_seq":3179,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478167+0000","last_change":"2023-12-01T15:59:36.966407+0000","last_active":"2023-12-01T15:59:43.478167+0000","last_peered":"2023-12-01T15:59:43.478167+0000","last_clean":"2023-12-01T15:59:43.478167+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T15:59:43.478167+0000","last_undegraded":"2023-12-01T15:59:43.478167+0000","last_fullsized":"2023-12-01T15:59:43.478167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.165714477,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"41'2491","reported_seq":2535,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478592+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:59:43.478592+0000","last_peered":"2023-12-01T15:59:43.478592+0000","last_clean":"2023-12-01T15:59:43.478592+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:59:43.478592+0000","last_undegraded":"2023-12-01T15:59:43.478592+0000","last_fullsized":"2023-12-01T15:59:43.478592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2491,"log_dups_size":0,"ondisk_log_size":2491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2494,"num_write_kb":26915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'3462","reported_seq":2932,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479262+0000","last_change":"2023-12-01T15:59:36.980979+0000","last_active":"2023-12-01T15:59:43.479262+0000","last_peered":"2023-12-01T15:59:43.479262+0000","last_clean":"2023-12-01T15:59:43.479262+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:59:43.479262+0000","last_undegraded":"2023-12-01T15:59:43.479262+0000","last_fullsized":"2023-12-01T15:59:43.479262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15615646,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1160,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'2352","reported_seq":2396,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477548+0000","last_change":"2023-12-01T15:43:45.206261+0000","last_active":"2023-12-01T15:59:43.477548+0000","last_peered":"2023-12-01T15:59:43.477548+0000","last_clean":"2023-12-01T15:59:43.477548+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T15:59:43.477548+0000","last_undegraded":"2023-12-01T15:59:43.477548+0000","last_fullsized":"2023-12-01T15:59:43.477548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2354,"num_write_kb":17078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'3597","reported_seq":2983,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.397327+0000","last_change":"2023-12-01T15:59:36.901256+0000","last_active":"2023-12-01T15:59:43.397327+0000","last_peered":"2023-12-01T15:59:43.397327+0000","last_clean":"2023-12-01T15:59:43.397327+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T15:59:43.397327+0000","last_undegraded":"2023-12-01T15:59:43.397327+0000","last_fullsized":"2023-12-01T15:59:43.397327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086977656,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"36'1538","reported_seq":1582,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.393123+0000","last_change":"2023-12-01T15:43:45.200481+0000","last_active":"2023-12-01T15:59:43.393123+0000","last_peered":"2023-12-01T15:59:43.393123+0000","last_clean":"2023-12-01T15:59:43.393123+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T15:59:43.393123+0000","last_undegraded":"2023-12-01T15:59:43.393123+0000","last_fullsized":"2023-12-01T15:59:43.393123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1538,"log_dups_size":0,"ondisk_log_size":1538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1538,"num_write_kb":10132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3475","reported_seq":2915,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:55.340040+0000","last_change":"2023-12-01T15:59:55.340335+0000","last_active":"2023-12-01T15:59:55.340040+0000","last_peered":"2023-12-01T15:59:55.340040+0000","last_clean":"2023-12-01T15:59:55.340040+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:59:55.340040+0000","last_undegraded":"2023-12-01T15:59:55.340040+0000","last_fullsized":"2023-12-01T15:59:55.340040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3475","last_scrub_stamp":"2023-12-01T15:59:55.339969+0000","last_deep_scrub":"43'3475","last_deep_scrub_stamp":"2023-12-01T15:59:55.339969+0000","last_clean_scrub_stamp":"2023-12-01T15:59:55.339969+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:16.716385+0000","scrub_duration":0.037072088000000003,"objects_trimmed":0,"snaptrim_duration":0.64740572200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":201,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.485338+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:59:44.485338+0000","last_peered":"2023-12-01T15:59:44.485338+0000","last_clean":"2023-12-01T15:59:44.485338+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:59:44.485338+0000","last_undegraded":"2023-12-01T15:59:44.485338+0000","last_fullsized":"2023-12-01T15:59:44.485338+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477661+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:59:43.477661+0000","last_peered":"2023-12-01T15:59:43.477661+0000","last_clean":"2023-12-01T15:59:43.477661+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:59:43.477661+0000","last_undegraded":"2023-12-01T15:59:43.477661+0000","last_fullsized":"2023-12-01T15:59:43.477661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"39'4414","reported_seq":4458,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394907+0000","last_change":"2023-12-01T15:43:45.201766+0000","last_active":"2023-12-01T15:59:43.394907+0000","last_peered":"2023-12-01T15:59:43.394907+0000","last_clean":"2023-12-01T15:59:43.394907+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T15:59:43.394907+0000","last_undegraded":"2023-12-01T15:59:43.394907+0000","last_fullsized":"2023-12-01T15:59:43.394907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4414,"log_dups_size":0,"ondisk_log_size":4414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4406,"num_write_kb":30219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"43'3657","reported_seq":3070,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480688+0000","last_change":"2023-12-01T15:59:36.978939+0000","last_active":"2023-12-01T15:59:43.480688+0000","last_peered":"2023-12-01T15:59:43.480688+0000","last_clean":"2023-12-01T15:59:43.480688+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:59:43.480688+0000","last_undegraded":"2023-12-01T15:59:43.480688+0000","last_fullsized":"2023-12-01T15:59:43.480688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3657,"log_dups_size":0,"ondisk_log_size":3657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.144833777,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174011+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:59:46.174011+0000","last_peered":"2023-12-01T15:59:46.174011+0000","last_clean":"2023-12-01T15:59:46.174011+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:59:46.174011+0000","last_undegraded":"2023-12-01T15:59:46.174011+0000","last_fullsized":"2023-12-01T15:59:46.174011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'2295","reported_seq":2539,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477700+0000","last_change":"2023-12-01T15:43:45.209138+0000","last_active":"2023-12-01T15:59:43.477700+0000","last_peered":"2023-12-01T15:59:43.477700+0000","last_clean":"2023-12-01T15:59:43.477700+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T15:59:43.477700+0000","last_undegraded":"2023-12-01T15:59:43.477700+0000","last_fullsized":"2023-12-01T15:59:43.477700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3359983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":3419,"num_write":2296,"num_write_kb":16044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'3370","reported_seq":2811,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479724+0000","last_change":"2023-12-01T15:59:36.960605+0000","last_active":"2023-12-01T15:59:43.479724+0000","last_peered":"2023-12-01T15:59:43.479724+0000","last_clean":"2023-12-01T15:59:43.479724+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T15:59:43.479724+0000","last_undegraded":"2023-12-01T15:59:43.479724+0000","last_fullsized":"2023-12-01T15:59:43.479724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3370,"log_dups_size":0,"ondisk_log_size":3370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13848359499999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1137,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394145+0000","last_change":"2023-12-01T15:43:41.043692+0000","last_active":"2023-12-01T15:59:43.394145+0000","last_peered":"2023-12-01T15:59:43.394145+0000","last_clean":"2023-12-01T15:59:43.394145+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T15:59:43.394145+0000","last_undegraded":"2023-12-01T15:59:43.394145+0000","last_fullsized":"2023-12-01T15:59:43.394145+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"42'2706","reported_seq":2751,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.934287+0000","last_change":"2023-12-01T15:43:45.204466+0000","last_active":"2023-12-01T15:59:44.934287+0000","last_peered":"2023-12-01T15:59:44.934287+0000","last_clean":"2023-12-01T15:59:44.934287+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T15:59:44.934287+0000","last_undegraded":"2023-12-01T15:59:44.934287+0000","last_fullsized":"2023-12-01T15:59:44.934287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2706,"log_dups_size":0,"ondisk_log_size":2706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2697,"num_write_kb":25331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3393","reported_seq":2878,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.386317+0000","last_change":"2023-12-01T15:59:49.386477+0000","last_active":"2023-12-01T15:59:49.386317+0000","last_peered":"2023-12-01T15:59:49.386317+0000","last_clean":"2023-12-01T15:59:49.386317+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:59:49.386317+0000","last_undegraded":"2023-12-01T15:59:49.386317+0000","last_fullsized":"2023-12-01T15:59:49.386317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3393","last_scrub_stamp":"2023-12-01T15:59:49.386292+0000","last_deep_scrub":"44'3393","last_deep_scrub_stamp":"2023-12-01T15:59:49.386292+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.386292+0000","objects_scrubbed":3,"log_size":3393,"log_dups_size":0,"ondisk_log_size":3393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:21:35.191687+0000","scrub_duration":0.041281799000000001,"objects_trimmed":0,"snaptrim_duration":0.644502672,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1119,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478773+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:59:43.478773+0000","last_peered":"2023-12-01T15:59:43.478773+0000","last_clean":"2023-12-01T15:59:43.478773+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:59:43.478773+0000","last_undegraded":"2023-12-01T15:59:43.478773+0000","last_fullsized":"2023-12-01T15:59:43.478773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"42'3556","reported_seq":3600,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395984+0000","last_change":"2023-12-01T15:43:45.207506+0000","last_active":"2023-12-01T15:59:43.395984+0000","last_peered":"2023-12-01T15:59:43.395984+0000","last_clean":"2023-12-01T15:59:43.395984+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T15:59:43.395984+0000","last_undegraded":"2023-12-01T15:59:43.395984+0000","last_fullsized":"2023-12-01T15:59:43.395984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3556,"log_dups_size":0,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3556,"num_write_kb":20852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3573","reported_seq":2976,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:47.437403+0000","last_change":"2023-12-01T15:59:47.437607+0000","last_active":"2023-12-01T15:59:47.437403+0000","last_peered":"2023-12-01T15:59:47.437403+0000","last_clean":"2023-12-01T15:59:47.437403+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:47.437403+0000","last_undegraded":"2023-12-01T15:59:47.437403+0000","last_fullsized":"2023-12-01T15:59:47.437403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3573","last_scrub_stamp":"2023-12-01T15:59:47.437368+0000","last_deep_scrub":"44'3573","last_deep_scrub_stamp":"2023-12-01T15:59:47.437368+0000","last_clean_scrub_stamp":"2023-12-01T15:59:47.437368+0000","objects_scrubbed":1,"log_size":3573,"log_dups_size":0,"ondisk_log_size":3573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:45:47.573028+0000","scrub_duration":0.052350225,"objects_trimmed":0,"snaptrim_duration":0.65789627900000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"43'2830","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.397156+0000","last_change":"2023-12-01T15:43:45.210575+0000","last_active":"2023-12-01T15:59:43.397156+0000","last_peered":"2023-12-01T15:59:43.397156+0000","last_clean":"2023-12-01T15:59:43.397156+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T15:59:43.397156+0000","last_undegraded":"2023-12-01T15:59:43.397156+0000","last_fullsized":"2023-12-01T15:59:43.397156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2830,"log_dups_size":0,"ondisk_log_size":2830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2820,"num_write_kb":26865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.396904+0000","last_change":"2023-12-01T15:43:41.044156+0000","last_active":"2023-12-01T15:59:43.396904+0000","last_peered":"2023-12-01T15:59:43.396904+0000","last_clean":"2023-12-01T15:59:43.396904+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T15:59:43.396904+0000","last_undegraded":"2023-12-01T15:59:43.396904+0000","last_fullsized":"2023-12-01T15:59:43.396904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"44'3761","reported_seq":3210,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.423586+0000","last_change":"2023-12-01T15:59:48.423729+0000","last_active":"2023-12-01T15:59:48.423586+0000","last_peered":"2023-12-01T15:59:48.423586+0000","last_clean":"2023-12-01T15:59:48.423586+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:59:48.423586+0000","last_undegraded":"2023-12-01T15:59:48.423586+0000","last_fullsized":"2023-12-01T15:59:48.423586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3761","last_scrub_stamp":"2023-12-01T15:59:48.423554+0000","last_deep_scrub":"44'3761","last_deep_scrub_stamp":"2023-12-01T15:59:48.423554+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.423554+0000","objects_scrubbed":2,"log_size":3761,"log_dups_size":0,"ondisk_log_size":3761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:02.504062+0000","scrub_duration":0.041749799999999997,"objects_trimmed":0,"snaptrim_duration":0.64064258500000004,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"43'723","reported_seq":767,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.396350+0000","last_change":"2023-12-01T15:43:45.200408+0000","last_active":"2023-12-01T15:59:43.396350+0000","last_peered":"2023-12-01T15:59:43.396350+0000","last_clean":"2023-12-01T15:59:43.396350+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T15:59:43.396350+0000","last_undegraded":"2023-12-01T15:59:43.396350+0000","last_fullsized":"2023-12-01T15:59:43.396350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":8308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480912+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:59:43.480912+0000","last_peered":"2023-12-01T15:59:43.480912+0000","last_clean":"2023-12-01T15:59:43.480912+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:59:43.480912+0000","last_undegraded":"2023-12-01T15:59:43.480912+0000","last_fullsized":"2023-12-01T15:59:43.480912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"43'3558","reported_seq":2962,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.481685+0000","last_change":"2023-12-01T15:59:36.962654+0000","last_active":"2023-12-01T15:59:43.481685+0000","last_peered":"2023-12-01T15:59:43.481685+0000","last_clean":"2023-12-01T15:59:43.481685+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T15:59:43.481685+0000","last_undegraded":"2023-12-01T15:59:43.481685+0000","last_fullsized":"2023-12-01T15:59:43.481685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13059393599999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1243,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"36'1637","reported_seq":1681,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395881+0000","last_change":"2023-12-01T15:43:45.203186+0000","last_active":"2023-12-01T15:59:43.395881+0000","last_peered":"2023-12-01T15:59:43.395881+0000","last_clean":"2023-12-01T15:59:43.395881+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T15:59:43.395881+0000","last_undegraded":"2023-12-01T15:59:43.395881+0000","last_fullsized":"2023-12-01T15:59:43.395881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1642,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394684+0000","last_change":"2023-12-01T15:43:41.044507+0000","last_active":"2023-12-01T15:59:43.394684+0000","last_peered":"2023-12-01T15:59:43.394684+0000","last_clean":"2023-12-01T15:59:43.394684+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T15:59:43.394684+0000","last_undegraded":"2023-12-01T15:59:43.394684+0000","last_fullsized":"2023-12-01T15:59:43.394684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'3700","reported_seq":3078,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.659888+0000","last_change":"2023-12-01T15:59:56.660009+0000","last_active":"2023-12-01T15:59:56.659888+0000","last_peered":"2023-12-01T15:59:56.659888+0000","last_clean":"2023-12-01T15:59:56.659888+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:59:56.659888+0000","last_undegraded":"2023-12-01T15:59:56.659888+0000","last_fullsized":"2023-12-01T15:59:56.659888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3700","last_scrub_stamp":"2023-12-01T15:59:56.659861+0000","last_deep_scrub":"44'3700","last_deep_scrub_stamp":"2023-12-01T15:59:56.659861+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.659861+0000","objects_scrubbed":4,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:17.850001+0000","scrub_duration":0.058770831000000003,"objects_trimmed":0,"snaptrim_duration":0.13319146700000001,"stat_sum":{"num_bytes":4118,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'1995","reported_seq":2039,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.719533+0000","last_change":"2023-12-01T15:43:45.205286+0000","last_active":"2023-12-01T15:59:44.719533+0000","last_peered":"2023-12-01T15:59:44.719533+0000","last_clean":"2023-12-01T15:59:44.719533+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T15:59:44.719533+0000","last_undegraded":"2023-12-01T15:59:44.719533+0000","last_fullsized":"2023-12-01T15:59:44.719533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2265,"num_write_kb":16414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480499+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:59:43.480499+0000","last_peered":"2023-12-01T15:59:43.480499+0000","last_clean":"2023-12-01T15:59:43.480499+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:59:43.480499+0000","last_undegraded":"2023-12-01T15:59:43.480499+0000","last_fullsized":"2023-12-01T15:59:43.480499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"43'3405","reported_seq":2819,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394558+0000","last_change":"2023-12-01T15:59:36.902129+0000","last_active":"2023-12-01T15:59:43.394558+0000","last_peered":"2023-12-01T15:59:43.394558+0000","last_clean":"2023-12-01T15:59:43.394558+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T15:59:43.394558+0000","last_undegraded":"2023-12-01T15:59:43.394558+0000","last_fullsized":"2023-12-01T15:59:43.394558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3405,"log_dups_size":0,"ondisk_log_size":3405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.087179219000000002,"stat_sum":{"num_bytes":12302,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"44'3615","reported_seq":3032,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.027009+0000","last_change":"2023-12-01T15:59:49.027191+0000","last_active":"2023-12-01T15:59:49.027009+0000","last_peered":"2023-12-01T15:59:49.027009+0000","last_clean":"2023-12-01T15:59:49.027009+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:59:49.027009+0000","last_undegraded":"2023-12-01T15:59:49.027009+0000","last_fullsized":"2023-12-01T15:59:49.027009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3615","last_scrub_stamp":"2023-12-01T15:59:49.026983+0000","last_deep_scrub":"44'3615","last_deep_scrub_stamp":"2023-12-01T15:59:49.026983+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.026983+0000","objects_scrubbed":2,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:03.107490+0000","scrub_duration":0.046925306,"objects_trimmed":0,"snaptrim_duration":0.084182759999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'3712","reported_seq":3755,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174398+0000","last_change":"2023-12-01T15:43:45.208015+0000","last_active":"2023-12-01T15:59:46.174398+0000","last_peered":"2023-12-01T15:59:46.174398+0000","last_clean":"2023-12-01T15:59:46.174398+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T15:59:46.174398+0000","last_undegraded":"2023-12-01T15:59:46.174398+0000","last_fullsized":"2023-12-01T15:59:46.174398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3712,"log_dups_size":0,"ondisk_log_size":3712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3712,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"43'3508","reported_seq":2927,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.393726+0000","last_change":"2023-12-01T15:59:37.439759+0000","last_active":"2023-12-01T15:59:43.393726+0000","last_peered":"2023-12-01T15:59:43.393726+0000","last_clean":"2023-12-01T15:59:43.393726+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T15:59:43.393726+0000","last_undegraded":"2023-12-01T15:59:43.393726+0000","last_fullsized":"2023-12-01T15:59:43.393726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63296622700000005,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"43'2457","reported_seq":2500,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.396501+0000","last_change":"2023-12-01T15:43:45.210538+0000","last_active":"2023-12-01T15:59:43.396501+0000","last_peered":"2023-12-01T15:59:43.396501+0000","last_clean":"2023-12-01T15:59:43.396501+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T15:59:43.396501+0000","last_undegraded":"2023-12-01T15:59:43.396501+0000","last_fullsized":"2023-12-01T15:59:43.396501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2457,"log_dups_size":0,"ondisk_log_size":2457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2453,"num_write_kb":21278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"43'1339","reported_seq":1382,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.397536+0000","last_change":"2023-12-01T15:43:45.204325+0000","last_active":"2023-12-01T15:59:43.397536+0000","last_peered":"2023-12-01T15:59:43.397536+0000","last_clean":"2023-12-01T15:59:43.397536+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T15:59:43.397536+0000","last_undegraded":"2023-12-01T15:59:43.397536+0000","last_fullsized":"2023-12-01T15:59:43.397536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1339,"log_dups_size":0,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1338,"num_write_kb":26066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'3641","reported_seq":3004,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477667+0000","last_change":"2023-12-01T15:59:36.952311+0000","last_active":"2023-12-01T15:59:43.477667+0000","last_peered":"2023-12-01T15:59:43.477667+0000","last_clean":"2023-12-01T15:59:43.477667+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T15:59:43.477667+0000","last_undegraded":"2023-12-01T15:59:43.477667+0000","last_fullsized":"2023-12-01T15:59:43.477667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13235097200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"43'900","reported_seq":943,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.481192+0000","last_change":"2023-12-01T15:43:45.203624+0000","last_active":"2023-12-01T15:59:43.481192+0000","last_peered":"2023-12-01T15:59:43.481192+0000","last_clean":"2023-12-01T15:59:43.481192+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T15:59:43.481192+0000","last_undegraded":"2023-12-01T15:59:43.481192+0000","last_fullsized":"2023-12-01T15:59:43.481192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3459","reported_seq":2881,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:50.436980+0000","last_change":"2023-12-01T15:59:50.437138+0000","last_active":"2023-12-01T15:59:50.436980+0000","last_peered":"2023-12-01T15:59:50.436980+0000","last_clean":"2023-12-01T15:59:50.436980+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:59:50.436980+0000","last_undegraded":"2023-12-01T15:59:50.436980+0000","last_fullsized":"2023-12-01T15:59:50.436980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3459","last_scrub_stamp":"2023-12-01T15:59:50.436956+0000","last_deep_scrub":"44'3459","last_deep_scrub_stamp":"2023-12-01T15:59:50.436956+0000","last_clean_scrub_stamp":"2023-12-01T15:59:50.436956+0000","objects_scrubbed":1,"log_size":3459,"log_dups_size":0,"ondisk_log_size":3459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:48:17.314373+0000","scrub_duration":0.047609585000000003,"objects_trimmed":0,"snaptrim_duration":0.59367497300000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1187,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"43'3413","reported_seq":2909,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480194+0000","last_change":"2023-12-01T15:59:36.971349+0000","last_active":"2023-12-01T15:59:43.480194+0000","last_peered":"2023-12-01T15:59:43.480194+0000","last_clean":"2023-12-01T15:59:43.480194+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:59:43.480194+0000","last_undegraded":"2023-12-01T15:59:43.480194+0000","last_fullsized":"2023-12-01T15:59:43.480194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17121966999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4978","reported_seq":5032,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.423566+0000","last_change":"2023-12-01T15:59:54.423763+0000","last_active":"2023-12-01T15:59:54.423566+0000","last_peered":"2023-12-01T15:59:54.423566+0000","last_clean":"2023-12-01T15:59:54.423566+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:59:54.423566+0000","last_undegraded":"2023-12-01T15:59:54.423566+0000","last_fullsized":"2023-12-01T15:59:54.423566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4978","last_scrub_stamp":"2023-12-01T15:59:54.423526+0000","last_deep_scrub":"44'4978","last_deep_scrub_stamp":"2023-12-01T15:59:54.423526+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.423526+0000","objects_scrubbed":5,"log_size":4978,"log_dups_size":0,"ondisk_log_size":4978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:49:35.988154+0000","scrub_duration":0.094740874000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4962,"num_write_kb":39191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670128,"num_omap_keys":1336,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3226","reported_seq":2697,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.720004+0000","last_change":"2023-12-01T15:59:36.959488+0000","last_active":"2023-12-01T15:59:44.720004+0000","last_peered":"2023-12-01T15:59:44.720004+0000","last_clean":"2023-12-01T15:59:44.720004+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T15:59:44.720004+0000","last_undegraded":"2023-12-01T15:59:44.720004+0000","last_fullsized":"2023-12-01T15:59:44.720004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3226,"log_dups_size":0,"ondisk_log_size":3226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13751970099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'493","reported_seq":547,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.331077+0000","last_change":"2023-12-01T15:59:56.331348+0000","last_active":"2023-12-01T15:59:56.331077+0000","last_peered":"2023-12-01T15:59:56.331077+0000","last_clean":"2023-12-01T15:59:56.331077+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:59:56.331077+0000","last_undegraded":"2023-12-01T15:59:56.331077+0000","last_fullsized":"2023-12-01T15:59:56.331077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'493","last_scrub_stamp":"2023-12-01T15:59:56.331006+0000","last_deep_scrub":"44'493","last_deep_scrub_stamp":"2023-12-01T15:59:56.331006+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.331006+0000","objects_scrubbed":3,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:06:39.368433+0000","scrub_duration":0.040743746999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":17875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'3423","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:47.535135+0000","last_change":"2023-12-01T15:59:47.535337+0000","last_active":"2023-12-01T15:59:47.535135+0000","last_peered":"2023-12-01T15:59:47.535135+0000","last_clean":"2023-12-01T15:59:47.535135+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:59:47.535135+0000","last_undegraded":"2023-12-01T15:59:47.535135+0000","last_fullsized":"2023-12-01T15:59:47.535135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3423","last_scrub_stamp":"2023-12-01T15:59:47.535105+0000","last_deep_scrub":"44'3423","last_deep_scrub_stamp":"2023-12-01T15:59:47.535105+0000","last_clean_scrub_stamp":"2023-12-01T15:59:47.535105+0000","objects_scrubbed":2,"log_size":3423,"log_dups_size":0,"ondisk_log_size":3423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:08.911521+0000","scrub_duration":0.045260416999999997,"objects_trimmed":0,"snaptrim_duration":0.134588554,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"44'3618","reported_seq":3672,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:59.010548+0000","last_change":"2023-12-01T15:59:59.010802+0000","last_active":"2023-12-01T15:59:59.010548+0000","last_peered":"2023-12-01T15:59:59.010548+0000","last_clean":"2023-12-01T15:59:59.010548+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:59:59.010548+0000","last_undegraded":"2023-12-01T15:59:59.010548+0000","last_fullsized":"2023-12-01T15:59:59.010548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3618","last_scrub_stamp":"2023-12-01T15:59:59.010494+0000","last_deep_scrub":"44'3618","last_deep_scrub_stamp":"2023-12-01T15:59:59.010494+0000","last_clean_scrub_stamp":"2023-12-01T15:59:59.010494+0000","objects_scrubbed":2,"log_size":3618,"log_dups_size":0,"ondisk_log_size":3618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:32.241596+0000","scrub_duration":0.048349939000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3601,"num_write_kb":33849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"43'3891","reported_seq":3217,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395972+0000","last_change":"2023-12-01T15:59:37.485420+0000","last_active":"2023-12-01T15:59:43.395972+0000","last_peered":"2023-12-01T15:59:43.395972+0000","last_clean":"2023-12-01T15:59:43.395972+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T15:59:43.395972+0000","last_undegraded":"2023-12-01T15:59:43.395972+0000","last_fullsized":"2023-12-01T15:59:43.395972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3891,"log_dups_size":0,"ondisk_log_size":3891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65050901000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"40'2098","reported_seq":2141,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.481965+0000","last_change":"2023-12-01T15:43:45.208899+0000","last_active":"2023-12-01T15:59:43.481965+0000","last_peered":"2023-12-01T15:59:43.481965+0000","last_clean":"2023-12-01T15:59:43.481965+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T15:59:43.481965+0000","last_undegraded":"2023-12-01T15:59:43.481965+0000","last_fullsized":"2023-12-01T15:59:43.481965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2089,"num_write_kb":16989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"43'3665","reported_seq":3076,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395665+0000","last_change":"2023-12-01T15:59:36.912047+0000","last_active":"2023-12-01T15:59:43.395665+0000","last_peered":"2023-12-01T15:59:43.395665+0000","last_clean":"2023-12-01T15:59:43.395665+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T15:59:43.395665+0000","last_undegraded":"2023-12-01T15:59:43.395665+0000","last_fullsized":"2023-12-01T15:59:43.395665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.084960400000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1169,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'640","reported_seq":683,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:45.693207+0000","last_change":"2023-12-01T15:43:45.203471+0000","last_active":"2023-12-01T15:59:45.693207+0000","last_peered":"2023-12-01T15:59:45.693207+0000","last_clean":"2023-12-01T15:59:45.693207+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T15:59:45.693207+0000","last_undegraded":"2023-12-01T15:59:45.693207+0000","last_fullsized":"2023-12-01T15:59:45.693207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1891144,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":643,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"43'3570","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:51.023765+0000","last_change":"2023-12-01T15:59:51.023871+0000","last_active":"2023-12-01T15:59:51.023765+0000","last_peered":"2023-12-01T15:59:51.023765+0000","last_clean":"2023-12-01T15:59:51.023765+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:59:51.023765+0000","last_undegraded":"2023-12-01T15:59:51.023765+0000","last_fullsized":"2023-12-01T15:59:51.023765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3570","last_scrub_stamp":"2023-12-01T15:59:51.023745+0000","last_deep_scrub":"43'3570","last_deep_scrub_stamp":"2023-12-01T15:59:51.023745+0000","last_clean_scrub_stamp":"2023-12-01T15:59:51.023745+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:48:17.901162+0000","scrub_duration":0.041221723000000002,"objects_trimmed":0,"snaptrim_duration":0.094045403999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'5943","reported_seq":5997,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:58.274157+0000","last_change":"2023-12-01T15:59:58.274287+0000","last_active":"2023-12-01T15:59:58.274157+0000","last_peered":"2023-12-01T15:59:58.274157+0000","last_clean":"2023-12-01T15:59:58.274157+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:59:58.274157+0000","last_undegraded":"2023-12-01T15:59:58.274157+0000","last_fullsized":"2023-12-01T15:59:58.274157+0000","mapping_epoch":16,"log_start":"21'300","ondisk_log_start":"21'300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'5943","last_scrub_stamp":"2023-12-01T15:59:58.274135+0000","last_deep_scrub":"44'5943","last_deep_scrub_stamp":"2023-12-01T15:59:58.274135+0000","last_clean_scrub_stamp":"2023-12-01T15:59:58.274135+0000","objects_scrubbed":7,"log_size":5643,"log_dups_size":0,"ondisk_log_size":5643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:27:01.882725+0000","scrub_duration":0.087623041999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5940,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1000,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3526","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.595185+0000","last_change":"2023-12-01T15:59:54.595288+0000","last_active":"2023-12-01T15:59:54.595185+0000","last_peered":"2023-12-01T15:59:54.595185+0000","last_clean":"2023-12-01T15:59:54.595185+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:59:54.595185+0000","last_undegraded":"2023-12-01T15:59:54.595185+0000","last_fullsized":"2023-12-01T15:59:54.595185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3526","last_scrub_stamp":"2023-12-01T15:59:54.595164+0000","last_deep_scrub":"44'3526","last_deep_scrub_stamp":"2023-12-01T15:59:54.595164+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.595164+0000","objects_scrubbed":1,"log_size":3526,"log_dups_size":0,"ondisk_log_size":3526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:27.589168+0000","scrub_duration":0.038520889000000003,"objects_trimmed":0,"snaptrim_duration":0.134288985,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"39'3426","reported_seq":3471,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.719726+0000","last_change":"2023-12-01T15:43:45.208256+0000","last_active":"2023-12-01T15:59:44.719726+0000","last_peered":"2023-12-01T15:59:44.719726+0000","last_clean":"2023-12-01T15:59:44.719726+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T15:59:44.719726+0000","last_undegraded":"2023-12-01T15:59:44.719726+0000","last_fullsized":"2023-12-01T15:59:44.719726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3411,"num_write_kb":30086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4050","reported_seq":3342,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.042179+0000","last_change":"2023-12-01T15:59:54.042427+0000","last_active":"2023-12-01T15:59:54.042179+0000","last_peered":"2023-12-01T15:59:54.042179+0000","last_clean":"2023-12-01T15:59:54.042179+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:59:54.042179+0000","last_undegraded":"2023-12-01T15:59:54.042179+0000","last_fullsized":"2023-12-01T15:59:54.042179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4050","last_scrub_stamp":"2023-12-01T15:59:54.042107+0000","last_deep_scrub":"44'4050","last_deep_scrub_stamp":"2023-12-01T15:59:54.042107+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.042107+0000","objects_scrubbed":3,"log_size":4050,"log_dups_size":0,"ondisk_log_size":4050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:49:35.606734+0000","scrub_duration":0.048885451000000003,"objects_trimmed":0,"snaptrim_duration":0.091841191000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"39'1803","reported_seq":1847,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480649+0000","last_change":"2023-12-01T15:43:45.204599+0000","last_active":"2023-12-01T15:59:43.480649+0000","last_peered":"2023-12-01T15:59:43.480649+0000","last_clean":"2023-12-01T15:59:43.480649+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T15:59:43.480649+0000","last_undegraded":"2023-12-01T15:59:43.480649+0000","last_fullsized":"2023-12-01T15:59:43.480649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1803,"log_dups_size":0,"ondisk_log_size":1803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1812,"num_write_kb":15324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":76140,"num_write_kb":40588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225536,"ondisk_log_size":225536,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":277882502,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":223,"num_read_kb":3419,"num_write":76837,"num_write_kb":641165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":672543,"num_omap_keys":1341,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":555827200,"data_stored":555765004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76372,"ondisk_log_size":76372,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705866,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":682768,"kb_used_data":134088,"kb_used_omap":0,"kb_used_meta":548672,"kb_avail":93689072,"statfs":{"total":96636764160,"available":95937609728,"internally_reserved":0,"allocated":137306112,"data_stored":136947550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":561840128},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.68500000000000005,"15min":0.63400000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.1799999999999999,"5min":10.84,"15min":10.84},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.129,"5min":0.88900000000000001,"15min":0.70899999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":11.926,"5min":11.926,"15min":11.926},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.71799999999999997,"15min":0.66800000000000004},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.246},"max":{"1min":0.77200000000000002,"5min":10.807,"15min":10.807},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":3.552,"5min":3.552,"15min":3.552},"last":0.68200000000000005}]},{"osd":2,"last update":"Fri Dec 1 15:59:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.72699999999999998,"15min":0.63},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.8700000000000001,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.68000000000000005,"15min":0.64700000000000002},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.71599999999999997,"5min":10.715999999999999,"15min":10.715999999999999},"last":0.82999999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705867,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":801892,"kb_used_data":157276,"kb_used_omap":0,"kb_used_meta":644608,"kb_avail":93569948,"statfs":{"total":96636764160,"available":95815626752,"internally_reserved":0,"allocated":161050624,"data_stored":160683934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":660078592},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69699999999999995,"15min":0.66300000000000003},"min":{"1min":0.23599999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.83199999999999996,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60699999999999998,"15min":0.64900000000000002},"min":{"1min":0.316,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75800000000000001,"5min":0.91200000000000003,"15min":2.657},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri Dec 1 15:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.69099999999999995,"15min":0.65800000000000003},"min":{"1min":0.26300000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.81799999999999995,"5min":8.0779999999999994,"15min":8.0779999999999994},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.39800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.77300000000000002,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Dec 1 15:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.55800000000000005},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61599999999999999,"5min":2.048,"15min":7.5289999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.70699999999999996,"15min":0.66200000000000003},"min":{"1min":0.29799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.92400000000000004,"5min":8.0370000000000008,"15min":9.8949999999999996},"last":0.84599999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705866,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589244,"kb_used_data":98868,"kb_used_omap":0,"kb_used_meta":490368,"kb_avail":93782596,"statfs":{"total":96636764160,"available":96033378304,"internally_reserved":0,"allocated":101240832,"data_stored":100906009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502136832},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 16:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.504},"min":{"1min":0.192,"5min":0.17399999999999999,"15min":0.17299999999999999},"max":{"1min":0.70899999999999996,"5min":0.749,"15min":8.4589999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.52000000000000002,"15min":0.53600000000000003},"min":{"1min":0.26800000000000002,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":0.65800000000000003,"5min":1.669,"15min":1.7729999999999999},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Dec 1 16:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.76300000000000001,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.625,"15min":0.67500000000000004},"min":{"1min":0.35399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74299999999999999,"5min":2.6640000000000001,"15min":10.914999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Dec 1 16:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.66100000000000003},"min":{"1min":0.33800000000000002,"5min":0.28100000000000003,"15min":0.251},"max":{"1min":0.80400000000000005,"5min":1.641,"15min":1.641},"last":0.622},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70999999999999996,"15min":0.69899999999999995},"min":{"1min":0.52900000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88500000000000001,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.73899999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705866,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814568,"kb_used_data":156000,"kb_used_omap":0,"kb_used_meta":658560,"kb_avail":93557272,"statfs":{"total":96636764160,"available":95802646528,"internally_reserved":0,"allocated":159744000,"data_stored":159387283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":674365440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 16:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.65700000000000003,"5min":1.595,"15min":1.595},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.622},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.92400000000000004,"5min":3.3639999999999999,"15min":30.995000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri Dec 1 16:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.62,"15min":0.72399999999999998},"min":{"1min":0.29799999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.0569999999999999,"5min":1.5069999999999999,"15min":24.504000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65200000000000002,"15min":0.75600000000000001},"min":{"1min":0.32100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0229999999999999,"5min":1.526,"15min":24.524999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Fri Dec 1 16:00:03 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.31,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":10.250999999999999,"5min":10.250999999999999,"15min":31.038},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.194,"5min":0.73999999999999999,"15min":0.72799999999999998},"min":{"1min":0.34399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":10.209,"5min":10.209,"15min":10.209},"last":0.89500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":158564352,"data_stored":158550118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":160464896,"data_stored":160441193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":136134656,"data_stored":136110397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T16:00:06.914 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.914 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.914 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.915 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.915 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.915 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.915 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.915 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.916 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.916 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.916 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.916 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.916 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.916 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.917 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.917 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.917 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.917 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.917 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.918 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.918 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.918 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.918 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.918 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.918 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.919 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.919 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.919 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.919 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.919 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.920 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.920 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.920 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.920 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.920 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.920 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.921 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.921 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.921 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.921 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.921 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.922 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.922 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.922 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-01T15:43:34.700727+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=34, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.922 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.922 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.922 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.923 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.923 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.923 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.923 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.923 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.923 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.924 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.924 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.924 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.924 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.924 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.924 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.925 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.925 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.925 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.925 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.925 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.926 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.926 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.926 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.926 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.926 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.926 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.927 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.927 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.927 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.927 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.927 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.928 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.928 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.928 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:06.928 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-01T16:00:18.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:00:18.439 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:00:18.442 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:00:26.929 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T16:00:27.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.044+0000 7fe19bfff700 1 Processor -- start 2023-12-01T16:00:27.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.044+0000 7fe19bfff700 1 -- start start 2023-12-01T16:00:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.044+0000 7fe19bfff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe19c145d80 0x7fe19c148170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.044+0000 7fe19bfff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19c06f7e0 con 0x7fe19c071600 2023-12-01T16:00:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.044+0000 7fe19bfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19c06f4f0 con 0x7fe19c0719e0 2023-12-01T16:00:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.044+0000 7fe19bfff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19c13f860 con 0x7fe19c145d80 2023-12-01T16:00:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.044+0000 7fe19b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe19c145d80 0x7fe19c148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:27.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.044+0000 7fe19affd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe19c071600 0x7fe19c13ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37892/0 (socket says 172.21.15.63:37892) 2023-12-01T16:00:27.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.044+0000 7fe19b7fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe19c145d80 0x7fe19c148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41490/0 (socket says 172.21.15.63:41490) 2023-12-01T16:00:27.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.044+0000 7fe19affd700 1 -- 172.21.15.63:0/3212979352 learned_addr learned my addr 172.21.15.63:0/3212979352 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T16:00:27.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19b7fe700 1 -- 172.21.15.63:0/3212979352 >> v1:172.21.15.66:6789/0 conn(0x7fe19c0719e0 legacy=0x7fe19c13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:27.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19b7fe700 1 -- 172.21.15.63:0/3212979352 >> v1:172.21.15.63:6789/0 conn(0x7fe19c071600 legacy=0x7fe19c13ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:27.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe199ffb700 1 -- 172.21.15.63:0/3212979352 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818358065 0 0) 0x7fe19c06f7e0 con 0x7fe19c071600 2023-12-01T16:00:27.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19b7fe700 1 -- 172.21.15.63:0/3212979352 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c06e770 con 0x7fe19c145d80 2023-12-01T16:00:27.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19b7fe700 1 --2- 172.21.15.63:0/3212979352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19c145d80 0x7fe19c148170 secure :-1 s=READY pgs=2958 cs=0 l=1 rev1=1 crypto rx=0x7fe194009850 tx=0x7fe194009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee35a9885153f09 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:00:27.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe199ffb700 1 -- 172.21.15.63:0/3212979352 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194011830 con 0x7fe19c145d80 2023-12-01T16:00:27.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe199ffb700 1 -- 172.21.15.63:0/3212979352 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe194011990 con 0x7fe19c145d80 2023-12-01T16:00:27.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe199ffb700 1 -- 172.21.15.63:0/3212979352 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194011d20 con 0x7fe19c145d80 2023-12-01T16:00:27.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19bfff700 1 -- 172.21.15.63:0/3212979352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19c145d80 msgr2=0x7fe19c148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:27.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19bfff700 1 --2- 172.21.15.63:0/3212979352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19c145d80 0x7fe19c148170 secure :-1 s=READY pgs=2958 cs=0 l=1 rev1=1 crypto rx=0x7fe194009850 tx=0x7fe194009b60 comp rx=0 tx=0).stop 2023-12-01T16:00:27.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19bfff700 1 -- 172.21.15.63:0/3212979352 shutdown_connections 2023-12-01T16:00:27.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19bfff700 1 --2- 172.21.15.63:0/3212979352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19c145d80 0x7fe19c148170 unknown :-1 s=CLOSED pgs=2958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:27.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19bfff700 1 -- 172.21.15.63:0/3212979352 >> 172.21.15.63:0/3212979352 conn(0x7fe19c0a8bd0 msgr2=0x7fe19c098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:00:27.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19bfff700 1 -- 172.21.15.63:0/3212979352 shutdown_connections 2023-12-01T16:00:27.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19bfff700 1 -- 172.21.15.63:0/3212979352 wait complete. 2023-12-01T16:00:27.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19bfff700 1 Processor -- start 2023-12-01T16:00:27.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.048+0000 7fe19bfff700 1 -- start start 2023-12-01T16:00:27.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe19c071600 0x7fe19c09c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:27.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19c0719e0 0x7fe19c1d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:27.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19c145d80 0x7fe19c1d4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:27.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19bfff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c143680 con 0x7fe19c145d80 2023-12-01T16:00:27.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c09c700 con 0x7fe19c071600 2023-12-01T16:00:27.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c1d39a0 con 0x7fe19c0719e0 2023-12-01T16:00:27.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19c145d80 0x7fe19c1d4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:27.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19c145d80 0x7fe19c1d4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41506/0 (socket says 172.21.15.63:41506) 2023-12-01T16:00:27.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19a7fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19c0719e0 0x7fe19c1d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:27.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19affd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe19c071600 0x7fe19c09c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:27.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19b7fe700 1 -- 172.21.15.63:0/3068982846 learned_addr learned my addr 172.21.15.63:0/3068982846 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:00:27.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19b7fe700 1 -- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19c0719e0 msgr2=0x7fe19c1d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:27.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19b7fe700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19c0719e0 0x7fe19c1d3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:27.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19b7fe700 1 -- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe19c071600 msgr2=0x7fe19c09c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:27.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19b7fe700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe19c071600 0x7fe19c09c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:27.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19b7fe700 1 -- 172.21.15.63:0/3068982846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1940094b0 con 0x7fe19c145d80 2023-12-01T16:00:27.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19b7fe700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19c145d80 0x7fe19c1d4160 secure :-1 s=READY pgs=2959 cs=0 l=1 rev1=1 crypto rx=0x7fe1940090b0 tx=0x7fe194004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:00:27.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe1837fe700 1 -- 172.21.15.63:0/3068982846 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194004400 con 0x7fe19c145d80 2023-12-01T16:00:27.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe1837fe700 1 -- 172.21.15.63:0/3068982846 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19401f070 con 0x7fe19c145d80 2023-12-01T16:00:27.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe1837fe700 1 -- 172.21.15.63:0/3068982846 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1940036c0 con 0x7fe19c145d80 2023-12-01T16:00:27.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19bfff700 1 -- 172.21.15.63:0/3068982846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19c1459a0 con 0x7fe19c145d80 2023-12-01T16:00:27.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.052+0000 7fe19bfff700 1 -- 172.21.15.63:0/3068982846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19c1443b0 con 0x7fe19c145d80 2023-12-01T16:00:27.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.056+0000 7fe19bfff700 1 -- 172.21.15.63:0/3068982846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19c065fb0 con 0x7fe19c145d80 2023-12-01T16:00:27.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.056+0000 7fe1837fe700 1 -- 172.21.15.63:0/3068982846 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe194021030 con 0x7fe19c145d80 2023-12-01T16:00:27.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.056+0000 7fe1837fe700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe188065ad0 0x7fe188067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:27.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.056+0000 7fe1837fe700 1 -- 172.21.15.63:0/3068982846 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7fe1940840b0 con 0x7fe19c145d80 2023-12-01T16:00:27.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.056+0000 7fe19affd700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe188065ad0 0x7fe188067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:27.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.056+0000 7fe19affd700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe188065ad0 0x7fe188067f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe190000f60 tx=0x7fe190007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:00:27.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.064+0000 7fe1837fe700 1 -- 172.21.15.63:0/3068982846 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe194051f00 con 0x7fe19c145d80 2023-12-01T16:00:27.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.228+0000 7fe19bfff700 1 -- 172.21.15.63:0/3068982846 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe19c0711b0 con 0x7fe188065ad0 2023-12-01T16:00:27.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.240+0000 7fe1837fe700 1 -- 172.21.15.63:0/3068982846 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279299 (secure 0 0 0) 0x7fe1900012b0 con 0x7fe188065ad0 2023-12-01T16:00:27.257 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T16:00:27.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 -- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe188065ad0 msgr2=0x7fe188067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe188065ad0 0x7fe188067f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe190000f60 tx=0x7fe190007e90 comp rx=0 tx=0).stop 2023-12-01T16:00:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 -- 172.21.15.63:0/3068982846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19c145d80 msgr2=0x7fe19c1d4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19c145d80 0x7fe19c1d4160 secure :-1 s=READY pgs=2959 cs=0 l=1 rev1=1 crypto rx=0x7fe1940090b0 tx=0x7fe194004770 comp rx=0 tx=0).stop 2023-12-01T16:00:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 -- 172.21.15.63:0/3068982846 shutdown_connections 2023-12-01T16:00:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fe188065ad0 0x7fe188067f90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19c0719e0 0x7fe19c1d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:27.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19c145d80 0x7fe19c1d4160 unknown :-1 s=CLOSED pgs=2959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:27.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 --2- 172.21.15.63:0/3068982846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe19c071600 0x7fe19c09c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:27.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 -- 172.21.15.63:0/3068982846 >> 172.21.15.63:0/3068982846 conn(0x7fe19c0a8bd0 msgr2=0x7fe19c13beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:00:27.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 -- 172.21.15.63:0/3068982846 shutdown_connections 2023-12-01T16:00:27.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:27.248+0000 7fe19bfff700 1 -- 172.21.15.63:0/3068982846 wait complete. 2023-12-01T16:00:27.261 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T16:00:27.272 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":547,"stamp":"2023-12-01T16:00:26.717122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":278600058,"num_objects":242,"num_object_clones":28,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":15,"num_read":370,"num_read_kb":3540,"num_write":153136,"num_write_kb":684169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278539,"num_omap_keys":10516,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302106,"ondisk_log_size":302106,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":2888472,"kb_used_data":546232,"kb_used_omap":0,"kb_used_meta":2342208,"kb_avail":374598888,"statfs":{"total":386547056640,"available":383589261312,"internally_reserved":0,"allocated":559341568,"data_stored":557924776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2398420992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1340305,"num_omap_keys":2669,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004344"},"pg_stats":[{"pgid":"4.3f","version":"43'3303","reported_seq":2799,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480994+0000","last_change":"2023-12-01T15:59:36.960583+0000","last_active":"2023-12-01T15:59:43.480994+0000","last_peered":"2023-12-01T15:59:43.480994+0000","last_clean":"2023-12-01T15:59:43.480994+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:59:43.480994+0000","last_undegraded":"2023-12-01T15:59:43.480994+0000","last_fullsized":"2023-12-01T15:59:43.480994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13670799,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"43'3496","reported_seq":2956,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.397472+0000","last_change":"2023-12-01T15:59:36.899161+0000","last_active":"2023-12-01T15:59:43.397472+0000","last_peered":"2023-12-01T15:59:43.397472+0000","last_clean":"2023-12-01T15:59:43.397472+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T15:59:43.397472+0000","last_undegraded":"2023-12-01T15:59:43.397472+0000","last_fullsized":"2023-12-01T15:59:43.397472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.085048589999999993,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'3434","reported_seq":2897,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478931+0000","last_change":"2023-12-01T15:59:36.980200+0000","last_active":"2023-12-01T15:59:43.478931+0000","last_peered":"2023-12-01T15:59:43.478931+0000","last_clean":"2023-12-01T15:59:43.478931+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:59:43.478931+0000","last_undegraded":"2023-12-01T15:59:43.478931+0000","last_fullsized":"2023-12-01T15:59:43.478931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15483981599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"44'3688","reported_seq":3053,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.948071+0000","last_change":"2023-12-01T15:59:46.948071+0000","last_active":"2023-12-01T15:59:46.948071+0000","last_peered":"2023-12-01T15:59:46.948071+0000","last_clean":"2023-12-01T15:59:46.948071+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:59:46.948071+0000","last_undegraded":"2023-12-01T15:59:46.948071+0000","last_fullsized":"2023-12-01T15:59:46.948071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3688","last_scrub_stamp":"2023-12-01T15:59:46.947938+0000","last_deep_scrub":"44'3688","last_deep_scrub_stamp":"2023-12-01T15:59:46.947938+0000","last_clean_scrub_stamp":"2023-12-01T15:59:46.947938+0000","objects_scrubbed":1,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:14:57.265242+0000","scrub_duration":0.050574905000000003,"objects_trimmed":0,"snaptrim_duration":0.086572531999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"43'3485","reported_seq":2918,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.481658+0000","last_change":"2023-12-01T15:59:36.962909+0000","last_active":"2023-12-01T15:59:43.481658+0000","last_peered":"2023-12-01T15:59:43.481658+0000","last_clean":"2023-12-01T15:59:43.481658+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T15:59:43.481658+0000","last_undegraded":"2023-12-01T15:59:43.481658+0000","last_fullsized":"2023-12-01T15:59:43.481658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13014335599999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'3421","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:10.244937+0000","last_change":"2023-12-01T16:00:10.245065+0000","last_active":"2023-12-01T16:00:10.244937+0000","last_peered":"2023-12-01T16:00:10.244937+0000","last_clean":"2023-12-01T16:00:10.244937+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T16:00:10.244937+0000","last_undegraded":"2023-12-01T16:00:10.244937+0000","last_fullsized":"2023-12-01T16:00:10.244937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3421","last_scrub_stamp":"2023-12-01T16:00:10.244912+0000","last_deep_scrub":"44'3421","last_deep_scrub_stamp":"2023-12-01T16:00:10.244912+0000","last_clean_scrub_stamp":"2023-12-01T16:00:10.244912+0000","objects_scrubbed":2,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:05.632092+0000","scrub_duration":0.052734889,"objects_trimmed":0,"snaptrim_duration":0.133828119,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'3764","reported_seq":3219,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477306+0000","last_change":"2023-12-01T15:59:36.977002+0000","last_active":"2023-12-01T15:59:43.477306+0000","last_peered":"2023-12-01T15:59:43.477306+0000","last_clean":"2023-12-01T15:59:43.477306+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T15:59:43.477306+0000","last_undegraded":"2023-12-01T15:59:43.477306+0000","last_fullsized":"2023-12-01T15:59:43.477306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3764,"log_dups_size":0,"ondisk_log_size":3764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16251290900000001,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'3433","reported_seq":2838,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477401+0000","last_change":"2023-12-01T15:59:36.975843+0000","last_active":"2023-12-01T15:59:43.477401+0000","last_peered":"2023-12-01T15:59:43.477401+0000","last_clean":"2023-12-01T15:59:43.477401+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:59:43.477401+0000","last_undegraded":"2023-12-01T15:59:43.477401+0000","last_fullsized":"2023-12-01T15:59:43.477401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3433,"log_dups_size":0,"ondisk_log_size":3433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.173046373,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"43'3524","reported_seq":2943,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479316+0000","last_change":"2023-12-01T15:59:36.960250+0000","last_active":"2023-12-01T15:59:43.479316+0000","last_peered":"2023-12-01T15:59:43.479316+0000","last_clean":"2023-12-01T15:59:43.479316+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:59:43.479316+0000","last_undegraded":"2023-12-01T15:59:43.479316+0000","last_fullsized":"2023-12-01T15:59:43.479316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13648046599999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'3320","reported_seq":2810,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480320+0000","last_change":"2023-12-01T15:59:36.978454+0000","last_active":"2023-12-01T15:59:43.480320+0000","last_peered":"2023-12-01T15:59:43.480320+0000","last_clean":"2023-12-01T15:59:43.480320+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:59:43.480320+0000","last_undegraded":"2023-12-01T15:59:43.480320+0000","last_fullsized":"2023-12-01T15:59:43.480320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.160523057,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"44'3408","reported_seq":2881,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.074279+0000","last_change":"2023-12-01T15:59:56.074578+0000","last_active":"2023-12-01T15:59:56.074279+0000","last_peered":"2023-12-01T15:59:56.074279+0000","last_clean":"2023-12-01T15:59:56.074279+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:59:56.074279+0000","last_undegraded":"2023-12-01T15:59:56.074279+0000","last_fullsized":"2023-12-01T15:59:56.074279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3408","last_scrub_stamp":"2023-12-01T15:59:56.074209+0000","last_deep_scrub":"44'3408","last_deep_scrub_stamp":"2023-12-01T15:59:56.074209+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.074209+0000","objects_scrubbed":1,"log_size":3408,"log_dups_size":0,"ondisk_log_size":3408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:17.450625+0000","scrub_duration":0.044446310000000003,"objects_trimmed":0,"snaptrim_duration":0.080275320999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"43'3529","reported_seq":2903,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395358+0000","last_change":"2023-12-01T15:59:37.474340+0000","last_active":"2023-12-01T15:59:43.395358+0000","last_peered":"2023-12-01T15:59:43.395358+0000","last_clean":"2023-12-01T15:59:43.395358+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T15:59:43.395358+0000","last_undegraded":"2023-12-01T15:59:43.395358+0000","last_fullsized":"2023-12-01T15:59:43.395358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63957533600000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"43'3178","reported_seq":2650,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477526+0000","last_change":"2023-12-01T15:59:36.959529+0000","last_active":"2023-12-01T15:59:43.477526+0000","last_peered":"2023-12-01T15:59:43.477526+0000","last_clean":"2023-12-01T15:59:43.477526+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T15:59:43.477526+0000","last_undegraded":"2023-12-01T15:59:43.477526+0000","last_fullsized":"2023-12-01T15:59:43.477526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3178,"log_dups_size":0,"ondisk_log_size":3178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138334033,"stat_sum":{"num_bytes":12297,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"43'3508","reported_seq":2945,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.031371+0000","last_change":"2023-12-01T16:00:23.031526+0000","last_active":"2023-12-01T16:00:23.031371+0000","last_peered":"2023-12-01T16:00:23.031371+0000","last_clean":"2023-12-01T16:00:23.031371+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T16:00:23.031371+0000","last_undegraded":"2023-12-01T16:00:23.031371+0000","last_fullsized":"2023-12-01T16:00:23.031371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3508","last_scrub_stamp":"2023-12-01T16:00:23.031325+0000","last_deep_scrub":"43'3508","last_deep_scrub_stamp":"2023-12-01T16:00:23.031325+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.031325+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:08.388208+0000","scrub_duration":0.040441997,"objects_trimmed":0,"snaptrim_duration":0.091404182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"43'3600","reported_seq":3009,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:45.693321+0000","last_change":"2023-12-01T15:59:36.901530+0000","last_active":"2023-12-01T15:59:45.693321+0000","last_peered":"2023-12-01T15:59:45.693321+0000","last_clean":"2023-12-01T15:59:45.693321+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:45.693321+0000","last_undegraded":"2023-12-01T15:59:45.693321+0000","last_fullsized":"2023-12-01T15:59:45.693321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086861997999999996,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1247,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"43'3533","reported_seq":2944,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174815+0000","last_change":"2023-12-01T15:59:36.976205+0000","last_active":"2023-12-01T15:59:46.174815+0000","last_peered":"2023-12-01T15:59:46.174815+0000","last_clean":"2023-12-01T15:59:46.174815+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T15:59:46.174815+0000","last_undegraded":"2023-12-01T15:59:46.174815+0000","last_fullsized":"2023-12-01T15:59:46.174815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3533,"log_dups_size":0,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17327173600000001,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"43'3588","reported_seq":2966,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.719907+0000","last_change":"2023-12-01T15:59:36.959847+0000","last_active":"2023-12-01T15:59:44.719907+0000","last_peered":"2023-12-01T15:59:44.719907+0000","last_clean":"2023-12-01T15:59:44.719907+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T15:59:44.719907+0000","last_undegraded":"2023-12-01T15:59:44.719907+0000","last_fullsized":"2023-12-01T15:59:44.719907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13630616600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'3287","reported_seq":2802,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:20.266022+0000","last_change":"2023-12-01T16:00:20.266155+0000","last_active":"2023-12-01T16:00:20.266022+0000","last_peered":"2023-12-01T16:00:20.266022+0000","last_clean":"2023-12-01T16:00:20.266022+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T16:00:20.266022+0000","last_undegraded":"2023-12-01T16:00:20.266022+0000","last_fullsized":"2023-12-01T16:00:20.266022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3287","last_scrub_stamp":"2023-12-01T16:00:20.265995+0000","last_deep_scrub":"44'3287","last_deep_scrub_stamp":"2023-12-01T16:00:20.265995+0000","last_clean_scrub_stamp":"2023-12-01T16:00:20.265995+0000","objects_scrubbed":5,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:05.049698+0000","scrub_duration":0.052120284000000003,"objects_trimmed":0,"snaptrim_duration":0.159652814,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1044,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"43'3337","reported_seq":2778,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478741+0000","last_change":"2023-12-01T15:59:36.954938+0000","last_active":"2023-12-01T15:59:43.478741+0000","last_peered":"2023-12-01T15:59:43.478741+0000","last_clean":"2023-12-01T15:59:43.478741+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T15:59:43.478741+0000","last_undegraded":"2023-12-01T15:59:43.478741+0000","last_fullsized":"2023-12-01T15:59:43.478741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134439324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"43'3655","reported_seq":3092,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477915+0000","last_change":"2023-12-01T15:59:36.963898+0000","last_active":"2023-12-01T15:59:43.477915+0000","last_peered":"2023-12-01T15:59:43.477915+0000","last_clean":"2023-12-01T15:59:43.477915+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:59:43.477915+0000","last_undegraded":"2023-12-01T15:59:43.477915+0000","last_fullsized":"2023-12-01T15:59:43.477915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3655,"log_dups_size":0,"ondisk_log_size":3655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16502647100000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"43'3592","reported_seq":3030,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395455+0000","last_change":"2023-12-01T15:59:36.908706+0000","last_active":"2023-12-01T15:59:43.395455+0000","last_peered":"2023-12-01T15:59:43.395455+0000","last_clean":"2023-12-01T15:59:43.395455+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T15:59:43.395455+0000","last_undegraded":"2023-12-01T15:59:43.395455+0000","last_fullsized":"2023-12-01T15:59:43.395455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.082049368999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"43'3494","reported_seq":2868,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477650+0000","last_change":"2023-12-01T15:59:36.954854+0000","last_active":"2023-12-01T15:59:43.477650+0000","last_peered":"2023-12-01T15:59:43.477650+0000","last_clean":"2023-12-01T15:59:43.477650+0000","last_became_active":"2023-12-01T15:44:30.528283+0000","last_became_peered":"2023-12-01T15:44:30.528283+0000","last_unstale":"2023-12-01T15:59:43.477650+0000","last_undegraded":"2023-12-01T15:59:43.477650+0000","last_fullsized":"2023-12-01T15:59:43.477650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3494,"log_dups_size":0,"ondisk_log_size":3494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13495370100000001,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'3466","reported_seq":2924,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.393003+0000","last_change":"2023-12-01T15:59:37.440864+0000","last_active":"2023-12-01T15:59:43.393003+0000","last_peered":"2023-12-01T15:59:43.393003+0000","last_clean":"2023-12-01T15:59:43.393003+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T15:59:43.393003+0000","last_undegraded":"2023-12-01T15:59:43.393003+0000","last_fullsized":"2023-12-01T15:59:43.393003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3466,"log_dups_size":0,"ondisk_log_size":3466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.62816057700000005,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"44'3578","reported_seq":2961,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:55.212242+0000","last_change":"2023-12-01T15:59:55.212383+0000","last_active":"2023-12-01T15:59:55.212242+0000","last_peered":"2023-12-01T15:59:55.212242+0000","last_clean":"2023-12-01T15:59:55.212242+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:59:55.212242+0000","last_undegraded":"2023-12-01T15:59:55.212242+0000","last_fullsized":"2023-12-01T15:59:55.212242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3578","last_scrub_stamp":"2023-12-01T15:59:55.212209+0000","last_deep_scrub":"44'3578","last_deep_scrub_stamp":"2023-12-01T15:59:55.212209+0000","last_clean_scrub_stamp":"2023-12-01T15:59:55.212209+0000","objects_scrubbed":1,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:16.402349+0000","scrub_duration":0.042530062,"objects_trimmed":0,"snaptrim_duration":0.17330785400000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"43'3344","reported_seq":2823,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394984+0000","last_change":"2023-12-01T15:59:37.452527+0000","last_active":"2023-12-01T15:59:43.394984+0000","last_peered":"2023-12-01T15:59:43.394984+0000","last_clean":"2023-12-01T15:59:43.394984+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T15:59:43.394984+0000","last_undegraded":"2023-12-01T15:59:43.394984+0000","last_fullsized":"2023-12-01T15:59:43.394984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63729295699999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'3411","reported_seq":2864,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394752+0000","last_change":"2023-12-01T15:59:37.421961+0000","last_active":"2023-12-01T15:59:43.394752+0000","last_peered":"2023-12-01T15:59:43.394752+0000","last_clean":"2023-12-01T15:59:43.394752+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T15:59:43.394752+0000","last_undegraded":"2023-12-01T15:59:43.394752+0000","last_fullsized":"2023-12-01T15:59:43.394752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3411,"log_dups_size":0,"ondisk_log_size":3411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.611917673,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'3318","reported_seq":2756,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:16.227798+0000","last_change":"2023-12-01T16:00:16.227914+0000","last_active":"2023-12-01T16:00:16.227798+0000","last_peered":"2023-12-01T16:00:16.227798+0000","last_clean":"2023-12-01T16:00:16.227798+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T16:00:16.227798+0000","last_undegraded":"2023-12-01T16:00:16.227798+0000","last_fullsized":"2023-12-01T16:00:16.227798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3318","last_scrub_stamp":"2023-12-01T16:00:16.227776+0000","last_deep_scrub":"44'3318","last_deep_scrub_stamp":"2023-12-01T16:00:16.227776+0000","last_clean_scrub_stamp":"2023-12-01T16:00:16.227776+0000","objects_scrubbed":6,"log_size":3318,"log_dups_size":0,"ondisk_log_size":3318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:57.976090+0000","scrub_duration":0.063500757000000005,"objects_trimmed":0,"snaptrim_duration":0.146734475,"stat_sum":{"num_bytes":4116,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'3312","reported_seq":2773,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.396620+0000","last_change":"2023-12-01T15:59:37.489547+0000","last_active":"2023-12-01T15:59:43.396620+0000","last_peered":"2023-12-01T15:59:43.396620+0000","last_clean":"2023-12-01T15:59:43.396620+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T15:59:43.396620+0000","last_undegraded":"2023-12-01T15:59:43.396620+0000","last_fullsized":"2023-12-01T15:59:43.396620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65414528699999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"43'3662","reported_seq":3039,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478127+0000","last_change":"2023-12-01T15:59:36.959770+0000","last_active":"2023-12-01T15:59:43.478127+0000","last_peered":"2023-12-01T15:59:43.478127+0000","last_clean":"2023-12-01T15:59:43.478127+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T15:59:43.478127+0000","last_undegraded":"2023-12-01T15:59:43.478127+0000","last_fullsized":"2023-12-01T15:59:43.478127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13835824199999999,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"44'3522","reported_seq":3005,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.187646+0000","last_change":"2023-12-01T15:59:48.187910+0000","last_active":"2023-12-01T15:59:48.187646+0000","last_peered":"2023-12-01T15:59:48.187646+0000","last_clean":"2023-12-01T15:59:48.187646+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:59:48.187646+0000","last_undegraded":"2023-12-01T15:59:48.187646+0000","last_fullsized":"2023-12-01T15:59:48.187646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3522","last_scrub_stamp":"2023-12-01T15:59:48.187580+0000","last_deep_scrub":"44'3522","last_deep_scrub_stamp":"2023-12-01T15:59:48.187580+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.187580+0000","objects_scrubbed":2,"log_size":3522,"log_dups_size":0,"ondisk_log_size":3522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:21.418682+0000","scrub_duration":0.049219767999999997,"objects_trimmed":0,"snaptrim_duration":0.13490588100000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"43'3994","reported_seq":3320,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.393101+0000","last_change":"2023-12-01T15:59:37.471324+0000","last_active":"2023-12-01T15:59:43.393101+0000","last_peered":"2023-12-01T15:59:43.393101+0000","last_clean":"2023-12-01T15:59:43.393101+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T15:59:43.393101+0000","last_undegraded":"2023-12-01T15:59:43.393101+0000","last_fullsized":"2023-12-01T15:59:43.393101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3994,"log_dups_size":0,"ondisk_log_size":3994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65412195699999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"43'3592","reported_seq":2995,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394360+0000","last_change":"2023-12-01T15:59:36.911013+0000","last_active":"2023-12-01T15:59:43.394360+0000","last_peered":"2023-12-01T15:59:43.394360+0000","last_clean":"2023-12-01T15:59:43.394360+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T15:59:43.394360+0000","last_undegraded":"2023-12-01T15:59:43.394360+0000","last_fullsized":"2023-12-01T15:59:43.394360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.090414480000000005,"stat_sum":{"num_bytes":4118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"44'3662","reported_seq":3075,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:58.388349+0000","last_change":"2023-12-01T15:59:58.388349+0000","last_active":"2023-12-01T15:59:58.388349+0000","last_peered":"2023-12-01T15:59:58.388349+0000","last_clean":"2023-12-01T15:59:58.388349+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:59:58.388349+0000","last_undegraded":"2023-12-01T15:59:58.388349+0000","last_fullsized":"2023-12-01T15:59:58.388349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3662","last_scrub_stamp":"2023-12-01T15:59:58.388055+0000","last_deep_scrub":"44'3662","last_deep_scrub_stamp":"2023-12-01T15:59:58.388055+0000","last_clean_scrub_stamp":"2023-12-01T15:59:58.388055+0000","objects_scrubbed":1,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:31.619158+0000","scrub_duration":0.048690542000000003,"objects_trimmed":0,"snaptrim_duration":0.646838511,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"39'2734","reported_seq":2778,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174284+0000","last_change":"2023-12-01T15:43:45.205685+0000","last_active":"2023-12-01T15:59:46.174284+0000","last_peered":"2023-12-01T15:59:46.174284+0000","last_clean":"2023-12-01T15:59:46.174284+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T15:59:46.174284+0000","last_undegraded":"2023-12-01T15:59:46.174284+0000","last_fullsized":"2023-12-01T15:59:46.174284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2734,"log_dups_size":0,"ondisk_log_size":2734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2729,"num_write_kb":18350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"43'3426","reported_seq":2845,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479561+0000","last_change":"2023-12-01T15:59:36.979597+0000","last_active":"2023-12-01T15:59:43.479561+0000","last_peered":"2023-12-01T15:59:43.479561+0000","last_clean":"2023-12-01T15:59:43.479561+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:59:43.479561+0000","last_undegraded":"2023-12-01T15:59:43.479561+0000","last_fullsized":"2023-12-01T15:59:43.479561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15458043599999999,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"35'5","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.719547+0000","last_change":"2023-12-01T15:43:45.203521+0000","last_active":"2023-12-01T15:59:44.719547+0000","last_peered":"2023-12-01T15:59:44.719547+0000","last_clean":"2023-12-01T15:59:44.719547+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T15:59:44.719547+0000","last_undegraded":"2023-12-01T15:59:44.719547+0000","last_fullsized":"2023-12-01T15:59:44.719547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3629","reported_seq":3090,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.506559+0000","last_change":"2023-12-01T15:59:48.506683+0000","last_active":"2023-12-01T15:59:48.506559+0000","last_peered":"2023-12-01T15:59:48.506559+0000","last_clean":"2023-12-01T15:59:48.506559+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:59:48.506559+0000","last_undegraded":"2023-12-01T15:59:48.506559+0000","last_fullsized":"2023-12-01T15:59:48.506559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3629","last_scrub_stamp":"2023-12-01T15:59:48.506533+0000","last_deep_scrub":"44'3629","last_deep_scrub_stamp":"2023-12-01T15:59:48.506533+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.506533+0000","objects_scrubbed":1,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:08:56.880573+0000","scrub_duration":0.046519142999999999,"objects_trimmed":0,"snaptrim_duration":0.13624631700000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"44'1013","reported_seq":1068,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:11.216918+0000","last_change":"2023-12-01T16:00:11.217056+0000","last_active":"2023-12-01T16:00:11.216918+0000","last_peered":"2023-12-01T16:00:11.216918+0000","last_clean":"2023-12-01T16:00:11.216918+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T16:00:11.216918+0000","last_undegraded":"2023-12-01T16:00:11.216918+0000","last_fullsized":"2023-12-01T16:00:11.216918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1013","last_scrub_stamp":"2023-12-01T16:00:11.216892+0000","last_deep_scrub":"44'1013","last_deep_scrub_stamp":"2023-12-01T16:00:11.216892+0000","last_clean_scrub_stamp":"2023-12-01T16:00:11.216892+0000","objects_scrubbed":6,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:32.838433+0000","scrub_duration":0.058295441000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":10007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1316869,"num_omap_keys":2625,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"44'3453","reported_seq":2886,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.543603+0000","last_change":"2023-12-01T15:59:49.543735+0000","last_active":"2023-12-01T15:59:49.543603+0000","last_peered":"2023-12-01T15:59:49.543603+0000","last_clean":"2023-12-01T15:59:49.543603+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:59:49.543603+0000","last_undegraded":"2023-12-01T15:59:49.543603+0000","last_fullsized":"2023-12-01T15:59:49.543603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3453","last_scrub_stamp":"2023-12-01T15:59:49.543577+0000","last_deep_scrub":"44'3453","last_deep_scrub_stamp":"2023-12-01T15:59:49.543577+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.543577+0000","objects_scrubbed":2,"log_size":3453,"log_dups_size":0,"ondisk_log_size":3453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:22.774680+0000","scrub_duration":0.045727260999999998,"objects_trimmed":0,"snaptrim_duration":0.13638832000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"42'1384","reported_seq":1428,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174340+0000","last_change":"2023-12-01T15:43:45.207762+0000","last_active":"2023-12-01T15:59:46.174340+0000","last_peered":"2023-12-01T15:59:46.174340+0000","last_clean":"2023-12-01T15:59:46.174340+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T15:59:46.174340+0000","last_undegraded":"2023-12-01T15:59:46.174340+0000","last_fullsized":"2023-12-01T15:59:46.174340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1392,"num_write_kb":12529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'1278","reported_seq":1333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:18.087582+0000","last_change":"2023-12-01T16:00:18.087703+0000","last_active":"2023-12-01T16:00:18.087582+0000","last_peered":"2023-12-01T16:00:18.087582+0000","last_clean":"2023-12-01T16:00:18.087582+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T16:00:18.087582+0000","last_undegraded":"2023-12-01T16:00:18.087582+0000","last_fullsized":"2023-12-01T16:00:18.087582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1278","last_scrub_stamp":"2023-12-01T16:00:18.087555+0000","last_deep_scrub":"44'1278","last_deep_scrub_stamp":"2023-12-01T16:00:18.087555+0000","last_clean_scrub_stamp":"2023-12-01T16:00:18.087555+0000","objects_scrubbed":2,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:13.474736+0000","scrub_duration":0.033204496999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":12495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'3658","reported_seq":3058,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:53.147914+0000","last_change":"2023-12-01T15:59:53.148041+0000","last_active":"2023-12-01T15:59:53.147914+0000","last_peered":"2023-12-01T15:59:53.147914+0000","last_clean":"2023-12-01T15:59:53.147914+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:59:53.147914+0000","last_undegraded":"2023-12-01T15:59:53.147914+0000","last_fullsized":"2023-12-01T15:59:53.147914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3658","last_scrub_stamp":"2023-12-01T15:59:53.147892+0000","last_deep_scrub":"43'3658","last_deep_scrub_stamp":"2023-12-01T15:59:53.147892+0000","last_clean_scrub_stamp":"2023-12-01T15:59:53.147892+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:26.141896+0000","scrub_duration":0.039317244000000001,"objects_trimmed":0,"snaptrim_duration":0.172903538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'1243","reported_seq":1298,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:05.986674+0000","last_change":"2023-12-01T16:00:05.986857+0000","last_active":"2023-12-01T16:00:05.986674+0000","last_peered":"2023-12-01T16:00:05.986674+0000","last_clean":"2023-12-01T16:00:05.986674+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T16:00:05.986674+0000","last_undegraded":"2023-12-01T16:00:05.986674+0000","last_fullsized":"2023-12-01T16:00:05.986674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1243","last_scrub_stamp":"2023-12-01T16:00:05.986638+0000","last_deep_scrub":"44'1243","last_deep_scrub_stamp":"2023-12-01T16:00:05.986638+0000","last_clean_scrub_stamp":"2023-12-01T16:00:05.986638+0000","objects_scrubbed":3,"log_size":1243,"log_dups_size":0,"ondisk_log_size":1243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:27.176778+0000","scrub_duration":0.028165143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1238,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'3445","reported_seq":2884,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:57.046416+0000","last_change":"2023-12-01T15:59:57.046543+0000","last_active":"2023-12-01T15:59:57.046416+0000","last_peered":"2023-12-01T15:59:57.046416+0000","last_clean":"2023-12-01T15:59:57.046416+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:59:57.046416+0000","last_undegraded":"2023-12-01T15:59:57.046416+0000","last_fullsized":"2023-12-01T15:59:57.046416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3445","last_scrub_stamp":"2023-12-01T15:59:57.046388+0000","last_deep_scrub":"44'3445","last_deep_scrub_stamp":"2023-12-01T15:59:57.046388+0000","last_clean_scrub_stamp":"2023-12-01T15:59:57.046388+0000","objects_scrubbed":3,"log_size":3445,"log_dups_size":0,"ondisk_log_size":3445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:06:40.083816+0000","scrub_duration":0.046119563000000002,"objects_trimmed":0,"snaptrim_duration":0.090755167999999997,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1186,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"39'4742","reported_seq":4786,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479970+0000","last_change":"2023-12-01T15:43:45.207098+0000","last_active":"2023-12-01T15:59:43.479970+0000","last_peered":"2023-12-01T15:59:43.479970+0000","last_clean":"2023-12-01T15:59:43.479970+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T15:59:43.479970+0000","last_undegraded":"2023-12-01T15:59:43.479970+0000","last_fullsized":"2023-12-01T15:59:43.479970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":4742,"log_dups_size":0,"ondisk_log_size":4742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4735,"num_write_kb":27522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3360","reported_seq":2796,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.985855+0000","last_change":"2023-12-01T15:59:49.985964+0000","last_active":"2023-12-01T15:59:49.985855+0000","last_peered":"2023-12-01T15:59:49.985855+0000","last_clean":"2023-12-01T15:59:49.985855+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:59:49.985855+0000","last_undegraded":"2023-12-01T15:59:49.985855+0000","last_fullsized":"2023-12-01T15:59:49.985855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3360","last_scrub_stamp":"2023-12-01T15:59:49.985801+0000","last_deep_scrub":"44'3360","last_deep_scrub_stamp":"2023-12-01T15:59:49.985801+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.985801+0000","objects_scrubbed":1,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:22:12.421111+0000","scrub_duration":0.040212074,"objects_trimmed":0,"snaptrim_duration":0.090274558000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'1994","reported_seq":2049,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.208746+0000","last_change":"2023-12-01T16:00:23.208916+0000","last_active":"2023-12-01T16:00:23.208746+0000","last_peered":"2023-12-01T16:00:23.208746+0000","last_clean":"2023-12-01T16:00:23.208746+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T16:00:23.208746+0000","last_undegraded":"2023-12-01T16:00:23.208746+0000","last_fullsized":"2023-12-01T16:00:23.208746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1994","last_scrub_stamp":"2023-12-01T16:00:23.208718+0000","last_deep_scrub":"44'1994","last_deep_scrub_stamp":"2023-12-01T16:00:23.208718+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.208718+0000","objects_scrubbed":6,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:53.915729+0000","scrub_duration":0.063117909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1987,"num_write_kb":25538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"44'3405","reported_seq":2910,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:59.668323+0000","last_change":"2023-12-01T15:59:59.668525+0000","last_active":"2023-12-01T15:59:59.668323+0000","last_peered":"2023-12-01T15:59:59.668323+0000","last_clean":"2023-12-01T15:59:59.668323+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:59:59.668323+0000","last_undegraded":"2023-12-01T15:59:59.668323+0000","last_fullsized":"2023-12-01T15:59:59.668323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3405","last_scrub_stamp":"2023-12-01T15:59:59.668279+0000","last_deep_scrub":"44'3405","last_deep_scrub_stamp":"2023-12-01T15:59:59.668279+0000","last_clean_scrub_stamp":"2023-12-01T15:59:59.668279+0000","objects_scrubbed":2,"log_size":3405,"log_dups_size":0,"ondisk_log_size":3405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:09.752731+0000","scrub_duration":0.045721932,"objects_trimmed":0,"snaptrim_duration":0.13034463499999999,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1138,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'4352","reported_seq":4407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:04.502682+0000","last_change":"2023-12-01T16:00:04.502810+0000","last_active":"2023-12-01T16:00:04.502682+0000","last_peered":"2023-12-01T16:00:04.502682+0000","last_clean":"2023-12-01T16:00:04.502682+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T16:00:04.502682+0000","last_undegraded":"2023-12-01T16:00:04.502682+0000","last_fullsized":"2023-12-01T16:00:04.502682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4352","last_scrub_stamp":"2023-12-01T16:00:04.502658+0000","last_deep_scrub":"44'4352","last_deep_scrub_stamp":"2023-12-01T16:00:04.502658+0000","last_clean_scrub_stamp":"2023-12-01T16:00:04.502658+0000","objects_scrubbed":4,"log_size":4352,"log_dups_size":0,"ondisk_log_size":4352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:37.496662+0000","scrub_duration":0.054000375000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4337,"num_write_kb":30065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1415,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"43'3797","reported_seq":3179,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478167+0000","last_change":"2023-12-01T15:59:36.966407+0000","last_active":"2023-12-01T15:59:43.478167+0000","last_peered":"2023-12-01T15:59:43.478167+0000","last_clean":"2023-12-01T15:59:43.478167+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T15:59:43.478167+0000","last_undegraded":"2023-12-01T15:59:43.478167+0000","last_fullsized":"2023-12-01T15:59:43.478167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.165714477,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"41'2491","reported_seq":2535,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478592+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:59:43.478592+0000","last_peered":"2023-12-01T15:59:43.478592+0000","last_clean":"2023-12-01T15:59:43.478592+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:59:43.478592+0000","last_undegraded":"2023-12-01T15:59:43.478592+0000","last_fullsized":"2023-12-01T15:59:43.478592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2491,"log_dups_size":0,"ondisk_log_size":2491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2494,"num_write_kb":26915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'3462","reported_seq":2932,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479262+0000","last_change":"2023-12-01T15:59:36.980979+0000","last_active":"2023-12-01T15:59:43.479262+0000","last_peered":"2023-12-01T15:59:43.479262+0000","last_clean":"2023-12-01T15:59:43.479262+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:59:43.479262+0000","last_undegraded":"2023-12-01T15:59:43.479262+0000","last_fullsized":"2023-12-01T15:59:43.479262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15615646,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1160,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'2352","reported_seq":2396,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477548+0000","last_change":"2023-12-01T15:43:45.206261+0000","last_active":"2023-12-01T15:59:43.477548+0000","last_peered":"2023-12-01T15:59:43.477548+0000","last_clean":"2023-12-01T15:59:43.477548+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T15:59:43.477548+0000","last_undegraded":"2023-12-01T15:59:43.477548+0000","last_fullsized":"2023-12-01T15:59:43.477548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2354,"num_write_kb":17078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'3597","reported_seq":2983,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.397327+0000","last_change":"2023-12-01T15:59:36.901256+0000","last_active":"2023-12-01T15:59:43.397327+0000","last_peered":"2023-12-01T15:59:43.397327+0000","last_clean":"2023-12-01T15:59:43.397327+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T15:59:43.397327+0000","last_undegraded":"2023-12-01T15:59:43.397327+0000","last_fullsized":"2023-12-01T15:59:43.397327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.086977656,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'1540","reported_seq":1595,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.514725+0000","last_change":"2023-12-01T16:00:23.514875+0000","last_active":"2023-12-01T16:00:23.514725+0000","last_peered":"2023-12-01T16:00:23.514725+0000","last_clean":"2023-12-01T16:00:23.514725+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T16:00:23.514725+0000","last_undegraded":"2023-12-01T16:00:23.514725+0000","last_fullsized":"2023-12-01T16:00:23.514725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1540","last_scrub_stamp":"2023-12-01T16:00:23.514701+0000","last_deep_scrub":"44'1540","last_deep_scrub_stamp":"2023-12-01T16:00:23.514701+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.514701+0000","objects_scrubbed":2,"log_size":1540,"log_dups_size":0,"ondisk_log_size":1540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:08.871584+0000","scrub_duration":0.042235796999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1538,"num_write_kb":10132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":636698,"num_omap_keys":1268,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3475","reported_seq":2915,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:55.340040+0000","last_change":"2023-12-01T15:59:55.340335+0000","last_active":"2023-12-01T15:59:55.340040+0000","last_peered":"2023-12-01T15:59:55.340040+0000","last_clean":"2023-12-01T15:59:55.340040+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:59:55.340040+0000","last_undegraded":"2023-12-01T15:59:55.340040+0000","last_fullsized":"2023-12-01T15:59:55.340040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3475","last_scrub_stamp":"2023-12-01T15:59:55.339969+0000","last_deep_scrub":"43'3475","last_deep_scrub_stamp":"2023-12-01T15:59:55.339969+0000","last_clean_scrub_stamp":"2023-12-01T15:59:55.339969+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:16.716385+0000","scrub_duration":0.037072088000000003,"objects_trimmed":0,"snaptrim_duration":0.64740572200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":201,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.485338+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:59:44.485338+0000","last_peered":"2023-12-01T15:59:44.485338+0000","last_clean":"2023-12-01T15:59:44.485338+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:59:44.485338+0000","last_undegraded":"2023-12-01T15:59:44.485338+0000","last_fullsized":"2023-12-01T15:59:44.485338+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174009+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:59:46.174009+0000","last_peered":"2023-12-01T15:59:46.174009+0000","last_clean":"2023-12-01T15:59:46.174009+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:59:46.174009+0000","last_undegraded":"2023-12-01T15:59:46.174009+0000","last_fullsized":"2023-12-01T15:59:46.174009+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"44'4418","reported_seq":4474,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:22.563805+0000","last_change":"2023-12-01T16:00:22.563805+0000","last_active":"2023-12-01T16:00:22.563805+0000","last_peered":"2023-12-01T16:00:22.563805+0000","last_clean":"2023-12-01T16:00:22.563805+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T16:00:22.563805+0000","last_undegraded":"2023-12-01T16:00:22.563805+0000","last_fullsized":"2023-12-01T16:00:22.563805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4418","last_scrub_stamp":"2023-12-01T16:00:22.563645+0000","last_deep_scrub":"44'4418","last_deep_scrub_stamp":"2023-12-01T16:00:22.563645+0000","last_clean_scrub_stamp":"2023-12-01T16:00:22.563645+0000","objects_scrubbed":4,"log_size":4418,"log_dups_size":0,"ondisk_log_size":4418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.311958+0000","scrub_duration":0.064643555000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4406,"num_write_kb":30219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"43'3657","reported_seq":3070,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480688+0000","last_change":"2023-12-01T15:59:36.978939+0000","last_active":"2023-12-01T15:59:43.480688+0000","last_peered":"2023-12-01T15:59:43.480688+0000","last_clean":"2023-12-01T15:59:43.480688+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:59:43.480688+0000","last_undegraded":"2023-12-01T15:59:43.480688+0000","last_fullsized":"2023-12-01T15:59:43.480688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3657,"log_dups_size":0,"ondisk_log_size":3657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.144833777,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174011+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:59:46.174011+0000","last_peered":"2023-12-01T15:59:46.174011+0000","last_clean":"2023-12-01T15:59:46.174011+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:59:46.174011+0000","last_undegraded":"2023-12-01T15:59:46.174011+0000","last_fullsized":"2023-12-01T15:59:46.174011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'2295","reported_seq":2540,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.719528+0000","last_change":"2023-12-01T15:43:45.209138+0000","last_active":"2023-12-01T15:59:44.719528+0000","last_peered":"2023-12-01T15:59:44.719528+0000","last_clean":"2023-12-01T15:59:44.719528+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T15:59:44.719528+0000","last_undegraded":"2023-12-01T15:59:44.719528+0000","last_fullsized":"2023-12-01T15:59:44.719528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3359983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":3419,"num_write":2296,"num_write_kb":16044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'3370","reported_seq":2811,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479724+0000","last_change":"2023-12-01T15:59:36.960605+0000","last_active":"2023-12-01T15:59:43.479724+0000","last_peered":"2023-12-01T15:59:43.479724+0000","last_clean":"2023-12-01T15:59:43.479724+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T15:59:43.479724+0000","last_undegraded":"2023-12-01T15:59:43.479724+0000","last_fullsized":"2023-12-01T15:59:43.479724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3370,"log_dups_size":0,"ondisk_log_size":3370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13848359499999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1137,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:08.498717+0000","last_change":"2023-12-01T16:00:08.498717+0000","last_active":"2023-12-01T16:00:08.498717+0000","last_peered":"2023-12-01T16:00:08.498717+0000","last_clean":"2023-12-01T16:00:08.498717+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T16:00:08.498717+0000","last_undegraded":"2023-12-01T16:00:08.498717+0000","last_fullsized":"2023-12-01T16:00:08.498717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:08.498410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:08.498410+0000","last_clean_scrub_stamp":"2023-12-01T16:00:08.498410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:18.582862+0000","scrub_duration":0.0065834630000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"44'2709","reported_seq":2765,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:14.574850+0000","last_change":"2023-12-01T16:00:14.574989+0000","last_active":"2023-12-01T16:00:14.574850+0000","last_peered":"2023-12-01T16:00:14.574850+0000","last_clean":"2023-12-01T16:00:14.574850+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T16:00:14.574850+0000","last_undegraded":"2023-12-01T16:00:14.574850+0000","last_fullsized":"2023-12-01T16:00:14.574850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2709","last_scrub_stamp":"2023-12-01T16:00:14.574824+0000","last_deep_scrub":"44'2709","last_deep_scrub_stamp":"2023-12-01T16:00:14.574824+0000","last_clean_scrub_stamp":"2023-12-01T16:00:14.574824+0000","objects_scrubbed":3,"log_size":2709,"log_dups_size":0,"ondisk_log_size":2709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:31:29.561401+0000","scrub_duration":0.059953542999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2697,"num_write_kb":25331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3393","reported_seq":2878,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.386317+0000","last_change":"2023-12-01T15:59:49.386477+0000","last_active":"2023-12-01T15:59:49.386317+0000","last_peered":"2023-12-01T15:59:49.386317+0000","last_clean":"2023-12-01T15:59:49.386317+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:59:49.386317+0000","last_undegraded":"2023-12-01T15:59:49.386317+0000","last_fullsized":"2023-12-01T15:59:49.386317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3393","last_scrub_stamp":"2023-12-01T15:59:49.386292+0000","last_deep_scrub":"44'3393","last_deep_scrub_stamp":"2023-12-01T15:59:49.386292+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.386292+0000","objects_scrubbed":3,"log_size":3393,"log_dups_size":0,"ondisk_log_size":3393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:21:35.191687+0000","scrub_duration":0.041281799000000001,"objects_trimmed":0,"snaptrim_duration":0.644502672,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1119,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174041+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:59:46.174041+0000","last_peered":"2023-12-01T15:59:46.174041+0000","last_clean":"2023-12-01T15:59:46.174041+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:59:46.174041+0000","last_undegraded":"2023-12-01T15:59:46.174041+0000","last_fullsized":"2023-12-01T15:59:46.174041+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'3561","reported_seq":3617,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:09.058193+0000","last_change":"2023-12-01T16:00:09.058193+0000","last_active":"2023-12-01T16:00:09.058193+0000","last_peered":"2023-12-01T16:00:09.058193+0000","last_clean":"2023-12-01T16:00:09.058193+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T16:00:09.058193+0000","last_undegraded":"2023-12-01T16:00:09.058193+0000","last_fullsized":"2023-12-01T16:00:09.058193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3561","last_scrub_stamp":"2023-12-01T16:00:09.058006+0000","last_deep_scrub":"44'3561","last_deep_scrub_stamp":"2023-12-01T16:00:09.058006+0000","last_clean_scrub_stamp":"2023-12-01T16:00:09.058006+0000","objects_scrubbed":5,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:19.142458+0000","scrub_duration":0.071950684000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3556,"num_write_kb":20852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1320010,"num_omap_keys":2629,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3573","reported_seq":2976,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:47.437403+0000","last_change":"2023-12-01T15:59:47.437607+0000","last_active":"2023-12-01T15:59:47.437403+0000","last_peered":"2023-12-01T15:59:47.437403+0000","last_clean":"2023-12-01T15:59:47.437403+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:47.437403+0000","last_undegraded":"2023-12-01T15:59:47.437403+0000","last_fullsized":"2023-12-01T15:59:47.437403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3573","last_scrub_stamp":"2023-12-01T15:59:47.437368+0000","last_deep_scrub":"44'3573","last_deep_scrub_stamp":"2023-12-01T15:59:47.437368+0000","last_clean_scrub_stamp":"2023-12-01T15:59:47.437368+0000","objects_scrubbed":1,"log_size":3573,"log_dups_size":0,"ondisk_log_size":3573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:45:47.573028+0000","scrub_duration":0.052350225,"objects_trimmed":0,"snaptrim_duration":0.65789627900000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'2832","reported_seq":2887,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:04.956597+0000","last_change":"2023-12-01T16:00:04.956811+0000","last_active":"2023-12-01T16:00:04.956597+0000","last_peered":"2023-12-01T16:00:04.956597+0000","last_clean":"2023-12-01T16:00:04.956597+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T16:00:04.956597+0000","last_undegraded":"2023-12-01T16:00:04.956597+0000","last_fullsized":"2023-12-01T16:00:04.956597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2832","last_scrub_stamp":"2023-12-01T16:00:04.956554+0000","last_deep_scrub":"44'2832","last_deep_scrub_stamp":"2023-12-01T16:00:04.956554+0000","last_clean_scrub_stamp":"2023-12-01T16:00:04.956554+0000","objects_scrubbed":2,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:37.950558+0000","scrub_duration":0.044932412999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2820,"num_write_kb":26865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":628812,"num_omap_keys":1252,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:05.464028+0000","last_change":"2023-12-01T16:00:05.464028+0000","last_active":"2023-12-01T16:00:05.464028+0000","last_peered":"2023-12-01T16:00:05.464028+0000","last_clean":"2023-12-01T16:00:05.464028+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T16:00:05.464028+0000","last_undegraded":"2023-12-01T16:00:05.464028+0000","last_fullsized":"2023-12-01T16:00:05.464028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:05.463736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:05.463736+0000","last_clean_scrub_stamp":"2023-12-01T16:00:05.463736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:26.653876+0000","scrub_duration":0.0051879350000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"44'3761","reported_seq":3210,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.423586+0000","last_change":"2023-12-01T15:59:48.423729+0000","last_active":"2023-12-01T15:59:48.423586+0000","last_peered":"2023-12-01T15:59:48.423586+0000","last_clean":"2023-12-01T15:59:48.423586+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:59:48.423586+0000","last_undegraded":"2023-12-01T15:59:48.423586+0000","last_fullsized":"2023-12-01T15:59:48.423586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3761","last_scrub_stamp":"2023-12-01T15:59:48.423554+0000","last_deep_scrub":"44'3761","last_deep_scrub_stamp":"2023-12-01T15:59:48.423554+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.423554+0000","objects_scrubbed":2,"log_size":3761,"log_dups_size":0,"ondisk_log_size":3761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:02.504062+0000","scrub_duration":0.041749799999999997,"objects_trimmed":0,"snaptrim_duration":0.64064258500000004,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"44'725","reported_seq":781,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:16.552415+0000","last_change":"2023-12-01T16:00:16.552415+0000","last_active":"2023-12-01T16:00:16.552415+0000","last_peered":"2023-12-01T16:00:16.552415+0000","last_clean":"2023-12-01T16:00:16.552415+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T16:00:16.552415+0000","last_undegraded":"2023-12-01T16:00:16.552415+0000","last_fullsized":"2023-12-01T16:00:16.552415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'725","last_scrub_stamp":"2023-12-01T16:00:16.552270+0000","last_deep_scrub":"44'725","last_deep_scrub_stamp":"2023-12-01T16:00:16.552270+0000","last_clean_scrub_stamp":"2023-12-01T16:00:16.552270+0000","objects_scrubbed":2,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:11.939451+0000","scrub_duration":0.030041060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":8308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480912+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:59:43.480912+0000","last_peered":"2023-12-01T15:59:43.480912+0000","last_clean":"2023-12-01T15:59:43.480912+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:59:43.480912+0000","last_undegraded":"2023-12-01T15:59:43.480912+0000","last_fullsized":"2023-12-01T15:59:43.480912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"44'3560","reported_seq":2975,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:11.777742+0000","last_change":"2023-12-01T16:00:11.777890+0000","last_active":"2023-12-01T16:00:11.777742+0000","last_peered":"2023-12-01T16:00:11.777742+0000","last_clean":"2023-12-01T16:00:11.777742+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T16:00:11.777742+0000","last_undegraded":"2023-12-01T16:00:11.777742+0000","last_fullsized":"2023-12-01T16:00:11.777742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3560","last_scrub_stamp":"2023-12-01T16:00:11.777713+0000","last_deep_scrub":"44'3560","last_deep_scrub_stamp":"2023-12-01T16:00:11.777713+0000","last_clean_scrub_stamp":"2023-12-01T16:00:11.777713+0000","objects_scrubbed":2,"log_size":3560,"log_dups_size":0,"ondisk_log_size":3560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:07.164893+0000","scrub_duration":0.046654314000000002,"objects_trimmed":0,"snaptrim_duration":0.13059393599999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1243,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'1640","reported_seq":1695,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:19.517593+0000","last_change":"2023-12-01T16:00:19.517728+0000","last_active":"2023-12-01T16:00:19.517593+0000","last_peered":"2023-12-01T16:00:19.517593+0000","last_clean":"2023-12-01T16:00:19.517593+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T16:00:19.517593+0000","last_undegraded":"2023-12-01T16:00:19.517593+0000","last_fullsized":"2023-12-01T16:00:19.517593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1640","last_scrub_stamp":"2023-12-01T16:00:19.517564+0000","last_deep_scrub":"44'1640","last_deep_scrub_stamp":"2023-12-01T16:00:19.517564+0000","last_clean_scrub_stamp":"2023-12-01T16:00:19.517564+0000","objects_scrubbed":3,"log_size":1640,"log_dups_size":0,"ondisk_log_size":1640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:42:53.178860+0000","scrub_duration":0.036244526999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1642,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:09.510544+0000","last_change":"2023-12-01T16:00:09.510854+0000","last_active":"2023-12-01T16:00:09.510544+0000","last_peered":"2023-12-01T16:00:09.510544+0000","last_clean":"2023-12-01T16:00:09.510544+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T16:00:09.510544+0000","last_undegraded":"2023-12-01T16:00:09.510544+0000","last_fullsized":"2023-12-01T16:00:09.510544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:09.510499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:09.510499+0000","last_clean_scrub_stamp":"2023-12-01T16:00:09.510499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:50:49.026098+0000","scrub_duration":0.005722286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'3700","reported_seq":3078,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.659888+0000","last_change":"2023-12-01T15:59:56.660009+0000","last_active":"2023-12-01T15:59:56.659888+0000","last_peered":"2023-12-01T15:59:56.659888+0000","last_clean":"2023-12-01T15:59:56.659888+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:59:56.659888+0000","last_undegraded":"2023-12-01T15:59:56.659888+0000","last_fullsized":"2023-12-01T15:59:56.659888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3700","last_scrub_stamp":"2023-12-01T15:59:56.659861+0000","last_deep_scrub":"44'3700","last_deep_scrub_stamp":"2023-12-01T15:59:56.659861+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.659861+0000","objects_scrubbed":4,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:17.850001+0000","scrub_duration":0.058770831000000003,"objects_trimmed":0,"snaptrim_duration":0.13319146700000001,"stat_sum":{"num_bytes":4118,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'2000","reported_seq":2055,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:18.918333+0000","last_change":"2023-12-01T16:00:18.918482+0000","last_active":"2023-12-01T16:00:18.918333+0000","last_peered":"2023-12-01T16:00:18.918333+0000","last_clean":"2023-12-01T16:00:18.918333+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T16:00:18.918333+0000","last_undegraded":"2023-12-01T16:00:18.918333+0000","last_fullsized":"2023-12-01T16:00:18.918333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2000","last_scrub_stamp":"2023-12-01T16:00:18.918306+0000","last_deep_scrub":"44'2000","last_deep_scrub_stamp":"2023-12-01T16:00:18.918306+0000","last_clean_scrub_stamp":"2023-12-01T16:00:18.918306+0000","objects_scrubbed":5,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:04.275189+0000","scrub_duration":0.15145572099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2265,"num_write_kb":16414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":702002,"num_omap_keys":1398,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480499+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:59:43.480499+0000","last_peered":"2023-12-01T15:59:43.480499+0000","last_clean":"2023-12-01T15:59:43.480499+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:59:43.480499+0000","last_undegraded":"2023-12-01T15:59:43.480499+0000","last_fullsized":"2023-12-01T15:59:43.480499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"43'3405","reported_seq":2819,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.394558+0000","last_change":"2023-12-01T15:59:36.902129+0000","last_active":"2023-12-01T15:59:43.394558+0000","last_peered":"2023-12-01T15:59:43.394558+0000","last_clean":"2023-12-01T15:59:43.394558+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T15:59:43.394558+0000","last_undegraded":"2023-12-01T15:59:43.394558+0000","last_fullsized":"2023-12-01T15:59:43.394558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3405,"log_dups_size":0,"ondisk_log_size":3405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.087179219000000002,"stat_sum":{"num_bytes":12302,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"44'3615","reported_seq":3033,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.027191+0000","last_change":"2023-12-01T15:59:49.027191+0000","last_active":"2023-12-01T15:59:49.027191+0000","last_peered":"2023-12-01T15:59:49.027191+0000","last_clean":"2023-12-01T15:59:49.027191+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:59:49.027191+0000","last_undegraded":"2023-12-01T15:59:49.027191+0000","last_fullsized":"2023-12-01T15:59:49.027191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3615","last_scrub_stamp":"2023-12-01T15:59:49.026983+0000","last_deep_scrub":"44'3615","last_deep_scrub_stamp":"2023-12-01T15:59:49.026983+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.026983+0000","objects_scrubbed":2,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:03.107490+0000","scrub_duration":0.046925306,"objects_trimmed":0,"snaptrim_duration":0.084182759999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'3719","reported_seq":3774,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:17.269725+0000","last_change":"2023-12-01T16:00:17.269901+0000","last_active":"2023-12-01T16:00:17.269725+0000","last_peered":"2023-12-01T16:00:17.269725+0000","last_clean":"2023-12-01T16:00:17.269725+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T16:00:17.269725+0000","last_undegraded":"2023-12-01T16:00:17.269725+0000","last_fullsized":"2023-12-01T16:00:17.269725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3719","last_scrub_stamp":"2023-12-01T16:00:17.269697+0000","last_deep_scrub":"44'3719","last_deep_scrub_stamp":"2023-12-01T16:00:17.269697+0000","last_clean_scrub_stamp":"2023-12-01T16:00:17.269697+0000","objects_scrubbed":7,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:02.626581+0000","scrub_duration":0.068143023999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3712,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":605,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"43'3508","reported_seq":2928,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:45.204887+0000","last_change":"2023-12-01T15:59:37.439759+0000","last_active":"2023-12-01T15:59:45.204887+0000","last_peered":"2023-12-01T15:59:45.204887+0000","last_clean":"2023-12-01T15:59:45.204887+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T15:59:45.204887+0000","last_undegraded":"2023-12-01T15:59:45.204887+0000","last_fullsized":"2023-12-01T15:59:45.204887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63296622700000005,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"44'2462","reported_seq":2516,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:19.085033+0000","last_change":"2023-12-01T16:00:19.085189+0000","last_active":"2023-12-01T16:00:19.085033+0000","last_peered":"2023-12-01T16:00:19.085033+0000","last_clean":"2023-12-01T16:00:19.085033+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T16:00:19.085033+0000","last_undegraded":"2023-12-01T16:00:19.085033+0000","last_fullsized":"2023-12-01T16:00:19.085033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2462","last_scrub_stamp":"2023-12-01T16:00:19.085001+0000","last_deep_scrub":"44'2462","last_deep_scrub_stamp":"2023-12-01T16:00:19.085001+0000","last_clean_scrub_stamp":"2023-12-01T16:00:19.085001+0000","objects_scrubbed":5,"log_size":2462,"log_dups_size":0,"ondisk_log_size":2462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:40.706542+0000","scrub_duration":0.035617093000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2453,"num_write_kb":21278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"44'1341","reported_seq":1395,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:20.130025+0000","last_change":"2023-12-01T16:00:20.130338+0000","last_active":"2023-12-01T16:00:20.130025+0000","last_peered":"2023-12-01T16:00:20.130025+0000","last_clean":"2023-12-01T16:00:20.130025+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T16:00:20.130025+0000","last_undegraded":"2023-12-01T16:00:20.130025+0000","last_fullsized":"2023-12-01T16:00:20.130025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1341","last_scrub_stamp":"2023-12-01T16:00:20.129959+0000","last_deep_scrub":"44'1341","last_deep_scrub_stamp":"2023-12-01T16:00:20.129959+0000","last_clean_scrub_stamp":"2023-12-01T16:00:20.129959+0000","objects_scrubbed":2,"log_size":1341,"log_dups_size":0,"ondisk_log_size":1341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:42:53.791254+0000","scrub_duration":0.039957485000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1338,"num_write_kb":26066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'3641","reported_seq":3016,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:17.763808+0000","last_change":"2023-12-01T16:00:17.763921+0000","last_active":"2023-12-01T16:00:17.763808+0000","last_peered":"2023-12-01T16:00:17.763808+0000","last_clean":"2023-12-01T16:00:17.763808+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T16:00:17.763808+0000","last_undegraded":"2023-12-01T16:00:17.763808+0000","last_fullsized":"2023-12-01T16:00:17.763808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3641","last_scrub_stamp":"2023-12-01T16:00:17.763787+0000","last_deep_scrub":"43'3641","last_deep_scrub_stamp":"2023-12-01T16:00:17.763787+0000","last_clean_scrub_stamp":"2023-12-01T16:00:17.763787+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:59.512101+0000","scrub_duration":0.036564379000000001,"objects_trimmed":0,"snaptrim_duration":0.13235097200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"44'903","reported_seq":957,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:22.885386+0000","last_change":"2023-12-01T16:00:22.885656+0000","last_active":"2023-12-01T16:00:22.885386+0000","last_peered":"2023-12-01T16:00:22.885386+0000","last_clean":"2023-12-01T16:00:22.885386+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T16:00:22.885386+0000","last_undegraded":"2023-12-01T16:00:22.885386+0000","last_fullsized":"2023-12-01T16:00:22.885386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'903","last_scrub_stamp":"2023-12-01T16:00:22.885328+0000","last_deep_scrub":"44'903","last_deep_scrub_stamp":"2023-12-01T16:00:22.885328+0000","last_clean_scrub_stamp":"2023-12-01T16:00:22.885328+0000","objects_scrubbed":3,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:25:47.742131+0000","scrub_duration":0.050233486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3459","reported_seq":2882,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:50.437138+0000","last_change":"2023-12-01T15:59:50.437138+0000","last_active":"2023-12-01T15:59:50.437138+0000","last_peered":"2023-12-01T15:59:50.437138+0000","last_clean":"2023-12-01T15:59:50.437138+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:59:50.437138+0000","last_undegraded":"2023-12-01T15:59:50.437138+0000","last_fullsized":"2023-12-01T15:59:50.437138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3459","last_scrub_stamp":"2023-12-01T15:59:50.436956+0000","last_deep_scrub":"44'3459","last_deep_scrub_stamp":"2023-12-01T15:59:50.436956+0000","last_clean_scrub_stamp":"2023-12-01T15:59:50.436956+0000","objects_scrubbed":1,"log_size":3459,"log_dups_size":0,"ondisk_log_size":3459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:48:17.314373+0000","scrub_duration":0.047609585000000003,"objects_trimmed":0,"snaptrim_duration":0.59367497300000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1187,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"43'3413","reported_seq":2909,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480194+0000","last_change":"2023-12-01T15:59:36.971349+0000","last_active":"2023-12-01T15:59:43.480194+0000","last_peered":"2023-12-01T15:59:43.480194+0000","last_clean":"2023-12-01T15:59:43.480194+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:59:43.480194+0000","last_undegraded":"2023-12-01T15:59:43.480194+0000","last_fullsized":"2023-12-01T15:59:43.480194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17121966999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4978","reported_seq":5032,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.423566+0000","last_change":"2023-12-01T15:59:54.423763+0000","last_active":"2023-12-01T15:59:54.423566+0000","last_peered":"2023-12-01T15:59:54.423566+0000","last_clean":"2023-12-01T15:59:54.423566+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:59:54.423566+0000","last_undegraded":"2023-12-01T15:59:54.423566+0000","last_fullsized":"2023-12-01T15:59:54.423566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4978","last_scrub_stamp":"2023-12-01T15:59:54.423526+0000","last_deep_scrub":"44'4978","last_deep_scrub_stamp":"2023-12-01T15:59:54.423526+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.423526+0000","objects_scrubbed":5,"log_size":4978,"log_dups_size":0,"ondisk_log_size":4978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:49:35.988154+0000","scrub_duration":0.094740874000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4962,"num_write_kb":39191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670128,"num_omap_keys":1336,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'3228","reported_seq":2710,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:12.801031+0000","last_change":"2023-12-01T16:00:12.801404+0000","last_active":"2023-12-01T16:00:12.801031+0000","last_peered":"2023-12-01T16:00:12.801031+0000","last_clean":"2023-12-01T16:00:12.801031+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T16:00:12.801031+0000","last_undegraded":"2023-12-01T16:00:12.801031+0000","last_fullsized":"2023-12-01T16:00:12.801031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3228","last_scrub_stamp":"2023-12-01T16:00:12.800966+0000","last_deep_scrub":"44'3228","last_deep_scrub_stamp":"2023-12-01T16:00:12.800966+0000","last_clean_scrub_stamp":"2023-12-01T16:00:12.800966+0000","objects_scrubbed":2,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:34.422506+0000","scrub_duration":0.046375222000000001,"objects_trimmed":0,"snaptrim_duration":0.13751970099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'493","reported_seq":547,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.331077+0000","last_change":"2023-12-01T15:59:56.331348+0000","last_active":"2023-12-01T15:59:56.331077+0000","last_peered":"2023-12-01T15:59:56.331077+0000","last_clean":"2023-12-01T15:59:56.331077+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:59:56.331077+0000","last_undegraded":"2023-12-01T15:59:56.331077+0000","last_fullsized":"2023-12-01T15:59:56.331077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'493","last_scrub_stamp":"2023-12-01T15:59:56.331006+0000","last_deep_scrub":"44'493","last_deep_scrub_stamp":"2023-12-01T15:59:56.331006+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.331006+0000","objects_scrubbed":3,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:06:39.368433+0000","scrub_duration":0.040743746999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":17875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'3423","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:47.535135+0000","last_change":"2023-12-01T15:59:47.535337+0000","last_active":"2023-12-01T15:59:47.535135+0000","last_peered":"2023-12-01T15:59:47.535135+0000","last_clean":"2023-12-01T15:59:47.535135+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:59:47.535135+0000","last_undegraded":"2023-12-01T15:59:47.535135+0000","last_fullsized":"2023-12-01T15:59:47.535135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3423","last_scrub_stamp":"2023-12-01T15:59:47.535105+0000","last_deep_scrub":"44'3423","last_deep_scrub_stamp":"2023-12-01T15:59:47.535105+0000","last_clean_scrub_stamp":"2023-12-01T15:59:47.535105+0000","objects_scrubbed":2,"log_size":3423,"log_dups_size":0,"ondisk_log_size":3423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:08.911521+0000","scrub_duration":0.045260416999999997,"objects_trimmed":0,"snaptrim_duration":0.134588554,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"44'3618","reported_seq":3672,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:59.010548+0000","last_change":"2023-12-01T15:59:59.010802+0000","last_active":"2023-12-01T15:59:59.010548+0000","last_peered":"2023-12-01T15:59:59.010548+0000","last_clean":"2023-12-01T15:59:59.010548+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:59:59.010548+0000","last_undegraded":"2023-12-01T15:59:59.010548+0000","last_fullsized":"2023-12-01T15:59:59.010548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3618","last_scrub_stamp":"2023-12-01T15:59:59.010494+0000","last_deep_scrub":"44'3618","last_deep_scrub_stamp":"2023-12-01T15:59:59.010494+0000","last_clean_scrub_stamp":"2023-12-01T15:59:59.010494+0000","objects_scrubbed":2,"log_size":3618,"log_dups_size":0,"ondisk_log_size":3618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:32.241596+0000","scrub_duration":0.048349939000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3601,"num_write_kb":33849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"43'3891","reported_seq":3217,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.395972+0000","last_change":"2023-12-01T15:59:37.485420+0000","last_active":"2023-12-01T15:59:43.395972+0000","last_peered":"2023-12-01T15:59:43.395972+0000","last_clean":"2023-12-01T15:59:43.395972+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T15:59:43.395972+0000","last_undegraded":"2023-12-01T15:59:43.395972+0000","last_fullsized":"2023-12-01T15:59:43.395972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3891,"log_dups_size":0,"ondisk_log_size":3891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.65050901000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"44'2100","reported_seq":2154,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:21.858238+0000","last_change":"2023-12-01T16:00:21.858509+0000","last_active":"2023-12-01T16:00:21.858238+0000","last_peered":"2023-12-01T16:00:21.858238+0000","last_clean":"2023-12-01T16:00:21.858238+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T16:00:21.858238+0000","last_undegraded":"2023-12-01T16:00:21.858238+0000","last_fullsized":"2023-12-01T16:00:21.858238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2100","last_scrub_stamp":"2023-12-01T16:00:21.858173+0000","last_deep_scrub":"44'2100","last_deep_scrub_stamp":"2023-12-01T16:00:21.858173+0000","last_clean_scrub_stamp":"2023-12-01T16:00:21.858173+0000","objects_scrubbed":2,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:06.641876+0000","scrub_duration":0.043601572999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2089,"num_write_kb":16989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"44'3666","reported_seq":3088,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:21.094948+0000","last_change":"2023-12-01T16:00:21.095073+0000","last_active":"2023-12-01T16:00:21.094948+0000","last_peered":"2023-12-01T16:00:21.094948+0000","last_clean":"2023-12-01T16:00:21.094948+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T16:00:21.094948+0000","last_undegraded":"2023-12-01T16:00:21.094948+0000","last_fullsized":"2023-12-01T16:00:21.094948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3666","last_scrub_stamp":"2023-12-01T16:00:21.094921+0000","last_deep_scrub":"44'3666","last_deep_scrub_stamp":"2023-12-01T16:00:21.094921+0000","last_clean_scrub_stamp":"2023-12-01T16:00:21.094921+0000","objects_scrubbed":1,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:41:15.386618+0000","scrub_duration":0.048431008999999997,"objects_trimmed":0,"snaptrim_duration":0.084960400000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1169,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'641","reported_seq":695,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:10.011211+0000","last_change":"2023-12-01T16:00:10.011337+0000","last_active":"2023-12-01T16:00:10.011211+0000","last_peered":"2023-12-01T16:00:10.011211+0000","last_clean":"2023-12-01T16:00:10.011211+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T16:00:10.011211+0000","last_undegraded":"2023-12-01T16:00:10.011211+0000","last_fullsized":"2023-12-01T16:00:10.011211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'641","last_scrub_stamp":"2023-12-01T16:00:10.011185+0000","last_deep_scrub":"44'641","last_deep_scrub_stamp":"2023-12-01T16:00:10.011185+0000","last_clean_scrub_stamp":"2023-12-01T16:00:10.011185+0000","objects_scrubbed":2,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:50:49.526785+0000","scrub_duration":0.024782471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1891144,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":643,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"43'3570","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:51.023765+0000","last_change":"2023-12-01T15:59:51.023871+0000","last_active":"2023-12-01T15:59:51.023765+0000","last_peered":"2023-12-01T15:59:51.023765+0000","last_clean":"2023-12-01T15:59:51.023765+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:59:51.023765+0000","last_undegraded":"2023-12-01T15:59:51.023765+0000","last_fullsized":"2023-12-01T15:59:51.023765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3570","last_scrub_stamp":"2023-12-01T15:59:51.023745+0000","last_deep_scrub":"43'3570","last_deep_scrub_stamp":"2023-12-01T15:59:51.023745+0000","last_clean_scrub_stamp":"2023-12-01T15:59:51.023745+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:48:17.901162+0000","scrub_duration":0.041221723000000002,"objects_trimmed":0,"snaptrim_duration":0.094045403999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'5943","reported_seq":5997,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:58.274157+0000","last_change":"2023-12-01T15:59:58.274287+0000","last_active":"2023-12-01T15:59:58.274157+0000","last_peered":"2023-12-01T15:59:58.274157+0000","last_clean":"2023-12-01T15:59:58.274157+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:59:58.274157+0000","last_undegraded":"2023-12-01T15:59:58.274157+0000","last_fullsized":"2023-12-01T15:59:58.274157+0000","mapping_epoch":16,"log_start":"21'300","ondisk_log_start":"21'300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'5943","last_scrub_stamp":"2023-12-01T15:59:58.274135+0000","last_deep_scrub":"44'5943","last_deep_scrub_stamp":"2023-12-01T15:59:58.274135+0000","last_clean_scrub_stamp":"2023-12-01T15:59:58.274135+0000","objects_scrubbed":7,"log_size":5643,"log_dups_size":0,"ondisk_log_size":5643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:27:01.882725+0000","scrub_duration":0.087623041999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5940,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1000,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3526","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.595185+0000","last_change":"2023-12-01T15:59:54.595288+0000","last_active":"2023-12-01T15:59:54.595185+0000","last_peered":"2023-12-01T15:59:54.595185+0000","last_clean":"2023-12-01T15:59:54.595185+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:59:54.595185+0000","last_undegraded":"2023-12-01T15:59:54.595185+0000","last_fullsized":"2023-12-01T15:59:54.595185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3526","last_scrub_stamp":"2023-12-01T15:59:54.595164+0000","last_deep_scrub":"44'3526","last_deep_scrub_stamp":"2023-12-01T15:59:54.595164+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.595164+0000","objects_scrubbed":1,"log_size":3526,"log_dups_size":0,"ondisk_log_size":3526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:27.589168+0000","scrub_duration":0.038520889000000003,"objects_trimmed":0,"snaptrim_duration":0.134288985,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"39'3426","reported_seq":3471,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.719726+0000","last_change":"2023-12-01T15:43:45.208256+0000","last_active":"2023-12-01T15:59:44.719726+0000","last_peered":"2023-12-01T15:59:44.719726+0000","last_clean":"2023-12-01T15:59:44.719726+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T15:59:44.719726+0000","last_undegraded":"2023-12-01T15:59:44.719726+0000","last_fullsized":"2023-12-01T15:59:44.719726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3411,"num_write_kb":30086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4050","reported_seq":3342,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.042179+0000","last_change":"2023-12-01T15:59:54.042427+0000","last_active":"2023-12-01T15:59:54.042179+0000","last_peered":"2023-12-01T15:59:54.042179+0000","last_clean":"2023-12-01T15:59:54.042179+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:59:54.042179+0000","last_undegraded":"2023-12-01T15:59:54.042179+0000","last_fullsized":"2023-12-01T15:59:54.042179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4050","last_scrub_stamp":"2023-12-01T15:59:54.042107+0000","last_deep_scrub":"44'4050","last_deep_scrub_stamp":"2023-12-01T15:59:54.042107+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.042107+0000","objects_scrubbed":3,"log_size":4050,"log_dups_size":0,"ondisk_log_size":4050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:49:35.606734+0000","scrub_duration":0.048885451000000003,"objects_trimmed":0,"snaptrim_duration":0.091841191000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"39'1803","reported_seq":1848,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.719778+0000","last_change":"2023-12-01T15:43:45.204599+0000","last_active":"2023-12-01T15:59:44.719778+0000","last_peered":"2023-12-01T15:59:44.719778+0000","last_clean":"2023-12-01T15:59:44.719778+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T15:59:44.719778+0000","last_undegraded":"2023-12-01T15:59:44.719778+0000","last_fullsized":"2023-12-01T15:59:44.719778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1803,"log_dups_size":0,"ondisk_log_size":1803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1812,"num_write_kb":15324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":76140,"num_write_kb":40588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225554,"ondisk_log_size":225554,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":277882502,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":223,"num_read_kb":3419,"num_write":76837,"num_write_kb":641165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278539,"num_omap_keys":10516,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":555827200,"data_stored":555765004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76435,"ondisk_log_size":76435,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705870,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":682768,"kb_used_data":134088,"kb_used_omap":0,"kb_used_meta":548672,"kb_avail":93689072,"statfs":{"total":96636764160,"available":95937609728,"internally_reserved":0,"allocated":137306112,"data_stored":136947550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":561840128},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 16:00:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":0.78700000000000003,"15min":0.65900000000000003},"min":{"1min":0.37,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":8.3049999999999997,"5min":10.84,"15min":10.84},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96199999999999997,"15min":0.72699999999999998},"min":{"1min":0.47199999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.2320000000000002,"5min":11.926,"15min":11.926},"last":0.629}]},{"osd":1,"last update":"Fri Dec 1 16:00:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":0.81000000000000005,"15min":0.68700000000000006},"min":{"1min":0.372,"5min":0.246,"15min":0.246},"max":{"1min":8.3399999999999999,"5min":10.807,"15min":10.807},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.86099999999999999,"5min":3.552,"15min":3.552},"last":0.68799999999999994}]},{"osd":2,"last update":"Fri Dec 1 16:00:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.79600000000000004,"15min":0.64400000000000002},"min":{"1min":0.45900000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":5.0419999999999998,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.751,"15min":0.66100000000000003},"min":{"1min":0.46100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.4039999999999999,"5min":10.715999999999999,"15min":10.715999999999999},"last":0.51200000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705871,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":801892,"kb_used_data":157276,"kb_used_omap":0,"kb_used_meta":644608,"kb_avail":93569948,"statfs":{"total":96636764160,"available":95815626752,"internally_reserved":0,"allocated":161050624,"data_stored":160683934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":660078592},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69699999999999995,"15min":0.66300000000000003},"min":{"1min":0.23599999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.83199999999999996,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60699999999999998,"15min":0.64900000000000002},"min":{"1min":0.316,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75800000000000001,"5min":0.91200000000000003,"15min":2.657},"last":0.80700000000000005}]},{"osd":1,"last update":"Fri Dec 1 15:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.69099999999999995,"15min":0.65800000000000003},"min":{"1min":0.26300000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.81799999999999995,"5min":8.0779999999999994,"15min":8.0779999999999994},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.39800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.77300000000000002,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.77000000000000002}]},{"osd":3,"last update":"Fri Dec 1 15:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.55800000000000005},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61599999999999999,"5min":2.048,"15min":7.5289999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.70699999999999996,"15min":0.66200000000000003},"min":{"1min":0.29799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.92400000000000004,"5min":8.0370000000000008,"15min":9.8949999999999996},"last":0.72499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705870,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589244,"kb_used_data":98868,"kb_used_omap":0,"kb_used_meta":490368,"kb_avail":93782596,"statfs":{"total":96636764160,"available":96033378304,"internally_reserved":0,"allocated":101240832,"data_stored":100906009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502136832},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 16:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.504},"min":{"1min":0.192,"5min":0.17399999999999999,"15min":0.17299999999999999},"max":{"1min":0.70899999999999996,"5min":0.749,"15min":8.4589999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.52000000000000002,"15min":0.53600000000000003},"min":{"1min":0.26800000000000002,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":0.65800000000000003,"5min":1.669,"15min":1.7729999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Dec 1 16:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.76300000000000001,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.625,"15min":0.67500000000000004},"min":{"1min":0.35399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74299999999999999,"5min":2.6640000000000001,"15min":10.914999999999999},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Dec 1 16:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.66100000000000003},"min":{"1min":0.33800000000000002,"5min":0.28100000000000003,"15min":0.251},"max":{"1min":0.80400000000000005,"5min":1.641,"15min":1.641},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70999999999999996,"15min":0.69899999999999995},"min":{"1min":0.52900000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88500000000000001,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.78200000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705870,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814568,"kb_used_data":156000,"kb_used_omap":0,"kb_used_meta":658560,"kb_avail":93557272,"statfs":{"total":96636764160,"available":95802646528,"internally_reserved":0,"allocated":159744000,"data_stored":159387283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":674365440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 16:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.65700000000000003,"5min":1.595,"15min":1.595},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.622},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.92400000000000004,"5min":3.3639999999999999,"15min":30.995000000000001},"last":0.504}]},{"osd":2,"last update":"Fri Dec 1 16:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.62,"15min":0.72399999999999998},"min":{"1min":0.29799999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.0569999999999999,"5min":1.5069999999999999,"15min":24.504000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65200000000000002,"15min":0.75600000000000001},"min":{"1min":0.32100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0229999999999999,"5min":1.526,"15min":24.524999999999999},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Dec 1 16:00:03 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.31,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":10.250999999999999,"5min":10.250999999999999,"15min":31.038},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.194,"5min":0.73999999999999999,"15min":0.72799999999999998},"min":{"1min":0.34399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":10.209,"5min":10.209,"15min":10.209},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":158564352,"data_stored":158550118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":160464896,"data_stored":160441193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":136134656,"data_stored":136110397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T16:00:27.277 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.278 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.278 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.278 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.278 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.279 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.279 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.279 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.279 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.279 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.280 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.280 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.280 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.280 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.280 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.281 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.281 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.281 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.281 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.282 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.282 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.282 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.282 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.282 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.283 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.283 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.283 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.283 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.283 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.284 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.284 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.284 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.284 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.285 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.285 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-01T15:43:34.700727+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=34, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.285 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.285 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.285 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.285 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.286 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.286 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.286 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.286 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.289 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.289 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.290 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.290 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.290 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.291 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:27.291 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-01T16:00:47.292 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T16:00:47.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981c83a700 1 Processor -- start 2023-12-01T16:00:47.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981c83a700 1 -- start start 2023-12-01T16:00:47.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981c83a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f981813b330 0x7f9818137790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:47.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981c83a700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9818137cd0 0x7f9818142970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:47.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981c83a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98180a4b20 con 0x7f981813af50 2023-12-01T16:00:47.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981c83a700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98180a3540 con 0x7f9818137cd0 2023-12-01T16:00:47.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981c83a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98180a3880 con 0x7f981813b330 2023-12-01T16:00:47.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9818137cd0 0x7f9818142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:47.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981759e700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9818137cd0 0x7f9818142970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60538/0 (socket says 172.21.15.63:60538) 2023-12-01T16:00:47.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981759e700 1 -- 172.21.15.63:0/1467776805 learned_addr learned my addr 172.21.15.63:0/1467776805 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:00:47.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981659c700 1 --2- 172.21.15.63:0/1467776805 >> v2:172.21.15.66:3300/0 conn(0x7f981813b330 0x7f9818137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:47.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981759e700 1 -- 172.21.15.63:0/1467776805 >> v2:172.21.15.66:3300/0 conn(0x7f981813b330 msgr2=0x7f9818137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:00:47.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.403+0000 7f981759e700 1 --2- 172.21.15.63:0/1467776805 >> v2:172.21.15.66:3300/0 conn(0x7f981813b330 0x7f9818137790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:47.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981759e700 1 -- 172.21.15.63:0/1467776805 >> v1:172.21.15.66:6789/0 conn(0x7f981813af50 legacy=0x7f9818137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:47.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981759e700 1 -- 172.21.15.63:0/1467776805 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98180a3270 con 0x7f9818137cd0 2023-12-01T16:00:47.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981759e700 1 --2- 172.21.15.63:0/1467776805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9818137cd0 0x7f9818142970 secure :-1 s=READY pgs=2960 cs=0 l=1 rev1=1 crypto rx=0x7f9810009e50 tx=0x7f981000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c806a53c387cd502 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:00:47.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f9815d9b700 1 -- 172.21.15.63:0/1467776805 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000e070 con 0x7f9818137cd0 2023-12-01T16:00:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f9815d9b700 1 -- 172.21.15.63:0/1467776805 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981000b980 con 0x7f9818137cd0 2023-12-01T16:00:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f9815d9b700 1 -- 172.21.15.63:0/1467776805 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000bd30 con 0x7f9818137cd0 2023-12-01T16:00:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 -- 172.21.15.63:0/1467776805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9818137cd0 msgr2=0x7f9818142970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 --2- 172.21.15.63:0/1467776805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9818137cd0 0x7f9818142970 secure :-1 s=READY pgs=2960 cs=0 l=1 rev1=1 crypto rx=0x7f9810009e50 tx=0x7f981000b330 comp rx=0 tx=0).stop 2023-12-01T16:00:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 -- 172.21.15.63:0/1467776805 shutdown_connections 2023-12-01T16:00:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 --2- 172.21.15.63:0/1467776805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9818137cd0 0x7f9818142970 unknown :-1 s=CLOSED pgs=2960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 --2- 172.21.15.63:0/1467776805 >> v2:172.21.15.66:3300/0 conn(0x7f981813b330 0x7f9818137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 -- 172.21.15.63:0/1467776805 >> 172.21.15.63:0/1467776805 conn(0x7f98180a8bd0 msgr2=0x7f9818098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:00:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 -- 172.21.15.63:0/1467776805 shutdown_connections 2023-12-01T16:00:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 -- 172.21.15.63:0/1467776805 wait complete. 2023-12-01T16:00:47.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 Processor -- start 2023-12-01T16:00:47.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 -- start start 2023-12-01T16:00:47.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9818137cd0 0x7f98181338d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:47.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f981813af50 0x7f9818133e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:47.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98181cf7a0 0x7f98181cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:47.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9818071e20 con 0x7f9818137cd0 2023-12-01T16:00:47.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9818120070 con 0x7f981813af50 2023-12-01T16:00:47.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981c83a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98180721d0 con 0x7f98181cf7a0 2023-12-01T16:00:47.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f9816d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9818137cd0 0x7f98181338d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:47.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98181cf7a0 0x7f98181cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:47.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f981659c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f981813af50 0x7f9818133e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:47.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f9816d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9818137cd0 0x7f98181338d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60548/0 (socket says 172.21.15.63:60548) 2023-12-01T16:00:47.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f9816d9d700 1 -- 172.21.15.63:0/2879266444 learned_addr learned my addr 172.21.15.63:0/2879266444 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:00:47.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f9816d9d700 1 -- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98181cf7a0 msgr2=0x7f98181cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:47.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f9816d9d700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98181cf7a0 0x7f98181cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:47.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f9816d9d700 1 -- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f981813af50 msgr2=0x7f9818133e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:47.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.407+0000 7f9816d9d700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f981813af50 0x7f9818133e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:47.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.411+0000 7f9816d9d700 1 -- 172.21.15.63:0/2879266444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009b30 con 0x7f9818137cd0 2023-12-01T16:00:47.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.411+0000 7f9816d9d700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9818137cd0 0x7f98181338d0 secure :-1 s=READY pgs=2961 cs=0 l=1 rev1=1 crypto rx=0x7f980800c500 tx=0x7f980800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:00:47.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.411+0000 7f97ff7fe700 1 -- 172.21.15.63:0/2879266444 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080052d0 con 0x7f9818137cd0 2023-12-01T16:00:47.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.411+0000 7f97ff7fe700 1 -- 172.21.15.63:0/2879266444 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808005430 con 0x7f9818137cd0 2023-12-01T16:00:47.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.411+0000 7f981c83a700 1 -- 172.21.15.63:0/2879266444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98180714d0 con 0x7f9818137cd0 2023-12-01T16:00:47.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.411+0000 7f97ff7fe700 1 -- 172.21.15.63:0/2879266444 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080055a0 con 0x7f9818137cd0 2023-12-01T16:00:47.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.411+0000 7f981c83a700 1 -- 172.21.15.63:0/2879266444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981811f010 con 0x7f9818137cd0 2023-12-01T16:00:47.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.411+0000 7f981c83a700 1 -- 172.21.15.63:0/2879266444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9818065f70 con 0x7f9818137cd0 2023-12-01T16:00:47.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.415+0000 7f97ff7fe700 1 -- 172.21.15.63:0/2879266444 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f98080036a0 con 0x7f9818137cd0 2023-12-01T16:00:47.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.415+0000 7f97ff7fe700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9804065ad0 0x7f9804067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:00:47.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.415+0000 7f97ff7fe700 1 -- 172.21.15.63:0/2879266444 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7f9808081c90 con 0x7f9818137cd0 2023-12-01T16:00:47.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.415+0000 7f981659c700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9804065ad0 0x7f9804067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:00:47.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.415+0000 7f981659c700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9804065ad0 0x7f9804067f90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9818071d40 tx=0x7f980c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:00:47.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.419+0000 7f97ff7fe700 1 -- 172.21.15.63:0/2879266444 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f980804fb80 con 0x7f9818137cd0 2023-12-01T16:00:47.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.579+0000 7f981c83a700 1 -- 172.21.15.63:0/2879266444 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f981813aab0 con 0x7f9804065ad0 2023-12-01T16:00:47.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.599+0000 7f97ff7fe700 1 -- 172.21.15.63:0/2879266444 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280720 (secure 0 0 0) 0x7f980c010710 con 0x7f9804065ad0 2023-12-01T16:00:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T16:00:47.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 -- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9804065ad0 msgr2=0x7f9804067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:47.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9804065ad0 0x7f9804067f90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9818071d40 tx=0x7f980c008040 comp rx=0 tx=0).stop 2023-12-01T16:00:47.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 -- 172.21.15.63:0/2879266444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9818137cd0 msgr2=0x7f98181338d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:00:47.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9818137cd0 0x7f98181338d0 secure :-1 s=READY pgs=2961 cs=0 l=1 rev1=1 crypto rx=0x7f980800c500 tx=0x7f980800c810 comp rx=0 tx=0).stop 2023-12-01T16:00:47.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 -- 172.21.15.63:0/2879266444 shutdown_connections 2023-12-01T16:00:47.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f9804065ad0 0x7f9804067f90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:47.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98181cf7a0 0x7f98181cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:47.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f981813af50 0x7f9818133e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:47.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 --2- 172.21.15.63:0/2879266444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9818137cd0 0x7f98181338d0 unknown :-1 s=CLOSED pgs=2961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:00:47.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 -- 172.21.15.63:0/2879266444 >> 172.21.15.63:0/2879266444 conn(0x7f98180a8bd0 msgr2=0x7f9818098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:00:47.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 -- 172.21.15.63:0/2879266444 shutdown_connections 2023-12-01T16:00:47.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:00:47.603+0000 7f981c83a700 1 -- 172.21.15.63:0/2879266444 wait complete. 2023-12-01T16:00:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T16:00:47.634 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2023-12-01T16:00:46.724732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":278600058,"num_objects":242,"num_object_clones":28,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":15,"num_read":370,"num_read_kb":3540,"num_write":153136,"num_write_kb":684169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5310321,"num_omap_keys":10576,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302160,"ondisk_log_size":302160,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":2892568,"kb_used_data":546232,"kb_used_omap":0,"kb_used_meta":2346304,"kb_avail":374594792,"statfs":{"total":386547056640,"available":383585067008,"internally_reserved":0,"allocated":559341568,"data_stored":557924776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2402615296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26782,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004685"},"pg_stats":[{"pgid":"4.3f","version":"43'3303","reported_seq":2800,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.720152+0000","last_change":"2023-12-01T15:59:36.960583+0000","last_active":"2023-12-01T15:59:44.720152+0000","last_peered":"2023-12-01T15:59:44.720152+0000","last_clean":"2023-12-01T15:59:44.720152+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:59:44.720152+0000","last_undegraded":"2023-12-01T15:59:44.720152+0000","last_fullsized":"2023-12-01T15:59:44.720152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13670799,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"44'3497","reported_seq":2969,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:37.162739+0000","last_change":"2023-12-01T16:00:37.162955+0000","last_active":"2023-12-01T16:00:37.162739+0000","last_peered":"2023-12-01T16:00:37.162739+0000","last_clean":"2023-12-01T16:00:37.162739+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T16:00:37.162739+0000","last_undegraded":"2023-12-01T16:00:37.162739+0000","last_fullsized":"2023-12-01T16:00:37.162739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3497","last_scrub_stamp":"2023-12-01T16:00:37.162676+0000","last_deep_scrub":"44'3497","last_deep_scrub_stamp":"2023-12-01T16:00:37.162676+0000","last_clean_scrub_stamp":"2023-12-01T16:00:37.162676+0000","objects_scrubbed":1,"log_size":3497,"log_dups_size":0,"ondisk_log_size":3497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:47:58.369574+0000","scrub_duration":0.043835766999999998,"objects_trimmed":0,"snaptrim_duration":0.085048589999999993,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'3434","reported_seq":2898,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174865+0000","last_change":"2023-12-01T15:59:36.980200+0000","last_active":"2023-12-01T15:59:46.174865+0000","last_peered":"2023-12-01T15:59:46.174865+0000","last_clean":"2023-12-01T15:59:46.174865+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:59:46.174865+0000","last_undegraded":"2023-12-01T15:59:46.174865+0000","last_fullsized":"2023-12-01T15:59:46.174865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15483981599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"44'3688","reported_seq":3053,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.948071+0000","last_change":"2023-12-01T15:59:46.948071+0000","last_active":"2023-12-01T15:59:46.948071+0000","last_peered":"2023-12-01T15:59:46.948071+0000","last_clean":"2023-12-01T15:59:46.948071+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:59:46.948071+0000","last_undegraded":"2023-12-01T15:59:46.948071+0000","last_fullsized":"2023-12-01T15:59:46.948071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3688","last_scrub_stamp":"2023-12-01T15:59:46.947938+0000","last_deep_scrub":"44'3688","last_deep_scrub_stamp":"2023-12-01T15:59:46.947938+0000","last_clean_scrub_stamp":"2023-12-01T15:59:46.947938+0000","objects_scrubbed":1,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:14:57.265242+0000","scrub_duration":0.050574905000000003,"objects_trimmed":0,"snaptrim_duration":0.086572531999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"43'3485","reported_seq":2918,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.481658+0000","last_change":"2023-12-01T15:59:36.962909+0000","last_active":"2023-12-01T15:59:43.481658+0000","last_peered":"2023-12-01T15:59:43.481658+0000","last_clean":"2023-12-01T15:59:43.481658+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T15:59:43.481658+0000","last_undegraded":"2023-12-01T15:59:43.481658+0000","last_fullsized":"2023-12-01T15:59:43.481658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13014335599999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'3421","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:10.244937+0000","last_change":"2023-12-01T16:00:10.245065+0000","last_active":"2023-12-01T16:00:10.244937+0000","last_peered":"2023-12-01T16:00:10.244937+0000","last_clean":"2023-12-01T16:00:10.244937+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T16:00:10.244937+0000","last_undegraded":"2023-12-01T16:00:10.244937+0000","last_fullsized":"2023-12-01T16:00:10.244937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3421","last_scrub_stamp":"2023-12-01T16:00:10.244912+0000","last_deep_scrub":"44'3421","last_deep_scrub_stamp":"2023-12-01T16:00:10.244912+0000","last_clean_scrub_stamp":"2023-12-01T16:00:10.244912+0000","objects_scrubbed":2,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:05.632092+0000","scrub_duration":0.052734889,"objects_trimmed":0,"snaptrim_duration":0.133828119,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"44'3768","reported_seq":3234,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:26.267026+0000","last_change":"2023-12-01T16:00:26.267141+0000","last_active":"2023-12-01T16:00:26.267026+0000","last_peered":"2023-12-01T16:00:26.267026+0000","last_clean":"2023-12-01T16:00:26.267026+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T16:00:26.267026+0000","last_undegraded":"2023-12-01T16:00:26.267026+0000","last_fullsized":"2023-12-01T16:00:26.267026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3768","last_scrub_stamp":"2023-12-01T16:00:26.267005+0000","last_deep_scrub":"44'3768","last_deep_scrub_stamp":"2023-12-01T16:00:26.267005+0000","last_clean_scrub_stamp":"2023-12-01T16:00:26.267005+0000","objects_scrubbed":4,"log_size":3768,"log_dups_size":0,"ondisk_log_size":3768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:47:15.591358+0000","scrub_duration":0.046986235000000001,"objects_trimmed":0,"snaptrim_duration":0.16251290900000001,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'3433","reported_seq":2838,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477401+0000","last_change":"2023-12-01T15:59:36.975843+0000","last_active":"2023-12-01T15:59:43.477401+0000","last_peered":"2023-12-01T15:59:43.477401+0000","last_clean":"2023-12-01T15:59:43.477401+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:59:43.477401+0000","last_undegraded":"2023-12-01T15:59:43.477401+0000","last_fullsized":"2023-12-01T15:59:43.477401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3433,"log_dups_size":0,"ondisk_log_size":3433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.173046373,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"43'3524","reported_seq":2943,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479316+0000","last_change":"2023-12-01T15:59:36.960250+0000","last_active":"2023-12-01T15:59:43.479316+0000","last_peered":"2023-12-01T15:59:43.479316+0000","last_clean":"2023-12-01T15:59:43.479316+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:59:43.479316+0000","last_undegraded":"2023-12-01T15:59:43.479316+0000","last_fullsized":"2023-12-01T15:59:43.479316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13648046599999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'3320","reported_seq":2811,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174591+0000","last_change":"2023-12-01T15:59:36.978454+0000","last_active":"2023-12-01T15:59:46.174591+0000","last_peered":"2023-12-01T15:59:46.174591+0000","last_clean":"2023-12-01T15:59:46.174591+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:59:46.174591+0000","last_undegraded":"2023-12-01T15:59:46.174591+0000","last_fullsized":"2023-12-01T15:59:46.174591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.160523057,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"44'3408","reported_seq":2882,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.074578+0000","last_change":"2023-12-01T15:59:56.074578+0000","last_active":"2023-12-01T15:59:56.074578+0000","last_peered":"2023-12-01T15:59:56.074578+0000","last_clean":"2023-12-01T15:59:56.074578+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:59:56.074578+0000","last_undegraded":"2023-12-01T15:59:56.074578+0000","last_fullsized":"2023-12-01T15:59:56.074578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3408","last_scrub_stamp":"2023-12-01T15:59:56.074209+0000","last_deep_scrub":"44'3408","last_deep_scrub_stamp":"2023-12-01T15:59:56.074209+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.074209+0000","objects_scrubbed":1,"log_size":3408,"log_dups_size":0,"ondisk_log_size":3408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:17.450625+0000","scrub_duration":0.044446310000000003,"objects_trimmed":0,"snaptrim_duration":0.080275320999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"43'3529","reported_seq":2904,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:45.205193+0000","last_change":"2023-12-01T15:59:37.474340+0000","last_active":"2023-12-01T15:59:45.205193+0000","last_peered":"2023-12-01T15:59:45.205193+0000","last_clean":"2023-12-01T15:59:45.205193+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T15:59:45.205193+0000","last_undegraded":"2023-12-01T15:59:45.205193+0000","last_fullsized":"2023-12-01T15:59:45.205193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.63957533600000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"43'3178","reported_seq":2651,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.720167+0000","last_change":"2023-12-01T15:59:36.959529+0000","last_active":"2023-12-01T15:59:44.720167+0000","last_peered":"2023-12-01T15:59:44.720167+0000","last_clean":"2023-12-01T15:59:44.720167+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T15:59:44.720167+0000","last_undegraded":"2023-12-01T15:59:44.720167+0000","last_fullsized":"2023-12-01T15:59:44.720167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3178,"log_dups_size":0,"ondisk_log_size":3178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138334033,"stat_sum":{"num_bytes":12297,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"43'3508","reported_seq":2945,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.031371+0000","last_change":"2023-12-01T16:00:23.031526+0000","last_active":"2023-12-01T16:00:23.031371+0000","last_peered":"2023-12-01T16:00:23.031371+0000","last_clean":"2023-12-01T16:00:23.031371+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T16:00:23.031371+0000","last_undegraded":"2023-12-01T16:00:23.031371+0000","last_fullsized":"2023-12-01T16:00:23.031371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3508","last_scrub_stamp":"2023-12-01T16:00:23.031325+0000","last_deep_scrub":"43'3508","last_deep_scrub_stamp":"2023-12-01T16:00:23.031325+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.031325+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:08.388208+0000","scrub_duration":0.040441997,"objects_trimmed":0,"snaptrim_duration":0.091404182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"44'3602","reported_seq":3022,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:41.172312+0000","last_change":"2023-12-01T16:00:41.172431+0000","last_active":"2023-12-01T16:00:41.172312+0000","last_peered":"2023-12-01T16:00:41.172312+0000","last_clean":"2023-12-01T16:00:41.172312+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T16:00:41.172312+0000","last_undegraded":"2023-12-01T16:00:41.172312+0000","last_fullsized":"2023-12-01T16:00:41.172312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3602","last_scrub_stamp":"2023-12-01T16:00:41.172283+0000","last_deep_scrub":"44'3602","last_deep_scrub_stamp":"2023-12-01T16:00:41.172283+0000","last_clean_scrub_stamp":"2023-12-01T16:00:41.172283+0000","objects_scrubbed":2,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:06.910819+0000","scrub_duration":0.043202600000000001,"objects_trimmed":0,"snaptrim_duration":0.086861997999999996,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1247,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"44'3536","reported_seq":2958,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:35.372431+0000","last_change":"2023-12-01T16:00:35.372603+0000","last_active":"2023-12-01T16:00:35.372431+0000","last_peered":"2023-12-01T16:00:35.372431+0000","last_clean":"2023-12-01T16:00:35.372431+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T16:00:35.372431+0000","last_undegraded":"2023-12-01T16:00:35.372431+0000","last_fullsized":"2023-12-01T16:00:35.372431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3536","last_scrub_stamp":"2023-12-01T16:00:35.372401+0000","last_deep_scrub":"44'3536","last_deep_scrub_stamp":"2023-12-01T16:00:35.372401+0000","last_clean_scrub_stamp":"2023-12-01T16:00:35.372401+0000","objects_scrubbed":3,"log_size":3536,"log_dups_size":0,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:06:41.936183+0000","scrub_duration":0.066751594999999997,"objects_trimmed":0,"snaptrim_duration":0.17327173600000001,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"43'3588","reported_seq":2966,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.719907+0000","last_change":"2023-12-01T15:59:36.959847+0000","last_active":"2023-12-01T15:59:44.719907+0000","last_peered":"2023-12-01T15:59:44.719907+0000","last_clean":"2023-12-01T15:59:44.719907+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T15:59:44.719907+0000","last_undegraded":"2023-12-01T15:59:44.719907+0000","last_fullsized":"2023-12-01T15:59:44.719907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13630616600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'3287","reported_seq":2802,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:20.266022+0000","last_change":"2023-12-01T16:00:20.266155+0000","last_active":"2023-12-01T16:00:20.266022+0000","last_peered":"2023-12-01T16:00:20.266022+0000","last_clean":"2023-12-01T16:00:20.266022+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T16:00:20.266022+0000","last_undegraded":"2023-12-01T16:00:20.266022+0000","last_fullsized":"2023-12-01T16:00:20.266022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3287","last_scrub_stamp":"2023-12-01T16:00:20.265995+0000","last_deep_scrub":"44'3287","last_deep_scrub_stamp":"2023-12-01T16:00:20.265995+0000","last_clean_scrub_stamp":"2023-12-01T16:00:20.265995+0000","objects_scrubbed":5,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:05.049698+0000","scrub_duration":0.052120284000000003,"objects_trimmed":0,"snaptrim_duration":0.159652814,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1044,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"43'3337","reported_seq":2778,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478741+0000","last_change":"2023-12-01T15:59:36.954938+0000","last_active":"2023-12-01T15:59:43.478741+0000","last_peered":"2023-12-01T15:59:43.478741+0000","last_clean":"2023-12-01T15:59:43.478741+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T15:59:43.478741+0000","last_undegraded":"2023-12-01T15:59:43.478741+0000","last_fullsized":"2023-12-01T15:59:43.478741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134439324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"43'3655","reported_seq":3092,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477915+0000","last_change":"2023-12-01T15:59:36.963898+0000","last_active":"2023-12-01T15:59:43.477915+0000","last_peered":"2023-12-01T15:59:43.477915+0000","last_clean":"2023-12-01T15:59:43.477915+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:59:43.477915+0000","last_undegraded":"2023-12-01T15:59:43.477915+0000","last_fullsized":"2023-12-01T15:59:43.477915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3655,"log_dups_size":0,"ondisk_log_size":3655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16502647100000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"43'3592","reported_seq":3041,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:36.187374+0000","last_change":"2023-12-01T16:00:36.187561+0000","last_active":"2023-12-01T16:00:36.187374+0000","last_peered":"2023-12-01T16:00:36.187374+0000","last_clean":"2023-12-01T16:00:36.187374+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T16:00:36.187374+0000","last_undegraded":"2023-12-01T16:00:36.187374+0000","last_fullsized":"2023-12-01T16:00:36.187374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3592","last_scrub_stamp":"2023-12-01T16:00:36.187327+0000","last_deep_scrub":"43'3592","last_deep_scrub_stamp":"2023-12-01T16:00:36.187327+0000","last_clean_scrub_stamp":"2023-12-01T16:00:36.187327+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:15.645932+0000","scrub_duration":0.049762045999999997,"objects_trimmed":0,"snaptrim_duration":0.082049368999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"43'3494","reported_seq":2868,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477650+0000","last_change":"2023-12-01T15:59:36.954854+0000","last_active":"2023-12-01T15:59:43.477650+0000","last_peered":"2023-12-01T15:59:43.477650+0000","last_clean":"2023-12-01T15:59:43.477650+0000","last_became_active":"2023-12-01T15:44:30.528283+0000","last_became_peered":"2023-12-01T15:44:30.528283+0000","last_unstale":"2023-12-01T15:59:43.477650+0000","last_undegraded":"2023-12-01T15:59:43.477650+0000","last_fullsized":"2023-12-01T15:59:43.477650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3494,"log_dups_size":0,"ondisk_log_size":3494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13495370100000001,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'3469","reported_seq":2938,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:43.353888+0000","last_change":"2023-12-01T16:00:43.354064+0000","last_active":"2023-12-01T16:00:43.353888+0000","last_peered":"2023-12-01T16:00:43.353888+0000","last_clean":"2023-12-01T16:00:43.353888+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T16:00:43.353888+0000","last_undegraded":"2023-12-01T16:00:43.353888+0000","last_fullsized":"2023-12-01T16:00:43.353888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3469","last_scrub_stamp":"2023-12-01T16:00:43.353860+0000","last_deep_scrub":"44'3469","last_deep_scrub_stamp":"2023-12-01T16:00:43.353860+0000","last_clean_scrub_stamp":"2023-12-01T16:00:43.353860+0000","objects_scrubbed":3,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:09.092397+0000","scrub_duration":0.046109907999999998,"objects_trimmed":0,"snaptrim_duration":0.62816057700000005,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"44'3578","reported_seq":2961,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:55.212242+0000","last_change":"2023-12-01T15:59:55.212383+0000","last_active":"2023-12-01T15:59:55.212242+0000","last_peered":"2023-12-01T15:59:55.212242+0000","last_clean":"2023-12-01T15:59:55.212242+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:59:55.212242+0000","last_undegraded":"2023-12-01T15:59:55.212242+0000","last_fullsized":"2023-12-01T15:59:55.212242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3578","last_scrub_stamp":"2023-12-01T15:59:55.212209+0000","last_deep_scrub":"44'3578","last_deep_scrub_stamp":"2023-12-01T15:59:55.212209+0000","last_clean_scrub_stamp":"2023-12-01T15:59:55.212209+0000","objects_scrubbed":1,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:16.402349+0000","scrub_duration":0.042530062,"objects_trimmed":0,"snaptrim_duration":0.17330785400000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"44'3345","reported_seq":2835,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:38.376718+0000","last_change":"2023-12-01T16:00:38.376863+0000","last_active":"2023-12-01T16:00:38.376718+0000","last_peered":"2023-12-01T16:00:38.376718+0000","last_clean":"2023-12-01T16:00:38.376718+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T16:00:38.376718+0000","last_undegraded":"2023-12-01T16:00:38.376718+0000","last_fullsized":"2023-12-01T16:00:38.376718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3345","last_scrub_stamp":"2023-12-01T16:00:38.376670+0000","last_deep_scrub":"44'3345","last_deep_scrub_stamp":"2023-12-01T16:00:38.376670+0000","last_clean_scrub_stamp":"2023-12-01T16:00:38.376670+0000","objects_scrubbed":1,"log_size":3345,"log_dups_size":0,"ondisk_log_size":3345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:17.835274+0000","scrub_duration":0.046600474000000003,"objects_trimmed":0,"snaptrim_duration":0.63729295699999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"44'3413","reported_seq":2877,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:41.365937+0000","last_change":"2023-12-01T16:00:41.366080+0000","last_active":"2023-12-01T16:00:41.365937+0000","last_peered":"2023-12-01T16:00:41.365937+0000","last_clean":"2023-12-01T16:00:41.365937+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T16:00:41.365937+0000","last_undegraded":"2023-12-01T16:00:41.365937+0000","last_fullsized":"2023-12-01T16:00:41.365937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3413","last_scrub_stamp":"2023-12-01T16:00:41.365907+0000","last_deep_scrub":"44'3413","last_deep_scrub_stamp":"2023-12-01T16:00:41.365907+0000","last_clean_scrub_stamp":"2023-12-01T16:00:41.365907+0000","objects_scrubbed":2,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:06:47.929689+0000","scrub_duration":0.039734258000000001,"objects_trimmed":0,"snaptrim_duration":0.611917673,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'3318","reported_seq":2756,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:16.227798+0000","last_change":"2023-12-01T16:00:16.227914+0000","last_active":"2023-12-01T16:00:16.227798+0000","last_peered":"2023-12-01T16:00:16.227798+0000","last_clean":"2023-12-01T16:00:16.227798+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T16:00:16.227798+0000","last_undegraded":"2023-12-01T16:00:16.227798+0000","last_fullsized":"2023-12-01T16:00:16.227798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3318","last_scrub_stamp":"2023-12-01T16:00:16.227776+0000","last_deep_scrub":"44'3318","last_deep_scrub_stamp":"2023-12-01T16:00:16.227776+0000","last_clean_scrub_stamp":"2023-12-01T16:00:16.227776+0000","objects_scrubbed":6,"log_size":3318,"log_dups_size":0,"ondisk_log_size":3318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:57.976090+0000","scrub_duration":0.063500757000000005,"objects_trimmed":0,"snaptrim_duration":0.146734475,"stat_sum":{"num_bytes":4116,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'3312","reported_seq":2784,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:44.354510+0000","last_change":"2023-12-01T16:00:44.354616+0000","last_active":"2023-12-01T16:00:44.354510+0000","last_peered":"2023-12-01T16:00:44.354510+0000","last_clean":"2023-12-01T16:00:44.354510+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T16:00:44.354510+0000","last_undegraded":"2023-12-01T16:00:44.354510+0000","last_fullsized":"2023-12-01T16:00:44.354510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3312","last_scrub_stamp":"2023-12-01T16:00:44.354488+0000","last_deep_scrub":"43'3312","last_deep_scrub_stamp":"2023-12-01T16:00:44.354488+0000","last_clean_scrub_stamp":"2023-12-01T16:00:44.354488+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:32:49.581772+0000","scrub_duration":0.043847218,"objects_trimmed":0,"snaptrim_duration":0.65414528699999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"43'3662","reported_seq":3040,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.720145+0000","last_change":"2023-12-01T15:59:36.959770+0000","last_active":"2023-12-01T15:59:44.720145+0000","last_peered":"2023-12-01T15:59:44.720145+0000","last_clean":"2023-12-01T15:59:44.720145+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T15:59:44.720145+0000","last_undegraded":"2023-12-01T15:59:44.720145+0000","last_fullsized":"2023-12-01T15:59:44.720145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13835824199999999,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"44'3522","reported_seq":3006,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.187910+0000","last_change":"2023-12-01T15:59:48.187910+0000","last_active":"2023-12-01T15:59:48.187910+0000","last_peered":"2023-12-01T15:59:48.187910+0000","last_clean":"2023-12-01T15:59:48.187910+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:59:48.187910+0000","last_undegraded":"2023-12-01T15:59:48.187910+0000","last_fullsized":"2023-12-01T15:59:48.187910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3522","last_scrub_stamp":"2023-12-01T15:59:48.187580+0000","last_deep_scrub":"44'3522","last_deep_scrub_stamp":"2023-12-01T15:59:48.187580+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.187580+0000","objects_scrubbed":2,"log_size":3522,"log_dups_size":0,"ondisk_log_size":3522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:21.418682+0000","scrub_duration":0.049219767999999997,"objects_trimmed":0,"snaptrim_duration":0.13490588100000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"44'3995","reported_seq":3333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:26.522607+0000","last_change":"2023-12-01T16:00:26.522607+0000","last_active":"2023-12-01T16:00:26.522607+0000","last_peered":"2023-12-01T16:00:26.522607+0000","last_clean":"2023-12-01T16:00:26.522607+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T16:00:26.522607+0000","last_undegraded":"2023-12-01T16:00:26.522607+0000","last_fullsized":"2023-12-01T16:00:26.522607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3995","last_scrub_stamp":"2023-12-01T16:00:26.522403+0000","last_deep_scrub":"44'3995","last_deep_scrub_stamp":"2023-12-01T16:00:26.522403+0000","last_clean_scrub_stamp":"2023-12-01T16:00:26.522403+0000","objects_scrubbed":1,"log_size":3995,"log_dups_size":0,"ondisk_log_size":3995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:11.306106+0000","scrub_duration":0.045664127999999998,"objects_trimmed":0,"snaptrim_duration":0.65412195699999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"44'3597","reported_seq":3012,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:27.093419+0000","last_change":"2023-12-01T16:00:27.093419+0000","last_active":"2023-12-01T16:00:27.093419+0000","last_peered":"2023-12-01T16:00:27.093419+0000","last_clean":"2023-12-01T16:00:27.093419+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T16:00:27.093419+0000","last_undegraded":"2023-12-01T16:00:27.093419+0000","last_fullsized":"2023-12-01T16:00:27.093419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3597","last_scrub_stamp":"2023-12-01T16:00:27.093268+0000","last_deep_scrub":"44'3597","last_deep_scrub_stamp":"2023-12-01T16:00:27.093268+0000","last_clean_scrub_stamp":"2023-12-01T16:00:27.093268+0000","objects_scrubbed":5,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:25:51.950070+0000","scrub_duration":0.053776247999999999,"objects_trimmed":0,"snaptrim_duration":0.090414480000000005,"stat_sum":{"num_bytes":4118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"44'3662","reported_seq":3075,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:58.388349+0000","last_change":"2023-12-01T15:59:58.388349+0000","last_active":"2023-12-01T15:59:58.388349+0000","last_peered":"2023-12-01T15:59:58.388349+0000","last_clean":"2023-12-01T15:59:58.388349+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:59:58.388349+0000","last_undegraded":"2023-12-01T15:59:58.388349+0000","last_fullsized":"2023-12-01T15:59:58.388349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3662","last_scrub_stamp":"2023-12-01T15:59:58.388055+0000","last_deep_scrub":"44'3662","last_deep_scrub_stamp":"2023-12-01T15:59:58.388055+0000","last_clean_scrub_stamp":"2023-12-01T15:59:58.388055+0000","objects_scrubbed":1,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:31.619158+0000","scrub_duration":0.048690542000000003,"objects_trimmed":0,"snaptrim_duration":0.646838511,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"44'2737","reported_seq":2792,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:32.335426+0000","last_change":"2023-12-01T16:00:32.335578+0000","last_active":"2023-12-01T16:00:32.335426+0000","last_peered":"2023-12-01T16:00:32.335426+0000","last_clean":"2023-12-01T16:00:32.335426+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T16:00:32.335426+0000","last_undegraded":"2023-12-01T16:00:32.335426+0000","last_fullsized":"2023-12-01T16:00:32.335426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2737","last_scrub_stamp":"2023-12-01T16:00:32.335394+0000","last_deep_scrub":"44'2737","last_deep_scrub_stamp":"2023-12-01T16:00:32.335394+0000","last_clean_scrub_stamp":"2023-12-01T16:00:32.335394+0000","objects_scrubbed":3,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:11.793999+0000","scrub_duration":0.040503364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2729,"num_write_kb":18350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"43'3426","reported_seq":2846,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174811+0000","last_change":"2023-12-01T15:59:36.979597+0000","last_active":"2023-12-01T15:59:46.174811+0000","last_peered":"2023-12-01T15:59:46.174811+0000","last_clean":"2023-12-01T15:59:46.174811+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:59:46.174811+0000","last_undegraded":"2023-12-01T15:59:46.174811+0000","last_fullsized":"2023-12-01T15:59:46.174811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15458043599999999,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"35'5","reported_seq":60,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:36.838471+0000","last_change":"2023-12-01T16:00:36.838731+0000","last_active":"2023-12-01T16:00:36.838471+0000","last_peered":"2023-12-01T16:00:36.838471+0000","last_clean":"2023-12-01T16:00:36.838471+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T16:00:36.838471+0000","last_undegraded":"2023-12-01T16:00:36.838471+0000","last_fullsized":"2023-12-01T16:00:36.838471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2023-12-01T16:00:36.838414+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2023-12-01T16:00:36.838414+0000","last_clean_scrub_stamp":"2023-12-01T16:00:36.838414+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:06:43.402195+0000","scrub_duration":0.0045544590000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3629","reported_seq":3091,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.506683+0000","last_change":"2023-12-01T15:59:48.506683+0000","last_active":"2023-12-01T15:59:48.506683+0000","last_peered":"2023-12-01T15:59:48.506683+0000","last_clean":"2023-12-01T15:59:48.506683+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:59:48.506683+0000","last_undegraded":"2023-12-01T15:59:48.506683+0000","last_fullsized":"2023-12-01T15:59:48.506683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3629","last_scrub_stamp":"2023-12-01T15:59:48.506533+0000","last_deep_scrub":"44'3629","last_deep_scrub_stamp":"2023-12-01T15:59:48.506533+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.506533+0000","objects_scrubbed":1,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:08:56.880573+0000","scrub_duration":0.046519142999999999,"objects_trimmed":0,"snaptrim_duration":0.13624631700000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"44'1013","reported_seq":1068,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:11.216918+0000","last_change":"2023-12-01T16:00:11.217056+0000","last_active":"2023-12-01T16:00:11.216918+0000","last_peered":"2023-12-01T16:00:11.216918+0000","last_clean":"2023-12-01T16:00:11.216918+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T16:00:11.216918+0000","last_undegraded":"2023-12-01T16:00:11.216918+0000","last_fullsized":"2023-12-01T16:00:11.216918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1013","last_scrub_stamp":"2023-12-01T16:00:11.216892+0000","last_deep_scrub":"44'1013","last_deep_scrub_stamp":"2023-12-01T16:00:11.216892+0000","last_clean_scrub_stamp":"2023-12-01T16:00:11.216892+0000","objects_scrubbed":6,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:32.838433+0000","scrub_duration":0.058295441000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":10007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1316869,"num_omap_keys":2625,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"44'3453","reported_seq":2887,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.543735+0000","last_change":"2023-12-01T15:59:49.543735+0000","last_active":"2023-12-01T15:59:49.543735+0000","last_peered":"2023-12-01T15:59:49.543735+0000","last_clean":"2023-12-01T15:59:49.543735+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:59:49.543735+0000","last_undegraded":"2023-12-01T15:59:49.543735+0000","last_fullsized":"2023-12-01T15:59:49.543735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3453","last_scrub_stamp":"2023-12-01T15:59:49.543577+0000","last_deep_scrub":"44'3453","last_deep_scrub_stamp":"2023-12-01T15:59:49.543577+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.543577+0000","objects_scrubbed":2,"log_size":3453,"log_dups_size":0,"ondisk_log_size":3453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:22.774680+0000","scrub_duration":0.045727260999999998,"objects_trimmed":0,"snaptrim_duration":0.13638832000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"42'1384","reported_seq":1428,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174340+0000","last_change":"2023-12-01T15:43:45.207762+0000","last_active":"2023-12-01T15:59:46.174340+0000","last_peered":"2023-12-01T15:59:46.174340+0000","last_clean":"2023-12-01T15:59:46.174340+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T15:59:46.174340+0000","last_undegraded":"2023-12-01T15:59:46.174340+0000","last_fullsized":"2023-12-01T15:59:46.174340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1392,"num_write_kb":12529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'1278","reported_seq":1333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:18.087582+0000","last_change":"2023-12-01T16:00:18.087703+0000","last_active":"2023-12-01T16:00:18.087582+0000","last_peered":"2023-12-01T16:00:18.087582+0000","last_clean":"2023-12-01T16:00:18.087582+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T16:00:18.087582+0000","last_undegraded":"2023-12-01T16:00:18.087582+0000","last_fullsized":"2023-12-01T16:00:18.087582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1278","last_scrub_stamp":"2023-12-01T16:00:18.087555+0000","last_deep_scrub":"44'1278","last_deep_scrub_stamp":"2023-12-01T16:00:18.087555+0000","last_clean_scrub_stamp":"2023-12-01T16:00:18.087555+0000","objects_scrubbed":2,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:13.474736+0000","scrub_duration":0.033204496999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":12495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'3658","reported_seq":3058,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:53.147914+0000","last_change":"2023-12-01T15:59:53.148041+0000","last_active":"2023-12-01T15:59:53.147914+0000","last_peered":"2023-12-01T15:59:53.147914+0000","last_clean":"2023-12-01T15:59:53.147914+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:59:53.147914+0000","last_undegraded":"2023-12-01T15:59:53.147914+0000","last_fullsized":"2023-12-01T15:59:53.147914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3658","last_scrub_stamp":"2023-12-01T15:59:53.147892+0000","last_deep_scrub":"43'3658","last_deep_scrub_stamp":"2023-12-01T15:59:53.147892+0000","last_clean_scrub_stamp":"2023-12-01T15:59:53.147892+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:26.141896+0000","scrub_duration":0.039317244000000001,"objects_trimmed":0,"snaptrim_duration":0.172903538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'1243","reported_seq":1298,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:05.986674+0000","last_change":"2023-12-01T16:00:05.986857+0000","last_active":"2023-12-01T16:00:05.986674+0000","last_peered":"2023-12-01T16:00:05.986674+0000","last_clean":"2023-12-01T16:00:05.986674+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T16:00:05.986674+0000","last_undegraded":"2023-12-01T16:00:05.986674+0000","last_fullsized":"2023-12-01T16:00:05.986674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1243","last_scrub_stamp":"2023-12-01T16:00:05.986638+0000","last_deep_scrub":"44'1243","last_deep_scrub_stamp":"2023-12-01T16:00:05.986638+0000","last_clean_scrub_stamp":"2023-12-01T16:00:05.986638+0000","objects_scrubbed":3,"log_size":1243,"log_dups_size":0,"ondisk_log_size":1243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:27.176778+0000","scrub_duration":0.028165143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1238,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'3445","reported_seq":2884,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:57.046416+0000","last_change":"2023-12-01T15:59:57.046543+0000","last_active":"2023-12-01T15:59:57.046416+0000","last_peered":"2023-12-01T15:59:57.046416+0000","last_clean":"2023-12-01T15:59:57.046416+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:59:57.046416+0000","last_undegraded":"2023-12-01T15:59:57.046416+0000","last_fullsized":"2023-12-01T15:59:57.046416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3445","last_scrub_stamp":"2023-12-01T15:59:57.046388+0000","last_deep_scrub":"44'3445","last_deep_scrub_stamp":"2023-12-01T15:59:57.046388+0000","last_clean_scrub_stamp":"2023-12-01T15:59:57.046388+0000","objects_scrubbed":3,"log_size":3445,"log_dups_size":0,"ondisk_log_size":3445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:06:40.083816+0000","scrub_duration":0.046119563000000002,"objects_trimmed":0,"snaptrim_duration":0.090755167999999997,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1186,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"44'4746","reported_seq":4801,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:42.519833+0000","last_change":"2023-12-01T16:00:42.519960+0000","last_active":"2023-12-01T16:00:42.519833+0000","last_peered":"2023-12-01T16:00:42.519833+0000","last_clean":"2023-12-01T16:00:42.519833+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T16:00:42.519833+0000","last_undegraded":"2023-12-01T16:00:42.519833+0000","last_fullsized":"2023-12-01T16:00:42.519833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4746","last_scrub_stamp":"2023-12-01T16:00:42.519805+0000","last_deep_scrub":"44'4746","last_deep_scrub_stamp":"2023-12-01T16:00:42.519805+0000","last_clean_scrub_stamp":"2023-12-01T16:00:42.519805+0000","objects_scrubbed":4,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:08:09.869538+0000","scrub_duration":0.057596223000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4735,"num_write_kb":27522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3360","reported_seq":2796,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.985855+0000","last_change":"2023-12-01T15:59:49.985964+0000","last_active":"2023-12-01T15:59:49.985855+0000","last_peered":"2023-12-01T15:59:49.985855+0000","last_clean":"2023-12-01T15:59:49.985855+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:59:49.985855+0000","last_undegraded":"2023-12-01T15:59:49.985855+0000","last_fullsized":"2023-12-01T15:59:49.985855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3360","last_scrub_stamp":"2023-12-01T15:59:49.985801+0000","last_deep_scrub":"44'3360","last_deep_scrub_stamp":"2023-12-01T15:59:49.985801+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.985801+0000","objects_scrubbed":1,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:22:12.421111+0000","scrub_duration":0.040212074,"objects_trimmed":0,"snaptrim_duration":0.090274558000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'1994","reported_seq":2049,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.208746+0000","last_change":"2023-12-01T16:00:23.208916+0000","last_active":"2023-12-01T16:00:23.208746+0000","last_peered":"2023-12-01T16:00:23.208746+0000","last_clean":"2023-12-01T16:00:23.208746+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T16:00:23.208746+0000","last_undegraded":"2023-12-01T16:00:23.208746+0000","last_fullsized":"2023-12-01T16:00:23.208746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1994","last_scrub_stamp":"2023-12-01T16:00:23.208718+0000","last_deep_scrub":"44'1994","last_deep_scrub_stamp":"2023-12-01T16:00:23.208718+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.208718+0000","objects_scrubbed":6,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:53.915729+0000","scrub_duration":0.063117909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1987,"num_write_kb":25538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"44'3405","reported_seq":2910,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:59.668323+0000","last_change":"2023-12-01T15:59:59.668525+0000","last_active":"2023-12-01T15:59:59.668323+0000","last_peered":"2023-12-01T15:59:59.668323+0000","last_clean":"2023-12-01T15:59:59.668323+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:59:59.668323+0000","last_undegraded":"2023-12-01T15:59:59.668323+0000","last_fullsized":"2023-12-01T15:59:59.668323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3405","last_scrub_stamp":"2023-12-01T15:59:59.668279+0000","last_deep_scrub":"44'3405","last_deep_scrub_stamp":"2023-12-01T15:59:59.668279+0000","last_clean_scrub_stamp":"2023-12-01T15:59:59.668279+0000","objects_scrubbed":2,"log_size":3405,"log_dups_size":0,"ondisk_log_size":3405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:09.752731+0000","scrub_duration":0.045721932,"objects_trimmed":0,"snaptrim_duration":0.13034463499999999,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1138,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'4352","reported_seq":4407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:04.502682+0000","last_change":"2023-12-01T16:00:04.502810+0000","last_active":"2023-12-01T16:00:04.502682+0000","last_peered":"2023-12-01T16:00:04.502682+0000","last_clean":"2023-12-01T16:00:04.502682+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T16:00:04.502682+0000","last_undegraded":"2023-12-01T16:00:04.502682+0000","last_fullsized":"2023-12-01T16:00:04.502682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4352","last_scrub_stamp":"2023-12-01T16:00:04.502658+0000","last_deep_scrub":"44'4352","last_deep_scrub_stamp":"2023-12-01T16:00:04.502658+0000","last_clean_scrub_stamp":"2023-12-01T16:00:04.502658+0000","objects_scrubbed":4,"log_size":4352,"log_dups_size":0,"ondisk_log_size":4352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:37.496662+0000","scrub_duration":0.054000375000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4337,"num_write_kb":30065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1415,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"44'3800","reported_seq":3193,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:39.434317+0000","last_change":"2023-12-01T16:00:39.434464+0000","last_active":"2023-12-01T16:00:39.434317+0000","last_peered":"2023-12-01T16:00:39.434317+0000","last_clean":"2023-12-01T16:00:39.434317+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T16:00:39.434317+0000","last_undegraded":"2023-12-01T16:00:39.434317+0000","last_fullsized":"2023-12-01T16:00:39.434317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3800","last_scrub_stamp":"2023-12-01T16:00:39.434285+0000","last_deep_scrub":"44'3800","last_deep_scrub_stamp":"2023-12-01T16:00:39.434285+0000","last_clean_scrub_stamp":"2023-12-01T16:00:39.434285+0000","objects_scrubbed":3,"log_size":3800,"log_dups_size":0,"ondisk_log_size":3800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:54:03.676050+0000","scrub_duration":0.048777055999999999,"objects_trimmed":0,"snaptrim_duration":0.165714477,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"41'2491","reported_seq":2535,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478592+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:59:43.478592+0000","last_peered":"2023-12-01T15:59:43.478592+0000","last_clean":"2023-12-01T15:59:43.478592+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:59:43.478592+0000","last_undegraded":"2023-12-01T15:59:43.478592+0000","last_fullsized":"2023-12-01T15:59:43.478592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2491,"log_dups_size":0,"ondisk_log_size":2491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2494,"num_write_kb":26915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'3462","reported_seq":2932,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479262+0000","last_change":"2023-12-01T15:59:36.980979+0000","last_active":"2023-12-01T15:59:43.479262+0000","last_peered":"2023-12-01T15:59:43.479262+0000","last_clean":"2023-12-01T15:59:43.479262+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:59:43.479262+0000","last_undegraded":"2023-12-01T15:59:43.479262+0000","last_fullsized":"2023-12-01T15:59:43.479262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15615646,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1160,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'2354","reported_seq":2409,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:37.412078+0000","last_change":"2023-12-01T16:00:37.412288+0000","last_active":"2023-12-01T16:00:37.412078+0000","last_peered":"2023-12-01T16:00:37.412078+0000","last_clean":"2023-12-01T16:00:37.412078+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T16:00:37.412078+0000","last_undegraded":"2023-12-01T16:00:37.412078+0000","last_fullsized":"2023-12-01T16:00:37.412078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2354","last_scrub_stamp":"2023-12-01T16:00:37.412048+0000","last_deep_scrub":"44'2354","last_deep_scrub_stamp":"2023-12-01T16:00:37.412048+0000","last_clean_scrub_stamp":"2023-12-01T16:00:37.412048+0000","objects_scrubbed":2,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:03.150585+0000","scrub_duration":0.041570694999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2354,"num_write_kb":17078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'3598","reported_seq":2995,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:25.028288+0000","last_change":"2023-12-01T16:00:25.028416+0000","last_active":"2023-12-01T16:00:25.028288+0000","last_peered":"2023-12-01T16:00:25.028288+0000","last_clean":"2023-12-01T16:00:25.028288+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T16:00:25.028288+0000","last_undegraded":"2023-12-01T16:00:25.028288+0000","last_fullsized":"2023-12-01T16:00:25.028288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3598","last_scrub_stamp":"2023-12-01T16:00:25.028260+0000","last_deep_scrub":"44'3598","last_deep_scrub_stamp":"2023-12-01T16:00:25.028260+0000","last_clean_scrub_stamp":"2023-12-01T16:00:25.028260+0000","objects_scrubbed":1,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:09.811963+0000","scrub_duration":0.045226192999999998,"objects_trimmed":0,"snaptrim_duration":0.086977656,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'1540","reported_seq":1595,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.514725+0000","last_change":"2023-12-01T16:00:23.514875+0000","last_active":"2023-12-01T16:00:23.514725+0000","last_peered":"2023-12-01T16:00:23.514725+0000","last_clean":"2023-12-01T16:00:23.514725+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T16:00:23.514725+0000","last_undegraded":"2023-12-01T16:00:23.514725+0000","last_fullsized":"2023-12-01T16:00:23.514725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1540","last_scrub_stamp":"2023-12-01T16:00:23.514701+0000","last_deep_scrub":"44'1540","last_deep_scrub_stamp":"2023-12-01T16:00:23.514701+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.514701+0000","objects_scrubbed":2,"log_size":1540,"log_dups_size":0,"ondisk_log_size":1540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:08.871584+0000","scrub_duration":0.042235796999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1538,"num_write_kb":10132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":636698,"num_omap_keys":1268,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3475","reported_seq":2915,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:55.340040+0000","last_change":"2023-12-01T15:59:55.340335+0000","last_active":"2023-12-01T15:59:55.340040+0000","last_peered":"2023-12-01T15:59:55.340040+0000","last_clean":"2023-12-01T15:59:55.340040+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:59:55.340040+0000","last_undegraded":"2023-12-01T15:59:55.340040+0000","last_fullsized":"2023-12-01T15:59:55.340040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3475","last_scrub_stamp":"2023-12-01T15:59:55.339969+0000","last_deep_scrub":"43'3475","last_deep_scrub_stamp":"2023-12-01T15:59:55.339969+0000","last_clean_scrub_stamp":"2023-12-01T15:59:55.339969+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:16.716385+0000","scrub_duration":0.037072088000000003,"objects_trimmed":0,"snaptrim_duration":0.64740572200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":201,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.485338+0000","last_change":"2023-12-01T15:43:35.844659+0000","last_active":"2023-12-01T15:59:44.485338+0000","last_peered":"2023-12-01T15:59:44.485338+0000","last_clean":"2023-12-01T15:59:44.485338+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T15:59:44.485338+0000","last_undegraded":"2023-12-01T15:59:44.485338+0000","last_fullsized":"2023-12-01T15:59:44.485338+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:34.700727+0000","last_clean_scrub_stamp":"2023-12-01T15:43:34.700727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174009+0000","last_change":"2023-12-01T15:43:41.048146+0000","last_active":"2023-12-01T15:59:46.174009+0000","last_peered":"2023-12-01T15:59:46.174009+0000","last_clean":"2023-12-01T15:59:46.174009+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T15:59:46.174009+0000","last_undegraded":"2023-12-01T15:59:46.174009+0000","last_fullsized":"2023-12-01T15:59:46.174009+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"44'4418","reported_seq":4474,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:22.563805+0000","last_change":"2023-12-01T16:00:22.563805+0000","last_active":"2023-12-01T16:00:22.563805+0000","last_peered":"2023-12-01T16:00:22.563805+0000","last_clean":"2023-12-01T16:00:22.563805+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T16:00:22.563805+0000","last_undegraded":"2023-12-01T16:00:22.563805+0000","last_fullsized":"2023-12-01T16:00:22.563805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4418","last_scrub_stamp":"2023-12-01T16:00:22.563645+0000","last_deep_scrub":"44'4418","last_deep_scrub_stamp":"2023-12-01T16:00:22.563645+0000","last_clean_scrub_stamp":"2023-12-01T16:00:22.563645+0000","objects_scrubbed":4,"log_size":4418,"log_dups_size":0,"ondisk_log_size":4418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.311958+0000","scrub_duration":0.064643555000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4406,"num_write_kb":30219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"43'3657","reported_seq":3071,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174769+0000","last_change":"2023-12-01T15:59:36.978939+0000","last_active":"2023-12-01T15:59:46.174769+0000","last_peered":"2023-12-01T15:59:46.174769+0000","last_clean":"2023-12-01T15:59:46.174769+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:59:46.174769+0000","last_undegraded":"2023-12-01T15:59:46.174769+0000","last_fullsized":"2023-12-01T15:59:46.174769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3657,"log_dups_size":0,"ondisk_log_size":3657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.144833777,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174011+0000","last_change":"2023-12-01T15:43:41.046921+0000","last_active":"2023-12-01T15:59:46.174011+0000","last_peered":"2023-12-01T15:59:46.174011+0000","last_clean":"2023-12-01T15:59:46.174011+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T15:59:46.174011+0000","last_undegraded":"2023-12-01T15:59:46.174011+0000","last_fullsized":"2023-12-01T15:59:46.174011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'2297","reported_seq":2553,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:33.875936+0000","last_change":"2023-12-01T16:00:33.876097+0000","last_active":"2023-12-01T16:00:33.875936+0000","last_peered":"2023-12-01T16:00:33.875936+0000","last_clean":"2023-12-01T16:00:33.875936+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T16:00:33.875936+0000","last_undegraded":"2023-12-01T16:00:33.875936+0000","last_fullsized":"2023-12-01T16:00:33.875936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2297","last_scrub_stamp":"2023-12-01T16:00:33.875902+0000","last_deep_scrub":"44'2297","last_deep_scrub_stamp":"2023-12-01T16:00:33.875902+0000","last_clean_scrub_stamp":"2023-12-01T16:00:33.875902+0000","objects_scrubbed":2,"log_size":2297,"log_dups_size":0,"ondisk_log_size":2297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:13.334507+0000","scrub_duration":0.034118038000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3359983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":3419,"num_write":2296,"num_write_kb":16044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'3370","reported_seq":2811,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479724+0000","last_change":"2023-12-01T15:59:36.960605+0000","last_active":"2023-12-01T15:59:43.479724+0000","last_peered":"2023-12-01T15:59:43.479724+0000","last_clean":"2023-12-01T15:59:43.479724+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T15:59:43.479724+0000","last_undegraded":"2023-12-01T15:59:43.479724+0000","last_fullsized":"2023-12-01T15:59:43.479724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3370,"log_dups_size":0,"ondisk_log_size":3370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13848359499999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1137,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:08.498717+0000","last_change":"2023-12-01T16:00:08.498717+0000","last_active":"2023-12-01T16:00:08.498717+0000","last_peered":"2023-12-01T16:00:08.498717+0000","last_clean":"2023-12-01T16:00:08.498717+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T16:00:08.498717+0000","last_undegraded":"2023-12-01T16:00:08.498717+0000","last_fullsized":"2023-12-01T16:00:08.498717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:08.498410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:08.498410+0000","last_clean_scrub_stamp":"2023-12-01T16:00:08.498410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:18.582862+0000","scrub_duration":0.0065834630000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"44'2709","reported_seq":2765,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:14.574850+0000","last_change":"2023-12-01T16:00:14.574989+0000","last_active":"2023-12-01T16:00:14.574850+0000","last_peered":"2023-12-01T16:00:14.574850+0000","last_clean":"2023-12-01T16:00:14.574850+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T16:00:14.574850+0000","last_undegraded":"2023-12-01T16:00:14.574850+0000","last_fullsized":"2023-12-01T16:00:14.574850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2709","last_scrub_stamp":"2023-12-01T16:00:14.574824+0000","last_deep_scrub":"44'2709","last_deep_scrub_stamp":"2023-12-01T16:00:14.574824+0000","last_clean_scrub_stamp":"2023-12-01T16:00:14.574824+0000","objects_scrubbed":3,"log_size":2709,"log_dups_size":0,"ondisk_log_size":2709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:31:29.561401+0000","scrub_duration":0.059953542999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2697,"num_write_kb":25331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3393","reported_seq":2878,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.386317+0000","last_change":"2023-12-01T15:59:49.386477+0000","last_active":"2023-12-01T15:59:49.386317+0000","last_peered":"2023-12-01T15:59:49.386317+0000","last_clean":"2023-12-01T15:59:49.386317+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:59:49.386317+0000","last_undegraded":"2023-12-01T15:59:49.386317+0000","last_fullsized":"2023-12-01T15:59:49.386317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3393","last_scrub_stamp":"2023-12-01T15:59:49.386292+0000","last_deep_scrub":"44'3393","last_deep_scrub_stamp":"2023-12-01T15:59:49.386292+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.386292+0000","objects_scrubbed":3,"log_size":3393,"log_dups_size":0,"ondisk_log_size":3393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:21:35.191687+0000","scrub_duration":0.041281799000000001,"objects_trimmed":0,"snaptrim_duration":0.644502672,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1119,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174041+0000","last_change":"2023-12-01T15:43:41.049184+0000","last_active":"2023-12-01T15:59:46.174041+0000","last_peered":"2023-12-01T15:59:46.174041+0000","last_clean":"2023-12-01T15:59:46.174041+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T15:59:46.174041+0000","last_undegraded":"2023-12-01T15:59:46.174041+0000","last_fullsized":"2023-12-01T15:59:46.174041+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'3561","reported_seq":3617,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:09.058193+0000","last_change":"2023-12-01T16:00:09.058193+0000","last_active":"2023-12-01T16:00:09.058193+0000","last_peered":"2023-12-01T16:00:09.058193+0000","last_clean":"2023-12-01T16:00:09.058193+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T16:00:09.058193+0000","last_undegraded":"2023-12-01T16:00:09.058193+0000","last_fullsized":"2023-12-01T16:00:09.058193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3561","last_scrub_stamp":"2023-12-01T16:00:09.058006+0000","last_deep_scrub":"44'3561","last_deep_scrub_stamp":"2023-12-01T16:00:09.058006+0000","last_clean_scrub_stamp":"2023-12-01T16:00:09.058006+0000","objects_scrubbed":5,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:19.142458+0000","scrub_duration":0.071950684000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3556,"num_write_kb":20852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1320010,"num_omap_keys":2629,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3573","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:47.437607+0000","last_change":"2023-12-01T15:59:47.437607+0000","last_active":"2023-12-01T15:59:47.437607+0000","last_peered":"2023-12-01T15:59:47.437607+0000","last_clean":"2023-12-01T15:59:47.437607+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:47.437607+0000","last_undegraded":"2023-12-01T15:59:47.437607+0000","last_fullsized":"2023-12-01T15:59:47.437607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3573","last_scrub_stamp":"2023-12-01T15:59:47.437368+0000","last_deep_scrub":"44'3573","last_deep_scrub_stamp":"2023-12-01T15:59:47.437368+0000","last_clean_scrub_stamp":"2023-12-01T15:59:47.437368+0000","objects_scrubbed":1,"log_size":3573,"log_dups_size":0,"ondisk_log_size":3573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:45:47.573028+0000","scrub_duration":0.052350225,"objects_trimmed":0,"snaptrim_duration":0.65789627900000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'2832","reported_seq":2888,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:04.956811+0000","last_change":"2023-12-01T16:00:04.956811+0000","last_active":"2023-12-01T16:00:04.956811+0000","last_peered":"2023-12-01T16:00:04.956811+0000","last_clean":"2023-12-01T16:00:04.956811+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T16:00:04.956811+0000","last_undegraded":"2023-12-01T16:00:04.956811+0000","last_fullsized":"2023-12-01T16:00:04.956811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2832","last_scrub_stamp":"2023-12-01T16:00:04.956554+0000","last_deep_scrub":"44'2832","last_deep_scrub_stamp":"2023-12-01T16:00:04.956554+0000","last_clean_scrub_stamp":"2023-12-01T16:00:04.956554+0000","objects_scrubbed":2,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:37.950558+0000","scrub_duration":0.044932412999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2820,"num_write_kb":26865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":628812,"num_omap_keys":1252,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:05.464028+0000","last_change":"2023-12-01T16:00:05.464028+0000","last_active":"2023-12-01T16:00:05.464028+0000","last_peered":"2023-12-01T16:00:05.464028+0000","last_clean":"2023-12-01T16:00:05.464028+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T16:00:05.464028+0000","last_undegraded":"2023-12-01T16:00:05.464028+0000","last_fullsized":"2023-12-01T16:00:05.464028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:05.463736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:05.463736+0000","last_clean_scrub_stamp":"2023-12-01T16:00:05.463736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:26.653876+0000","scrub_duration":0.0051879350000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"44'3761","reported_seq":3211,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.423729+0000","last_change":"2023-12-01T15:59:48.423729+0000","last_active":"2023-12-01T15:59:48.423729+0000","last_peered":"2023-12-01T15:59:48.423729+0000","last_clean":"2023-12-01T15:59:48.423729+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:59:48.423729+0000","last_undegraded":"2023-12-01T15:59:48.423729+0000","last_fullsized":"2023-12-01T15:59:48.423729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3761","last_scrub_stamp":"2023-12-01T15:59:48.423554+0000","last_deep_scrub":"44'3761","last_deep_scrub_stamp":"2023-12-01T15:59:48.423554+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.423554+0000","objects_scrubbed":2,"log_size":3761,"log_dups_size":0,"ondisk_log_size":3761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:02.504062+0000","scrub_duration":0.041749799999999997,"objects_trimmed":0,"snaptrim_duration":0.64064258500000004,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"44'725","reported_seq":781,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:16.552415+0000","last_change":"2023-12-01T16:00:16.552415+0000","last_active":"2023-12-01T16:00:16.552415+0000","last_peered":"2023-12-01T16:00:16.552415+0000","last_clean":"2023-12-01T16:00:16.552415+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T16:00:16.552415+0000","last_undegraded":"2023-12-01T16:00:16.552415+0000","last_fullsized":"2023-12-01T16:00:16.552415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'725","last_scrub_stamp":"2023-12-01T16:00:16.552270+0000","last_deep_scrub":"44'725","last_deep_scrub_stamp":"2023-12-01T16:00:16.552270+0000","last_clean_scrub_stamp":"2023-12-01T16:00:16.552270+0000","objects_scrubbed":2,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:11.939451+0000","scrub_duration":0.030041060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":8308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174111+0000","last_change":"2023-12-01T15:43:41.048275+0000","last_active":"2023-12-01T15:59:46.174111+0000","last_peered":"2023-12-01T15:59:46.174111+0000","last_clean":"2023-12-01T15:59:46.174111+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T15:59:46.174111+0000","last_undegraded":"2023-12-01T15:59:46.174111+0000","last_fullsized":"2023-12-01T15:59:46.174111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"44'3560","reported_seq":2976,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:11.777890+0000","last_change":"2023-12-01T16:00:11.777890+0000","last_active":"2023-12-01T16:00:11.777890+0000","last_peered":"2023-12-01T16:00:11.777890+0000","last_clean":"2023-12-01T16:00:11.777890+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T16:00:11.777890+0000","last_undegraded":"2023-12-01T16:00:11.777890+0000","last_fullsized":"2023-12-01T16:00:11.777890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3560","last_scrub_stamp":"2023-12-01T16:00:11.777713+0000","last_deep_scrub":"44'3560","last_deep_scrub_stamp":"2023-12-01T16:00:11.777713+0000","last_clean_scrub_stamp":"2023-12-01T16:00:11.777713+0000","objects_scrubbed":2,"log_size":3560,"log_dups_size":0,"ondisk_log_size":3560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:07.164893+0000","scrub_duration":0.046654314000000002,"objects_trimmed":0,"snaptrim_duration":0.13059393599999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1243,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'1640","reported_seq":1695,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:19.517593+0000","last_change":"2023-12-01T16:00:19.517728+0000","last_active":"2023-12-01T16:00:19.517593+0000","last_peered":"2023-12-01T16:00:19.517593+0000","last_clean":"2023-12-01T16:00:19.517593+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T16:00:19.517593+0000","last_undegraded":"2023-12-01T16:00:19.517593+0000","last_fullsized":"2023-12-01T16:00:19.517593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1640","last_scrub_stamp":"2023-12-01T16:00:19.517564+0000","last_deep_scrub":"44'1640","last_deep_scrub_stamp":"2023-12-01T16:00:19.517564+0000","last_clean_scrub_stamp":"2023-12-01T16:00:19.517564+0000","objects_scrubbed":3,"log_size":1640,"log_dups_size":0,"ondisk_log_size":1640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:42:53.178860+0000","scrub_duration":0.036244526999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1642,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:09.510544+0000","last_change":"2023-12-01T16:00:09.510854+0000","last_active":"2023-12-01T16:00:09.510544+0000","last_peered":"2023-12-01T16:00:09.510544+0000","last_clean":"2023-12-01T16:00:09.510544+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T16:00:09.510544+0000","last_undegraded":"2023-12-01T16:00:09.510544+0000","last_fullsized":"2023-12-01T16:00:09.510544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:09.510499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:09.510499+0000","last_clean_scrub_stamp":"2023-12-01T16:00:09.510499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:50:49.026098+0000","scrub_duration":0.005722286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'3700","reported_seq":3078,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.659888+0000","last_change":"2023-12-01T15:59:56.660009+0000","last_active":"2023-12-01T15:59:56.659888+0000","last_peered":"2023-12-01T15:59:56.659888+0000","last_clean":"2023-12-01T15:59:56.659888+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:59:56.659888+0000","last_undegraded":"2023-12-01T15:59:56.659888+0000","last_fullsized":"2023-12-01T15:59:56.659888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3700","last_scrub_stamp":"2023-12-01T15:59:56.659861+0000","last_deep_scrub":"44'3700","last_deep_scrub_stamp":"2023-12-01T15:59:56.659861+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.659861+0000","objects_scrubbed":4,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:17.850001+0000","scrub_duration":0.058770831000000003,"objects_trimmed":0,"snaptrim_duration":0.13319146700000001,"stat_sum":{"num_bytes":4118,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'2000","reported_seq":2055,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:18.918333+0000","last_change":"2023-12-01T16:00:18.918482+0000","last_active":"2023-12-01T16:00:18.918333+0000","last_peered":"2023-12-01T16:00:18.918333+0000","last_clean":"2023-12-01T16:00:18.918333+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T16:00:18.918333+0000","last_undegraded":"2023-12-01T16:00:18.918333+0000","last_fullsized":"2023-12-01T16:00:18.918333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2000","last_scrub_stamp":"2023-12-01T16:00:18.918306+0000","last_deep_scrub":"44'2000","last_deep_scrub_stamp":"2023-12-01T16:00:18.918306+0000","last_clean_scrub_stamp":"2023-12-01T16:00:18.918306+0000","objects_scrubbed":5,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:04.275189+0000","scrub_duration":0.15145572099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2265,"num_write_kb":16414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":702002,"num_omap_keys":1398,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.480499+0000","last_change":"2023-12-01T15:43:41.048043+0000","last_active":"2023-12-01T15:59:43.480499+0000","last_peered":"2023-12-01T15:59:43.480499+0000","last_clean":"2023-12-01T15:59:43.480499+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T15:59:43.480499+0000","last_undegraded":"2023-12-01T15:59:43.480499+0000","last_fullsized":"2023-12-01T15:59:43.480499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:40.008046+0000","last_clean_scrub_stamp":"2023-12-01T15:43:40.008046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"44'3410","reported_seq":2836,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:31.122991+0000","last_change":"2023-12-01T16:00:31.123172+0000","last_active":"2023-12-01T16:00:31.122991+0000","last_peered":"2023-12-01T16:00:31.122991+0000","last_clean":"2023-12-01T16:00:31.122991+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T16:00:31.122991+0000","last_undegraded":"2023-12-01T16:00:31.122991+0000","last_fullsized":"2023-12-01T16:00:31.122991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3410","last_scrub_stamp":"2023-12-01T16:00:31.122961+0000","last_deep_scrub":"44'3410","last_deep_scrub_stamp":"2023-12-01T16:00:31.122961+0000","last_clean_scrub_stamp":"2023-12-01T16:00:31.122961+0000","objects_scrubbed":5,"log_size":3410,"log_dups_size":0,"ondisk_log_size":3410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:47:20.447314+0000","scrub_duration":0.056985352000000003,"objects_trimmed":0,"snaptrim_duration":0.087179219000000002,"stat_sum":{"num_bytes":12302,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"44'3615","reported_seq":3033,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.027191+0000","last_change":"2023-12-01T15:59:49.027191+0000","last_active":"2023-12-01T15:59:49.027191+0000","last_peered":"2023-12-01T15:59:49.027191+0000","last_clean":"2023-12-01T15:59:49.027191+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:59:49.027191+0000","last_undegraded":"2023-12-01T15:59:49.027191+0000","last_fullsized":"2023-12-01T15:59:49.027191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3615","last_scrub_stamp":"2023-12-01T15:59:49.026983+0000","last_deep_scrub":"44'3615","last_deep_scrub_stamp":"2023-12-01T15:59:49.026983+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.026983+0000","objects_scrubbed":2,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:03.107490+0000","scrub_duration":0.046925306,"objects_trimmed":0,"snaptrim_duration":0.084182759999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'3719","reported_seq":3774,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:17.269725+0000","last_change":"2023-12-01T16:00:17.269901+0000","last_active":"2023-12-01T16:00:17.269725+0000","last_peered":"2023-12-01T16:00:17.269725+0000","last_clean":"2023-12-01T16:00:17.269725+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T16:00:17.269725+0000","last_undegraded":"2023-12-01T16:00:17.269725+0000","last_fullsized":"2023-12-01T16:00:17.269725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3719","last_scrub_stamp":"2023-12-01T16:00:17.269697+0000","last_deep_scrub":"44'3719","last_deep_scrub_stamp":"2023-12-01T16:00:17.269697+0000","last_clean_scrub_stamp":"2023-12-01T16:00:17.269697+0000","objects_scrubbed":7,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:02.626581+0000","scrub_duration":0.068143023999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3712,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":605,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"44'3513","reported_seq":2944,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:32.500021+0000","last_change":"2023-12-01T16:00:32.500141+0000","last_active":"2023-12-01T16:00:32.500021+0000","last_peered":"2023-12-01T16:00:32.500021+0000","last_clean":"2023-12-01T16:00:32.500021+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T16:00:32.500021+0000","last_undegraded":"2023-12-01T16:00:32.500021+0000","last_fullsized":"2023-12-01T16:00:32.500021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3513","last_scrub_stamp":"2023-12-01T16:00:32.499989+0000","last_deep_scrub":"44'3513","last_deep_scrub_stamp":"2023-12-01T16:00:32.499989+0000","last_clean_scrub_stamp":"2023-12-01T16:00:32.499989+0000","objects_scrubbed":5,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:47:21.824342+0000","scrub_duration":0.061740942,"objects_trimmed":0,"snaptrim_duration":0.63296622700000005,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"44'2462","reported_seq":2517,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:19.085189+0000","last_change":"2023-12-01T16:00:19.085189+0000","last_active":"2023-12-01T16:00:19.085189+0000","last_peered":"2023-12-01T16:00:19.085189+0000","last_clean":"2023-12-01T16:00:19.085189+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T16:00:19.085189+0000","last_undegraded":"2023-12-01T16:00:19.085189+0000","last_fullsized":"2023-12-01T16:00:19.085189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2462","last_scrub_stamp":"2023-12-01T16:00:19.085001+0000","last_deep_scrub":"44'2462","last_deep_scrub_stamp":"2023-12-01T16:00:19.085001+0000","last_clean_scrub_stamp":"2023-12-01T16:00:19.085001+0000","objects_scrubbed":5,"log_size":2462,"log_dups_size":0,"ondisk_log_size":2462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:40.706542+0000","scrub_duration":0.035617093000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2453,"num_write_kb":21278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"44'1341","reported_seq":1396,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:20.130338+0000","last_change":"2023-12-01T16:00:20.130338+0000","last_active":"2023-12-01T16:00:20.130338+0000","last_peered":"2023-12-01T16:00:20.130338+0000","last_clean":"2023-12-01T16:00:20.130338+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T16:00:20.130338+0000","last_undegraded":"2023-12-01T16:00:20.130338+0000","last_fullsized":"2023-12-01T16:00:20.130338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1341","last_scrub_stamp":"2023-12-01T16:00:20.129959+0000","last_deep_scrub":"44'1341","last_deep_scrub_stamp":"2023-12-01T16:00:20.129959+0000","last_clean_scrub_stamp":"2023-12-01T16:00:20.129959+0000","objects_scrubbed":2,"log_size":1341,"log_dups_size":0,"ondisk_log_size":1341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:42:53.791254+0000","scrub_duration":0.039957485000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1338,"num_write_kb":26066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'3641","reported_seq":3016,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:17.763808+0000","last_change":"2023-12-01T16:00:17.763921+0000","last_active":"2023-12-01T16:00:17.763808+0000","last_peered":"2023-12-01T16:00:17.763808+0000","last_clean":"2023-12-01T16:00:17.763808+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T16:00:17.763808+0000","last_undegraded":"2023-12-01T16:00:17.763808+0000","last_fullsized":"2023-12-01T16:00:17.763808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3641","last_scrub_stamp":"2023-12-01T16:00:17.763787+0000","last_deep_scrub":"43'3641","last_deep_scrub_stamp":"2023-12-01T16:00:17.763787+0000","last_clean_scrub_stamp":"2023-12-01T16:00:17.763787+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:59.512101+0000","scrub_duration":0.036564379000000001,"objects_trimmed":0,"snaptrim_duration":0.13235097200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"44'903","reported_seq":958,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:22.885656+0000","last_change":"2023-12-01T16:00:22.885656+0000","last_active":"2023-12-01T16:00:22.885656+0000","last_peered":"2023-12-01T16:00:22.885656+0000","last_clean":"2023-12-01T16:00:22.885656+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T16:00:22.885656+0000","last_undegraded":"2023-12-01T16:00:22.885656+0000","last_fullsized":"2023-12-01T16:00:22.885656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'903","last_scrub_stamp":"2023-12-01T16:00:22.885328+0000","last_deep_scrub":"44'903","last_deep_scrub_stamp":"2023-12-01T16:00:22.885328+0000","last_clean_scrub_stamp":"2023-12-01T16:00:22.885328+0000","objects_scrubbed":3,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:25:47.742131+0000","scrub_duration":0.050233486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3459","reported_seq":2882,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:50.437138+0000","last_change":"2023-12-01T15:59:50.437138+0000","last_active":"2023-12-01T15:59:50.437138+0000","last_peered":"2023-12-01T15:59:50.437138+0000","last_clean":"2023-12-01T15:59:50.437138+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:59:50.437138+0000","last_undegraded":"2023-12-01T15:59:50.437138+0000","last_fullsized":"2023-12-01T15:59:50.437138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3459","last_scrub_stamp":"2023-12-01T15:59:50.436956+0000","last_deep_scrub":"44'3459","last_deep_scrub_stamp":"2023-12-01T15:59:50.436956+0000","last_clean_scrub_stamp":"2023-12-01T15:59:50.436956+0000","objects_scrubbed":1,"log_size":3459,"log_dups_size":0,"ondisk_log_size":3459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:48:17.314373+0000","scrub_duration":0.047609585000000003,"objects_trimmed":0,"snaptrim_duration":0.59367497300000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1187,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"43'3413","reported_seq":2910,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174375+0000","last_change":"2023-12-01T15:59:36.971349+0000","last_active":"2023-12-01T15:59:46.174375+0000","last_peered":"2023-12-01T15:59:46.174375+0000","last_clean":"2023-12-01T15:59:46.174375+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:59:46.174375+0000","last_undegraded":"2023-12-01T15:59:46.174375+0000","last_fullsized":"2023-12-01T15:59:46.174375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17121966999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4978","reported_seq":5033,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.423763+0000","last_change":"2023-12-01T15:59:54.423763+0000","last_active":"2023-12-01T15:59:54.423763+0000","last_peered":"2023-12-01T15:59:54.423763+0000","last_clean":"2023-12-01T15:59:54.423763+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:59:54.423763+0000","last_undegraded":"2023-12-01T15:59:54.423763+0000","last_fullsized":"2023-12-01T15:59:54.423763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4978","last_scrub_stamp":"2023-12-01T15:59:54.423526+0000","last_deep_scrub":"44'4978","last_deep_scrub_stamp":"2023-12-01T15:59:54.423526+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.423526+0000","objects_scrubbed":5,"log_size":4978,"log_dups_size":0,"ondisk_log_size":4978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:49:35.988154+0000","scrub_duration":0.094740874000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4962,"num_write_kb":39191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670128,"num_omap_keys":1336,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'3228","reported_seq":2710,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:12.801031+0000","last_change":"2023-12-01T16:00:12.801404+0000","last_active":"2023-12-01T16:00:12.801031+0000","last_peered":"2023-12-01T16:00:12.801031+0000","last_clean":"2023-12-01T16:00:12.801031+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T16:00:12.801031+0000","last_undegraded":"2023-12-01T16:00:12.801031+0000","last_fullsized":"2023-12-01T16:00:12.801031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3228","last_scrub_stamp":"2023-12-01T16:00:12.800966+0000","last_deep_scrub":"44'3228","last_deep_scrub_stamp":"2023-12-01T16:00:12.800966+0000","last_clean_scrub_stamp":"2023-12-01T16:00:12.800966+0000","objects_scrubbed":2,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:34.422506+0000","scrub_duration":0.046375222000000001,"objects_trimmed":0,"snaptrim_duration":0.13751970099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'493","reported_seq":548,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.331348+0000","last_change":"2023-12-01T15:59:56.331348+0000","last_active":"2023-12-01T15:59:56.331348+0000","last_peered":"2023-12-01T15:59:56.331348+0000","last_clean":"2023-12-01T15:59:56.331348+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:59:56.331348+0000","last_undegraded":"2023-12-01T15:59:56.331348+0000","last_fullsized":"2023-12-01T15:59:56.331348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'493","last_scrub_stamp":"2023-12-01T15:59:56.331006+0000","last_deep_scrub":"44'493","last_deep_scrub_stamp":"2023-12-01T15:59:56.331006+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.331006+0000","objects_scrubbed":3,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:06:39.368433+0000","scrub_duration":0.040743746999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":17875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'3423","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:47.535135+0000","last_change":"2023-12-01T15:59:47.535337+0000","last_active":"2023-12-01T15:59:47.535135+0000","last_peered":"2023-12-01T15:59:47.535135+0000","last_clean":"2023-12-01T15:59:47.535135+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:59:47.535135+0000","last_undegraded":"2023-12-01T15:59:47.535135+0000","last_fullsized":"2023-12-01T15:59:47.535135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3423","last_scrub_stamp":"2023-12-01T15:59:47.535105+0000","last_deep_scrub":"44'3423","last_deep_scrub_stamp":"2023-12-01T15:59:47.535105+0000","last_clean_scrub_stamp":"2023-12-01T15:59:47.535105+0000","objects_scrubbed":2,"log_size":3423,"log_dups_size":0,"ondisk_log_size":3423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:08.911521+0000","scrub_duration":0.045260416999999997,"objects_trimmed":0,"snaptrim_duration":0.134588554,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"44'3618","reported_seq":3672,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:59.010548+0000","last_change":"2023-12-01T15:59:59.010802+0000","last_active":"2023-12-01T15:59:59.010548+0000","last_peered":"2023-12-01T15:59:59.010548+0000","last_clean":"2023-12-01T15:59:59.010548+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:59:59.010548+0000","last_undegraded":"2023-12-01T15:59:59.010548+0000","last_fullsized":"2023-12-01T15:59:59.010548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3618","last_scrub_stamp":"2023-12-01T15:59:59.010494+0000","last_deep_scrub":"44'3618","last_deep_scrub_stamp":"2023-12-01T15:59:59.010494+0000","last_clean_scrub_stamp":"2023-12-01T15:59:59.010494+0000","objects_scrubbed":2,"log_size":3618,"log_dups_size":0,"ondisk_log_size":3618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:32.241596+0000","scrub_duration":0.048349939000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3601,"num_write_kb":33849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"43'3891","reported_seq":3228,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:29.521261+0000","last_change":"2023-12-01T16:00:29.521372+0000","last_active":"2023-12-01T16:00:29.521261+0000","last_peered":"2023-12-01T16:00:29.521261+0000","last_clean":"2023-12-01T16:00:29.521261+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T16:00:29.521261+0000","last_undegraded":"2023-12-01T16:00:29.521261+0000","last_fullsized":"2023-12-01T16:00:29.521261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3891","last_scrub_stamp":"2023-12-01T16:00:29.521240+0000","last_deep_scrub":"43'3891","last_deep_scrub_stamp":"2023-12-01T16:00:29.521240+0000","last_clean_scrub_stamp":"2023-12-01T16:00:29.521240+0000","objects_scrubbed":0,"log_size":3891,"log_dups_size":0,"ondisk_log_size":3891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:02:00.228252+0000","scrub_duration":0.039399423000000003,"objects_trimmed":0,"snaptrim_duration":0.65050901000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"44'2100","reported_seq":2154,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:21.858238+0000","last_change":"2023-12-01T16:00:21.858509+0000","last_active":"2023-12-01T16:00:21.858238+0000","last_peered":"2023-12-01T16:00:21.858238+0000","last_clean":"2023-12-01T16:00:21.858238+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T16:00:21.858238+0000","last_undegraded":"2023-12-01T16:00:21.858238+0000","last_fullsized":"2023-12-01T16:00:21.858238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2100","last_scrub_stamp":"2023-12-01T16:00:21.858173+0000","last_deep_scrub":"44'2100","last_deep_scrub_stamp":"2023-12-01T16:00:21.858173+0000","last_clean_scrub_stamp":"2023-12-01T16:00:21.858173+0000","objects_scrubbed":2,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:06.641876+0000","scrub_duration":0.043601572999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2089,"num_write_kb":16989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"44'3666","reported_seq":3088,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:21.094948+0000","last_change":"2023-12-01T16:00:21.095073+0000","last_active":"2023-12-01T16:00:21.094948+0000","last_peered":"2023-12-01T16:00:21.094948+0000","last_clean":"2023-12-01T16:00:21.094948+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T16:00:21.094948+0000","last_undegraded":"2023-12-01T16:00:21.094948+0000","last_fullsized":"2023-12-01T16:00:21.094948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3666","last_scrub_stamp":"2023-12-01T16:00:21.094921+0000","last_deep_scrub":"44'3666","last_deep_scrub_stamp":"2023-12-01T16:00:21.094921+0000","last_clean_scrub_stamp":"2023-12-01T16:00:21.094921+0000","objects_scrubbed":1,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:41:15.386618+0000","scrub_duration":0.048431008999999997,"objects_trimmed":0,"snaptrim_duration":0.084960400000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1169,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'641","reported_seq":695,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:10.011211+0000","last_change":"2023-12-01T16:00:10.011337+0000","last_active":"2023-12-01T16:00:10.011211+0000","last_peered":"2023-12-01T16:00:10.011211+0000","last_clean":"2023-12-01T16:00:10.011211+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T16:00:10.011211+0000","last_undegraded":"2023-12-01T16:00:10.011211+0000","last_fullsized":"2023-12-01T16:00:10.011211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'641","last_scrub_stamp":"2023-12-01T16:00:10.011185+0000","last_deep_scrub":"44'641","last_deep_scrub_stamp":"2023-12-01T16:00:10.011185+0000","last_clean_scrub_stamp":"2023-12-01T16:00:10.011185+0000","objects_scrubbed":2,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:50:49.526785+0000","scrub_duration":0.024782471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1891144,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":643,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"43'3570","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:51.023765+0000","last_change":"2023-12-01T15:59:51.023871+0000","last_active":"2023-12-01T15:59:51.023765+0000","last_peered":"2023-12-01T15:59:51.023765+0000","last_clean":"2023-12-01T15:59:51.023765+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:59:51.023765+0000","last_undegraded":"2023-12-01T15:59:51.023765+0000","last_fullsized":"2023-12-01T15:59:51.023765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3570","last_scrub_stamp":"2023-12-01T15:59:51.023745+0000","last_deep_scrub":"43'3570","last_deep_scrub_stamp":"2023-12-01T15:59:51.023745+0000","last_clean_scrub_stamp":"2023-12-01T15:59:51.023745+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:48:17.901162+0000","scrub_duration":0.041221723000000002,"objects_trimmed":0,"snaptrim_duration":0.094045403999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'5943","reported_seq":5997,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:58.274157+0000","last_change":"2023-12-01T15:59:58.274287+0000","last_active":"2023-12-01T15:59:58.274157+0000","last_peered":"2023-12-01T15:59:58.274157+0000","last_clean":"2023-12-01T15:59:58.274157+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:59:58.274157+0000","last_undegraded":"2023-12-01T15:59:58.274157+0000","last_fullsized":"2023-12-01T15:59:58.274157+0000","mapping_epoch":16,"log_start":"21'300","ondisk_log_start":"21'300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'5943","last_scrub_stamp":"2023-12-01T15:59:58.274135+0000","last_deep_scrub":"44'5943","last_deep_scrub_stamp":"2023-12-01T15:59:58.274135+0000","last_clean_scrub_stamp":"2023-12-01T15:59:58.274135+0000","objects_scrubbed":7,"log_size":5643,"log_dups_size":0,"ondisk_log_size":5643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:27:01.882725+0000","scrub_duration":0.087623041999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5940,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1000,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3526","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.595185+0000","last_change":"2023-12-01T15:59:54.595288+0000","last_active":"2023-12-01T15:59:54.595185+0000","last_peered":"2023-12-01T15:59:54.595185+0000","last_clean":"2023-12-01T15:59:54.595185+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:59:54.595185+0000","last_undegraded":"2023-12-01T15:59:54.595185+0000","last_fullsized":"2023-12-01T15:59:54.595185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3526","last_scrub_stamp":"2023-12-01T15:59:54.595164+0000","last_deep_scrub":"44'3526","last_deep_scrub_stamp":"2023-12-01T15:59:54.595164+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.595164+0000","objects_scrubbed":1,"log_size":3526,"log_dups_size":0,"ondisk_log_size":3526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:27.589168+0000","scrub_duration":0.038520889000000003,"objects_trimmed":0,"snaptrim_duration":0.134288985,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"44'3430","reported_seq":3486,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:38.898618+0000","last_change":"2023-12-01T16:00:38.898867+0000","last_active":"2023-12-01T16:00:38.898618+0000","last_peered":"2023-12-01T16:00:38.898618+0000","last_clean":"2023-12-01T16:00:38.898618+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T16:00:38.898618+0000","last_undegraded":"2023-12-01T16:00:38.898618+0000","last_fullsized":"2023-12-01T16:00:38.898618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3430","last_scrub_stamp":"2023-12-01T16:00:38.898571+0000","last_deep_scrub":"44'3430","last_deep_scrub_stamp":"2023-12-01T16:00:38.898571+0000","last_clean_scrub_stamp":"2023-12-01T16:00:38.898571+0000","objects_scrubbed":4,"log_size":3430,"log_dups_size":0,"ondisk_log_size":3430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:04.637107+0000","scrub_duration":0.066174637999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3411,"num_write_kb":30086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4050","reported_seq":3343,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.042427+0000","last_change":"2023-12-01T15:59:54.042427+0000","last_active":"2023-12-01T15:59:54.042427+0000","last_peered":"2023-12-01T15:59:54.042427+0000","last_clean":"2023-12-01T15:59:54.042427+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:59:54.042427+0000","last_undegraded":"2023-12-01T15:59:54.042427+0000","last_fullsized":"2023-12-01T15:59:54.042427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4050","last_scrub_stamp":"2023-12-01T15:59:54.042107+0000","last_deep_scrub":"44'4050","last_deep_scrub_stamp":"2023-12-01T15:59:54.042107+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.042107+0000","objects_scrubbed":3,"log_size":4050,"log_dups_size":0,"ondisk_log_size":4050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:49:35.606734+0000","scrub_duration":0.048885451000000003,"objects_trimmed":0,"snaptrim_duration":0.091841191000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"44'1806","reported_seq":1862,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:39.925300+0000","last_change":"2023-12-01T16:00:39.925536+0000","last_active":"2023-12-01T16:00:39.925300+0000","last_peered":"2023-12-01T16:00:39.925300+0000","last_clean":"2023-12-01T16:00:39.925300+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T16:00:39.925300+0000","last_undegraded":"2023-12-01T16:00:39.925300+0000","last_fullsized":"2023-12-01T16:00:39.925300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1806","last_scrub_stamp":"2023-12-01T16:00:39.925228+0000","last_deep_scrub":"44'1806","last_deep_scrub_stamp":"2023-12-01T16:00:39.925228+0000","last_clean_scrub_stamp":"2023-12-01T16:00:39.925228+0000","objects_scrubbed":3,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:32:45.152512+0000","scrub_duration":0.050226169000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1812,"num_write_kb":15324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26782,"num_omap_keys":50,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":76140,"num_write_kb":40588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225590,"ondisk_log_size":225590,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":277882502,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":223,"num_read_kb":3419,"num_write":76837,"num_write_kb":641165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5310321,"num_omap_keys":10576,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":555827200,"data_stored":555765004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76453,"ondisk_log_size":76453,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705874,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":682768,"kb_used_data":134088,"kb_used_omap":0,"kb_used_meta":548672,"kb_avail":93689072,"statfs":{"total":96636764160,"available":95937609728,"internally_reserved":0,"allocated":137306112,"data_stored":136947550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":561840128},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 16:00:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":0.78700000000000003,"15min":0.65900000000000003},"min":{"1min":0.37,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":8.3049999999999997,"5min":10.84,"15min":10.84},"last":0.878},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96199999999999997,"15min":0.72699999999999998},"min":{"1min":0.47199999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.2320000000000002,"5min":11.926,"15min":11.926},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Dec 1 16:00:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":0.81000000000000005,"15min":0.68700000000000006},"min":{"1min":0.372,"5min":0.246,"15min":0.246},"max":{"1min":8.3399999999999999,"5min":10.807,"15min":10.807},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.86099999999999999,"5min":3.552,"15min":3.552},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Dec 1 16:00:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.79600000000000004,"15min":0.64400000000000002},"min":{"1min":0.45900000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":5.0419999999999998,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.751,"15min":0.66100000000000003},"min":{"1min":0.46100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.4039999999999999,"5min":10.715999999999999,"15min":10.715999999999999},"last":0.63200000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705875,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":805988,"kb_used_data":157276,"kb_used_omap":0,"kb_used_meta":648704,"kb_avail":93565852,"statfs":{"total":96636764160,"available":95811432448,"internally_reserved":0,"allocated":161050624,"data_stored":160683934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":664272896},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 15:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69699999999999995,"15min":0.66300000000000003},"min":{"1min":0.23599999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.83199999999999996,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60699999999999998,"15min":0.64900000000000002},"min":{"1min":0.316,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75800000000000001,"5min":0.91200000000000003,"15min":2.657},"last":0.64300000000000002}]},{"osd":1,"last update":"Fri Dec 1 15:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.69099999999999995,"15min":0.65800000000000003},"min":{"1min":0.26300000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.81799999999999995,"5min":8.0779999999999994,"15min":8.0779999999999994},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.39800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.77300000000000002,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Dec 1 15:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.55800000000000005},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61599999999999999,"5min":2.048,"15min":7.5289999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.70699999999999996,"15min":0.66200000000000003},"min":{"1min":0.29799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.92400000000000004,"5min":8.0370000000000008,"15min":9.8949999999999996},"last":0.59999999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705874,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589244,"kb_used_data":98868,"kb_used_omap":0,"kb_used_meta":490368,"kb_avail":93782596,"statfs":{"total":96636764160,"available":96033378304,"internally_reserved":0,"allocated":101240832,"data_stored":100906009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502136832},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 16:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.504},"min":{"1min":0.192,"5min":0.17399999999999999,"15min":0.17299999999999999},"max":{"1min":0.70899999999999996,"5min":0.749,"15min":8.4589999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.52000000000000002,"15min":0.53600000000000003},"min":{"1min":0.26800000000000002,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":0.65800000000000003,"5min":1.669,"15min":1.7729999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Dec 1 16:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.76300000000000001,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.625,"15min":0.67500000000000004},"min":{"1min":0.35399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74299999999999999,"5min":2.6640000000000001,"15min":10.914999999999999},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Dec 1 16:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.66100000000000003},"min":{"1min":0.33800000000000002,"5min":0.28100000000000003,"15min":0.251},"max":{"1min":0.80400000000000005,"5min":1.641,"15min":1.641},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70999999999999996,"15min":0.69899999999999995},"min":{"1min":0.52900000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88500000000000001,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.74399999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705874,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814568,"kb_used_data":156000,"kb_used_omap":0,"kb_used_meta":658560,"kb_avail":93557272,"statfs":{"total":96636764160,"available":95802646528,"internally_reserved":0,"allocated":159744000,"data_stored":159387283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":674365440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 16:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.65700000000000003,"5min":1.595,"15min":1.595},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.622},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.92400000000000004,"5min":3.3639999999999999,"15min":30.995000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Dec 1 16:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.62,"15min":0.72399999999999998},"min":{"1min":0.29799999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.0569999999999999,"5min":1.5069999999999999,"15min":24.504000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65200000000000002,"15min":0.75600000000000001},"min":{"1min":0.32100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0229999999999999,"5min":1.526,"15min":24.524999999999999},"last":0.872}]},{"osd":3,"last update":"Fri Dec 1 16:00:03 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.31,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":10.250999999999999,"5min":10.250999999999999,"15min":31.038},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.194,"5min":0.73999999999999999,"15min":0.72799999999999998},"min":{"1min":0.34399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":10.209,"5min":10.209,"15min":10.209},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":158564352,"data_stored":158550118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":160464896,"data_stored":160441193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":136134656,"data_stored":136110397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T16:00:47.639 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.640 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.640 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.640 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.641 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.641 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.641 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.641 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.642 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.642 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.642 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.642 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.643 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.643 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.643 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.644 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.644 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.644 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-01T15:43:34.700727+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=34, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.644 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.644 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.645 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.645 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.645 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.645 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.646 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-01T15:43:40.008046+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.646 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:00:47.647 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-01T16:00:48.493 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:00:48.496 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:00:48.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:01:07.648 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T16:01:07.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.755+0000 7f319d94f700 1 Processor -- start 2023-12-01T16:01:07.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.755+0000 7f319d94f700 1 -- start start 2023-12-01T16:01:07.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d94f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f319813da50 0x7f319813fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:07.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d94f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31980a40a0 con 0x7f3198133d20 2023-12-01T16:01:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d94f700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3198133840 con 0x7f3198139f40 2023-12-01T16:01:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d94f700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3198133b00 con 0x7f319813da50 2023-12-01T16:01:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319c94d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3198133d20 0x7f3198134100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:53224/0 (socket says 172.21.15.63:53224) 2023-12-01T16:01:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319c94d700 1 -- 172.21.15.63:0/968540749 learned_addr learned my addr 172.21.15.63:0/968540749 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T16:01:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d14e700 1 --2- 172.21.15.63:0/968540749 >> v2:172.21.15.66:3300/0 conn(0x7f319813da50 0x7f319813fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f318f7fe700 1 -- 172.21.15.63:0/968540749 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323023342 0 0) 0x7f31980a40a0 con 0x7f3198133d20 2023-12-01T16:01:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f318f7fe700 1 -- 172.21.15.63:0/968540749 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31800034f0 con 0x7f3198133d20 2023-12-01T16:01:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f318f7fe700 1 -- 172.21.15.63:0/968540749 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 576296528 0 0) 0x7f31800034f0 con 0x7f3198133d20 2023-12-01T16:01:07.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d14e700 1 -- 172.21.15.63:0/968540749 >> v1:172.21.15.66:6789/0 conn(0x7f3198139f40 legacy=0x7f319813c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:07.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d14e700 1 -- 172.21.15.63:0/968540749 >> v1:172.21.15.63:6789/0 conn(0x7f3198133d20 legacy=0x7f3198134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:07.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d14e700 1 -- 172.21.15.63:0/968540749 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319806ce70 con 0x7f319813da50 2023-12-01T16:01:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d14e700 1 --2- 172.21.15.63:0/968540749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319813da50 0x7f319813fe40 secure :-1 s=READY pgs=2946 cs=0 l=1 rev1=1 crypto rx=0x7f3190009dc0 tx=0x7f319000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbd1fa7f3de57bcc server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f318f7fe700 1 -- 172.21.15.63:0/968540749 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000e070 con 0x7f319813da50 2023-12-01T16:01:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f318f7fe700 1 -- 172.21.15.63:0/968540749 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3190003a40 con 0x7f319813da50 2023-12-01T16:01:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f318f7fe700 1 -- 172.21.15.63:0/968540749 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194001670 con 0x7f319813da50 2023-12-01T16:01:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d94f700 1 -- 172.21.15.63:0/968540749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319813da50 msgr2=0x7f319813fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d94f700 1 --2- 172.21.15.63:0/968540749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319813da50 0x7f319813fe40 secure :-1 s=READY pgs=2946 cs=0 l=1 rev1=1 crypto rx=0x7f3190009dc0 tx=0x7f319000b330 comp rx=0 tx=0).stop 2023-12-01T16:01:07.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d94f700 1 -- 172.21.15.63:0/968540749 shutdown_connections 2023-12-01T16:01:07.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d94f700 1 --2- 172.21.15.63:0/968540749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319813da50 0x7f319813fe40 unknown :-1 s=CLOSED pgs=2946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:07.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d94f700 1 -- 172.21.15.63:0/968540749 >> 172.21.15.63:0/968540749 conn(0x7f31980a5cc0 msgr2=0x7f31980a60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:07.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d94f700 1 -- 172.21.15.63:0/968540749 shutdown_connections 2023-12-01T16:01:07.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.759+0000 7f319d94f700 1 -- 172.21.15.63:0/968540749 wait complete. 2023-12-01T16:01:07.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d94f700 1 Processor -- start 2023-12-01T16:01:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d94f700 1 -- start start 2023-12-01T16:01:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d94f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3198133d20 0x7f31981caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d94f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3198139f40 0x7f31981cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d94f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319813da50 0x7f31981cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d94f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3198134820 con 0x7f3198133d20 2023-12-01T16:01:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d94f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3198070760 con 0x7f319813da50 2023-12-01T16:01:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d94f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3198135800 con 0x7f3198139f40 2023-12-01T16:01:07.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319c94d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3198133d20 0x7f31981caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:07.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319c94d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3198133d20 0x7f31981caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54176/0 (socket says 172.21.15.63:54176) 2023-12-01T16:01:07.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319c94d700 1 -- 172.21.15.63:0/945639798 learned_addr learned my addr 172.21.15.63:0/945639798 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:01:07.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f318ffff700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3198139f40 0x7f31981cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:07.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d14e700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319813da50 0x7f31981cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:07.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319c94d700 1 -- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3198139f40 msgr2=0x7f31981cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:07.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319c94d700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3198139f40 0x7f31981cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:07.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319c94d700 1 -- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319813da50 msgr2=0x7f31981cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:07.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319c94d700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319813da50 0x7f31981cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:07.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319c94d700 1 -- 172.21.15.63:0/945639798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190009a70 con 0x7f3198133d20 2023-12-01T16:01:07.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d14e700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319813da50 0x7f31981cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T16:01:07.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319c94d700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3198133d20 0x7f31981caf40 secure :-1 s=READY pgs=2963 cs=0 l=1 rev1=1 crypto rx=0x7f319400c750 tx=0x7f319400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:07.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f318d7fa700 1 -- 172.21.15.63:0/945639798 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194004ca0 con 0x7f3198133d20 2023-12-01T16:01:07.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f318d7fa700 1 -- 172.21.15.63:0/945639798 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3194004e20 con 0x7f3198133d20 2023-12-01T16:01:07.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d94f700 1 -- 172.21.15.63:0/945639798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3198135f70 con 0x7f3198133d20 2023-12-01T16:01:07.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f318d7fa700 1 -- 172.21.15.63:0/945639798 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194007310 con 0x7f3198133d20 2023-12-01T16:01:07.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.763+0000 7f319d94f700 1 -- 172.21.15.63:0/945639798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31981369e0 con 0x7f3198133d20 2023-12-01T16:01:07.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.767+0000 7f319d94f700 1 -- 172.21.15.63:0/945639798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3198070360 con 0x7f3198133d20 2023-12-01T16:01:07.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.767+0000 7f318d7fa700 1 -- 172.21.15.63:0/945639798 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3194007470 con 0x7f3198133d20 2023-12-01T16:01:07.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.767+0000 7f318d7fa700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3184065ad0 0x7f3184067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:07.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.767+0000 7f318d7fa700 1 -- 172.21.15.63:0/945639798 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7f3194081e30 con 0x7f3198133d20 2023-12-01T16:01:07.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.767+0000 7f318ffff700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3184065ad0 0x7f3184067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:07.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.767+0000 7f318ffff700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3184065ad0 0x7f3184067f90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3198072120 tx=0x7f3188009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:07.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.775+0000 7f318d7fa700 1 -- 172.21.15.63:0/945639798 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f319404fd20 con 0x7f3198133d20 2023-12-01T16:01:07.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.939+0000 7f319d94f700 1 -- 172.21.15.63:0/945639798 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f319806dff0 con 0x7f3184065ad0 2023-12-01T16:01:07.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.951+0000 7f318d7fa700 1 -- 172.21.15.63:0/945639798 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281678 (secure 0 0 0) 0x7f31880050d0 con 0x7f3184065ad0 2023-12-01T16:01:07.967 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T16:01:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 -- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3184065ad0 msgr2=0x7f3184067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3184065ad0 0x7f3184067f90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3198072120 tx=0x7f3188009040 comp rx=0 tx=0).stop 2023-12-01T16:01:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 -- 172.21.15.63:0/945639798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3198133d20 msgr2=0x7f31981caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3198133d20 0x7f31981caf40 secure :-1 s=READY pgs=2963 cs=0 l=1 rev1=1 crypto rx=0x7f319400c750 tx=0x7f319400cb10 comp rx=0 tx=0).stop 2023-12-01T16:01:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 -- 172.21.15.63:0/945639798 shutdown_connections 2023-12-01T16:01:07.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3184065ad0 0x7f3184067f90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:07.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3198139f40 0x7f31981cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:07.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319813da50 0x7f31981cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:07.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 --2- 172.21.15.63:0/945639798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3198133d20 0x7f31981caf40 unknown :-1 s=CLOSED pgs=2963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:07.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 -- 172.21.15.63:0/945639798 >> 172.21.15.63:0/945639798 conn(0x7f31980a5cc0 msgr2=0x7f3198069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:07.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 -- 172.21.15.63:0/945639798 shutdown_connections 2023-12-01T16:01:07.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:07.955+0000 7f319d94f700 1 -- 172.21.15.63:0/945639798 wait complete. 2023-12-01T16:01:07.975 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T16:01:07.983 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2023-12-01T16:01:06.732238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":278600058,"num_objects":242,"num_object_clones":28,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":15,"num_read":370,"num_read_kb":3540,"num_write":153136,"num_write_kb":684169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5327133,"num_omap_keys":10604,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302189,"ondisk_log_size":302189,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":2876184,"kb_used_data":546232,"kb_used_omap":0,"kb_used_meta":2329920,"kb_avail":374611176,"statfs":{"total":386547056640,"available":383601844224,"internally_reserved":0,"allocated":559341568,"data_stored":557924776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2385838080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16812,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004731"},"pg_stats":[{"pgid":"4.3f","version":"43'3303","reported_seq":2800,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.720152+0000","last_change":"2023-12-01T15:59:36.960583+0000","last_active":"2023-12-01T15:59:44.720152+0000","last_peered":"2023-12-01T15:59:44.720152+0000","last_clean":"2023-12-01T15:59:44.720152+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T15:59:44.720152+0000","last_undegraded":"2023-12-01T15:59:44.720152+0000","last_fullsized":"2023-12-01T15:59:44.720152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13670799,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"44'3497","reported_seq":2969,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:37.162739+0000","last_change":"2023-12-01T16:00:37.162955+0000","last_active":"2023-12-01T16:00:37.162739+0000","last_peered":"2023-12-01T16:00:37.162739+0000","last_clean":"2023-12-01T16:00:37.162739+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T16:00:37.162739+0000","last_undegraded":"2023-12-01T16:00:37.162739+0000","last_fullsized":"2023-12-01T16:00:37.162739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3497","last_scrub_stamp":"2023-12-01T16:00:37.162676+0000","last_deep_scrub":"44'3497","last_deep_scrub_stamp":"2023-12-01T16:00:37.162676+0000","last_clean_scrub_stamp":"2023-12-01T16:00:37.162676+0000","objects_scrubbed":1,"log_size":3497,"log_dups_size":0,"ondisk_log_size":3497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:47:58.369574+0000","scrub_duration":0.043835766999999998,"objects_trimmed":0,"snaptrim_duration":0.085048589999999993,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'3434","reported_seq":2898,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174865+0000","last_change":"2023-12-01T15:59:36.980200+0000","last_active":"2023-12-01T15:59:46.174865+0000","last_peered":"2023-12-01T15:59:46.174865+0000","last_clean":"2023-12-01T15:59:46.174865+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T15:59:46.174865+0000","last_undegraded":"2023-12-01T15:59:46.174865+0000","last_fullsized":"2023-12-01T15:59:46.174865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15483981599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"44'3688","reported_seq":3053,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.948071+0000","last_change":"2023-12-01T15:59:46.948071+0000","last_active":"2023-12-01T15:59:46.948071+0000","last_peered":"2023-12-01T15:59:46.948071+0000","last_clean":"2023-12-01T15:59:46.948071+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:59:46.948071+0000","last_undegraded":"2023-12-01T15:59:46.948071+0000","last_fullsized":"2023-12-01T15:59:46.948071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3688","last_scrub_stamp":"2023-12-01T15:59:46.947938+0000","last_deep_scrub":"44'3688","last_deep_scrub_stamp":"2023-12-01T15:59:46.947938+0000","last_clean_scrub_stamp":"2023-12-01T15:59:46.947938+0000","objects_scrubbed":1,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:14:57.265242+0000","scrub_duration":0.050574905000000003,"objects_trimmed":0,"snaptrim_duration":0.086572531999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"44'3487","reported_seq":2931,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:03.860344+0000","last_change":"2023-12-01T16:01:03.860477+0000","last_active":"2023-12-01T16:01:03.860344+0000","last_peered":"2023-12-01T16:01:03.860344+0000","last_clean":"2023-12-01T16:01:03.860344+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T16:01:03.860344+0000","last_undegraded":"2023-12-01T16:01:03.860344+0000","last_fullsized":"2023-12-01T16:01:03.860344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3487","last_scrub_stamp":"2023-12-01T16:01:03.860317+0000","last_deep_scrub":"44'3487","last_deep_scrub_stamp":"2023-12-01T16:01:03.860317+0000","last_clean_scrub_stamp":"2023-12-01T16:01:03.860317+0000","objects_scrubbed":2,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:34.904800+0000","scrub_duration":0.043185085999999998,"objects_trimmed":0,"snaptrim_duration":0.13014335599999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'3421","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:10.244937+0000","last_change":"2023-12-01T16:00:10.245065+0000","last_active":"2023-12-01T16:00:10.244937+0000","last_peered":"2023-12-01T16:00:10.244937+0000","last_clean":"2023-12-01T16:00:10.244937+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T16:00:10.244937+0000","last_undegraded":"2023-12-01T16:00:10.244937+0000","last_fullsized":"2023-12-01T16:00:10.244937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3421","last_scrub_stamp":"2023-12-01T16:00:10.244912+0000","last_deep_scrub":"44'3421","last_deep_scrub_stamp":"2023-12-01T16:00:10.244912+0000","last_clean_scrub_stamp":"2023-12-01T16:00:10.244912+0000","objects_scrubbed":2,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:05.632092+0000","scrub_duration":0.052734889,"objects_trimmed":0,"snaptrim_duration":0.133828119,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"44'3768","reported_seq":3234,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:26.267026+0000","last_change":"2023-12-01T16:00:26.267141+0000","last_active":"2023-12-01T16:00:26.267026+0000","last_peered":"2023-12-01T16:00:26.267026+0000","last_clean":"2023-12-01T16:00:26.267026+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T16:00:26.267026+0000","last_undegraded":"2023-12-01T16:00:26.267026+0000","last_fullsized":"2023-12-01T16:00:26.267026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3768","last_scrub_stamp":"2023-12-01T16:00:26.267005+0000","last_deep_scrub":"44'3768","last_deep_scrub_stamp":"2023-12-01T16:00:26.267005+0000","last_clean_scrub_stamp":"2023-12-01T16:00:26.267005+0000","objects_scrubbed":4,"log_size":3768,"log_dups_size":0,"ondisk_log_size":3768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:47:15.591358+0000","scrub_duration":0.046986235000000001,"objects_trimmed":0,"snaptrim_duration":0.16251290900000001,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'3433","reported_seq":2838,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477401+0000","last_change":"2023-12-01T15:59:36.975843+0000","last_active":"2023-12-01T15:59:43.477401+0000","last_peered":"2023-12-01T15:59:43.477401+0000","last_clean":"2023-12-01T15:59:43.477401+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T15:59:43.477401+0000","last_undegraded":"2023-12-01T15:59:43.477401+0000","last_fullsized":"2023-12-01T15:59:43.477401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3433,"log_dups_size":0,"ondisk_log_size":3433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.173046373,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"43'3524","reported_seq":2944,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:44.720082+0000","last_change":"2023-12-01T15:59:36.960250+0000","last_active":"2023-12-01T15:59:44.720082+0000","last_peered":"2023-12-01T15:59:44.720082+0000","last_clean":"2023-12-01T15:59:44.720082+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T15:59:44.720082+0000","last_undegraded":"2023-12-01T15:59:44.720082+0000","last_fullsized":"2023-12-01T15:59:44.720082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13648046599999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'3320","reported_seq":2811,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174591+0000","last_change":"2023-12-01T15:59:36.978454+0000","last_active":"2023-12-01T15:59:46.174591+0000","last_peered":"2023-12-01T15:59:46.174591+0000","last_clean":"2023-12-01T15:59:46.174591+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T15:59:46.174591+0000","last_undegraded":"2023-12-01T15:59:46.174591+0000","last_fullsized":"2023-12-01T15:59:46.174591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.160523057,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"44'3408","reported_seq":2882,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.074578+0000","last_change":"2023-12-01T15:59:56.074578+0000","last_active":"2023-12-01T15:59:56.074578+0000","last_peered":"2023-12-01T15:59:56.074578+0000","last_clean":"2023-12-01T15:59:56.074578+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:59:56.074578+0000","last_undegraded":"2023-12-01T15:59:56.074578+0000","last_fullsized":"2023-12-01T15:59:56.074578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3408","last_scrub_stamp":"2023-12-01T15:59:56.074209+0000","last_deep_scrub":"44'3408","last_deep_scrub_stamp":"2023-12-01T15:59:56.074209+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.074209+0000","objects_scrubbed":1,"log_size":3408,"log_dups_size":0,"ondisk_log_size":3408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:17.450625+0000","scrub_duration":0.044446310000000003,"objects_trimmed":0,"snaptrim_duration":0.080275320999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"43'3529","reported_seq":2915,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:49.279167+0000","last_change":"2023-12-01T16:00:49.279281+0000","last_active":"2023-12-01T16:00:49.279167+0000","last_peered":"2023-12-01T16:00:49.279167+0000","last_clean":"2023-12-01T16:00:49.279167+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T16:00:49.279167+0000","last_undegraded":"2023-12-01T16:00:49.279167+0000","last_fullsized":"2023-12-01T16:00:49.279167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3529","last_scrub_stamp":"2023-12-01T16:00:49.279144+0000","last_deep_scrub":"43'3529","last_deep_scrub_stamp":"2023-12-01T16:00:49.279144+0000","last_clean_scrub_stamp":"2023-12-01T16:00:49.279144+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:08:16.628877+0000","scrub_duration":0.036435990000000001,"objects_trimmed":0,"snaptrim_duration":0.63957533600000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"44'3183","reported_seq":2667,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:59.957039+0000","last_change":"2023-12-01T16:00:59.957213+0000","last_active":"2023-12-01T16:00:59.957039+0000","last_peered":"2023-12-01T16:00:59.957039+0000","last_clean":"2023-12-01T16:00:59.957039+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T16:00:59.957039+0000","last_undegraded":"2023-12-01T16:00:59.957039+0000","last_fullsized":"2023-12-01T16:00:59.957039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3183","last_scrub_stamp":"2023-12-01T16:00:59.957004+0000","last_deep_scrub":"44'3183","last_deep_scrub_stamp":"2023-12-01T16:00:59.957004+0000","last_clean_scrub_stamp":"2023-12-01T16:00:59.957004+0000","objects_scrubbed":5,"log_size":3183,"log_dups_size":0,"ondisk_log_size":3183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:33:13.277284+0000","scrub_duration":0.063358216999999994,"objects_trimmed":0,"snaptrim_duration":0.138334033,"stat_sum":{"num_bytes":12297,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"43'3508","reported_seq":2945,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.031371+0000","last_change":"2023-12-01T16:00:23.031526+0000","last_active":"2023-12-01T16:00:23.031371+0000","last_peered":"2023-12-01T16:00:23.031371+0000","last_clean":"2023-12-01T16:00:23.031371+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T16:00:23.031371+0000","last_undegraded":"2023-12-01T16:00:23.031371+0000","last_fullsized":"2023-12-01T16:00:23.031371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3508","last_scrub_stamp":"2023-12-01T16:00:23.031325+0000","last_deep_scrub":"43'3508","last_deep_scrub_stamp":"2023-12-01T16:00:23.031325+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.031325+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:08.388208+0000","scrub_duration":0.040441997,"objects_trimmed":0,"snaptrim_duration":0.091404182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"44'3602","reported_seq":3022,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:41.172312+0000","last_change":"2023-12-01T16:00:41.172431+0000","last_active":"2023-12-01T16:00:41.172312+0000","last_peered":"2023-12-01T16:00:41.172312+0000","last_clean":"2023-12-01T16:00:41.172312+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T16:00:41.172312+0000","last_undegraded":"2023-12-01T16:00:41.172312+0000","last_fullsized":"2023-12-01T16:00:41.172312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3602","last_scrub_stamp":"2023-12-01T16:00:41.172283+0000","last_deep_scrub":"44'3602","last_deep_scrub_stamp":"2023-12-01T16:00:41.172283+0000","last_clean_scrub_stamp":"2023-12-01T16:00:41.172283+0000","objects_scrubbed":2,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:06.910819+0000","scrub_duration":0.043202600000000001,"objects_trimmed":0,"snaptrim_duration":0.086861997999999996,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1247,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"44'3536","reported_seq":2958,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:35.372431+0000","last_change":"2023-12-01T16:00:35.372603+0000","last_active":"2023-12-01T16:00:35.372431+0000","last_peered":"2023-12-01T16:00:35.372431+0000","last_clean":"2023-12-01T16:00:35.372431+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T16:00:35.372431+0000","last_undegraded":"2023-12-01T16:00:35.372431+0000","last_fullsized":"2023-12-01T16:00:35.372431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3536","last_scrub_stamp":"2023-12-01T16:00:35.372401+0000","last_deep_scrub":"44'3536","last_deep_scrub_stamp":"2023-12-01T16:00:35.372401+0000","last_clean_scrub_stamp":"2023-12-01T16:00:35.372401+0000","objects_scrubbed":3,"log_size":3536,"log_dups_size":0,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:06:41.936183+0000","scrub_duration":0.066751594999999997,"objects_trimmed":0,"snaptrim_duration":0.17327173600000001,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"43'3588","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:58.919901+0000","last_change":"2023-12-01T16:00:58.920190+0000","last_active":"2023-12-01T16:00:58.919901+0000","last_peered":"2023-12-01T16:00:58.919901+0000","last_clean":"2023-12-01T16:00:58.919901+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T16:00:58.919901+0000","last_undegraded":"2023-12-01T16:00:58.919901+0000","last_fullsized":"2023-12-01T16:00:58.919901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3588","last_scrub_stamp":"2023-12-01T16:00:58.919824+0000","last_deep_scrub":"43'3588","last_deep_scrub_stamp":"2023-12-01T16:00:58.919824+0000","last_clean_scrub_stamp":"2023-12-01T16:00:58.919824+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:25:44.890371+0000","scrub_duration":0.034805932999999997,"objects_trimmed":0,"snaptrim_duration":0.13630616600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'3287","reported_seq":2802,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:20.266022+0000","last_change":"2023-12-01T16:00:20.266155+0000","last_active":"2023-12-01T16:00:20.266022+0000","last_peered":"2023-12-01T16:00:20.266022+0000","last_clean":"2023-12-01T16:00:20.266022+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T16:00:20.266022+0000","last_undegraded":"2023-12-01T16:00:20.266022+0000","last_fullsized":"2023-12-01T16:00:20.266022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3287","last_scrub_stamp":"2023-12-01T16:00:20.265995+0000","last_deep_scrub":"44'3287","last_deep_scrub_stamp":"2023-12-01T16:00:20.265995+0000","last_clean_scrub_stamp":"2023-12-01T16:00:20.265995+0000","objects_scrubbed":5,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:05.049698+0000","scrub_duration":0.052120284000000003,"objects_trimmed":0,"snaptrim_duration":0.159652814,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1044,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"43'3337","reported_seq":2789,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:56.885842+0000","last_change":"2023-12-01T16:00:56.886180+0000","last_active":"2023-12-01T16:00:56.885842+0000","last_peered":"2023-12-01T16:00:56.885842+0000","last_clean":"2023-12-01T16:00:56.885842+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T16:00:56.885842+0000","last_undegraded":"2023-12-01T16:00:56.885842+0000","last_fullsized":"2023-12-01T16:00:56.885842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3337","last_scrub_stamp":"2023-12-01T16:00:56.885792+0000","last_deep_scrub":"43'3337","last_deep_scrub_stamp":"2023-12-01T16:00:56.885792+0000","last_clean_scrub_stamp":"2023-12-01T16:00:56.885792+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:13:58.053769+0000","scrub_duration":0.041491897,"objects_trimmed":0,"snaptrim_duration":0.134439324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"43'3655","reported_seq":3092,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.477915+0000","last_change":"2023-12-01T15:59:36.963898+0000","last_active":"2023-12-01T15:59:43.477915+0000","last_peered":"2023-12-01T15:59:43.477915+0000","last_clean":"2023-12-01T15:59:43.477915+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T15:59:43.477915+0000","last_undegraded":"2023-12-01T15:59:43.477915+0000","last_fullsized":"2023-12-01T15:59:43.477915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3655,"log_dups_size":0,"ondisk_log_size":3655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16502647100000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"43'3592","reported_seq":3041,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:36.187374+0000","last_change":"2023-12-01T16:00:36.187561+0000","last_active":"2023-12-01T16:00:36.187374+0000","last_peered":"2023-12-01T16:00:36.187374+0000","last_clean":"2023-12-01T16:00:36.187374+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T16:00:36.187374+0000","last_undegraded":"2023-12-01T16:00:36.187374+0000","last_fullsized":"2023-12-01T16:00:36.187374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3592","last_scrub_stamp":"2023-12-01T16:00:36.187327+0000","last_deep_scrub":"43'3592","last_deep_scrub_stamp":"2023-12-01T16:00:36.187327+0000","last_clean_scrub_stamp":"2023-12-01T16:00:36.187327+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:15.645932+0000","scrub_duration":0.049762045999999997,"objects_trimmed":0,"snaptrim_duration":0.082049368999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"44'3500","reported_seq":2885,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:48.924370+0000","last_change":"2023-12-01T16:00:48.924735+0000","last_active":"2023-12-01T16:00:48.924370+0000","last_peered":"2023-12-01T16:00:48.924370+0000","last_clean":"2023-12-01T16:00:48.924370+0000","last_became_active":"2023-12-01T15:44:30.528283+0000","last_became_peered":"2023-12-01T15:44:30.528283+0000","last_unstale":"2023-12-01T16:00:48.924370+0000","last_undegraded":"2023-12-01T16:00:48.924370+0000","last_fullsized":"2023-12-01T16:00:48.924370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3500","last_scrub_stamp":"2023-12-01T16:00:48.924303+0000","last_deep_scrub":"44'3500","last_deep_scrub_stamp":"2023-12-01T16:00:48.924303+0000","last_clean_scrub_stamp":"2023-12-01T16:00:48.924303+0000","objects_scrubbed":6,"log_size":3500,"log_dups_size":0,"ondisk_log_size":3500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:29:43.670040+0000","scrub_duration":0.059716822000000003,"objects_trimmed":0,"snaptrim_duration":0.13495370100000001,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'3469","reported_seq":2938,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:43.353888+0000","last_change":"2023-12-01T16:00:43.354064+0000","last_active":"2023-12-01T16:00:43.353888+0000","last_peered":"2023-12-01T16:00:43.353888+0000","last_clean":"2023-12-01T16:00:43.353888+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T16:00:43.353888+0000","last_undegraded":"2023-12-01T16:00:43.353888+0000","last_fullsized":"2023-12-01T16:00:43.353888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3469","last_scrub_stamp":"2023-12-01T16:00:43.353860+0000","last_deep_scrub":"44'3469","last_deep_scrub_stamp":"2023-12-01T16:00:43.353860+0000","last_clean_scrub_stamp":"2023-12-01T16:00:43.353860+0000","objects_scrubbed":3,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:09.092397+0000","scrub_duration":0.046109907999999998,"objects_trimmed":0,"snaptrim_duration":0.62816057700000005,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"44'3578","reported_seq":2961,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:55.212242+0000","last_change":"2023-12-01T15:59:55.212383+0000","last_active":"2023-12-01T15:59:55.212242+0000","last_peered":"2023-12-01T15:59:55.212242+0000","last_clean":"2023-12-01T15:59:55.212242+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:59:55.212242+0000","last_undegraded":"2023-12-01T15:59:55.212242+0000","last_fullsized":"2023-12-01T15:59:55.212242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3578","last_scrub_stamp":"2023-12-01T15:59:55.212209+0000","last_deep_scrub":"44'3578","last_deep_scrub_stamp":"2023-12-01T15:59:55.212209+0000","last_clean_scrub_stamp":"2023-12-01T15:59:55.212209+0000","objects_scrubbed":1,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:16.402349+0000","scrub_duration":0.042530062,"objects_trimmed":0,"snaptrim_duration":0.17330785400000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"44'3345","reported_seq":2835,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:38.376718+0000","last_change":"2023-12-01T16:00:38.376863+0000","last_active":"2023-12-01T16:00:38.376718+0000","last_peered":"2023-12-01T16:00:38.376718+0000","last_clean":"2023-12-01T16:00:38.376718+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T16:00:38.376718+0000","last_undegraded":"2023-12-01T16:00:38.376718+0000","last_fullsized":"2023-12-01T16:00:38.376718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3345","last_scrub_stamp":"2023-12-01T16:00:38.376670+0000","last_deep_scrub":"44'3345","last_deep_scrub_stamp":"2023-12-01T16:00:38.376670+0000","last_clean_scrub_stamp":"2023-12-01T16:00:38.376670+0000","objects_scrubbed":1,"log_size":3345,"log_dups_size":0,"ondisk_log_size":3345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:17.835274+0000","scrub_duration":0.046600474000000003,"objects_trimmed":0,"snaptrim_duration":0.63729295699999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"44'3413","reported_seq":2877,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:41.365937+0000","last_change":"2023-12-01T16:00:41.366080+0000","last_active":"2023-12-01T16:00:41.365937+0000","last_peered":"2023-12-01T16:00:41.365937+0000","last_clean":"2023-12-01T16:00:41.365937+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T16:00:41.365937+0000","last_undegraded":"2023-12-01T16:00:41.365937+0000","last_fullsized":"2023-12-01T16:00:41.365937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3413","last_scrub_stamp":"2023-12-01T16:00:41.365907+0000","last_deep_scrub":"44'3413","last_deep_scrub_stamp":"2023-12-01T16:00:41.365907+0000","last_clean_scrub_stamp":"2023-12-01T16:00:41.365907+0000","objects_scrubbed":2,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:06:47.929689+0000","scrub_duration":0.039734258000000001,"objects_trimmed":0,"snaptrim_duration":0.611917673,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'3318","reported_seq":2756,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:16.227798+0000","last_change":"2023-12-01T16:00:16.227914+0000","last_active":"2023-12-01T16:00:16.227798+0000","last_peered":"2023-12-01T16:00:16.227798+0000","last_clean":"2023-12-01T16:00:16.227798+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T16:00:16.227798+0000","last_undegraded":"2023-12-01T16:00:16.227798+0000","last_fullsized":"2023-12-01T16:00:16.227798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3318","last_scrub_stamp":"2023-12-01T16:00:16.227776+0000","last_deep_scrub":"44'3318","last_deep_scrub_stamp":"2023-12-01T16:00:16.227776+0000","last_clean_scrub_stamp":"2023-12-01T16:00:16.227776+0000","objects_scrubbed":6,"log_size":3318,"log_dups_size":0,"ondisk_log_size":3318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:57.976090+0000","scrub_duration":0.063500757000000005,"objects_trimmed":0,"snaptrim_duration":0.146734475,"stat_sum":{"num_bytes":4116,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'3312","reported_seq":2784,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:44.354510+0000","last_change":"2023-12-01T16:00:44.354616+0000","last_active":"2023-12-01T16:00:44.354510+0000","last_peered":"2023-12-01T16:00:44.354510+0000","last_clean":"2023-12-01T16:00:44.354510+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T16:00:44.354510+0000","last_undegraded":"2023-12-01T16:00:44.354510+0000","last_fullsized":"2023-12-01T16:00:44.354510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3312","last_scrub_stamp":"2023-12-01T16:00:44.354488+0000","last_deep_scrub":"43'3312","last_deep_scrub_stamp":"2023-12-01T16:00:44.354488+0000","last_clean_scrub_stamp":"2023-12-01T16:00:44.354488+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:32:49.581772+0000","scrub_duration":0.043847218,"objects_trimmed":0,"snaptrim_duration":0.65414528699999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"44'3667","reported_seq":3056,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:51.903362+0000","last_change":"2023-12-01T16:00:51.903522+0000","last_active":"2023-12-01T16:00:51.903362+0000","last_peered":"2023-12-01T16:00:51.903362+0000","last_clean":"2023-12-01T16:00:51.903362+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T16:00:51.903362+0000","last_undegraded":"2023-12-01T16:00:51.903362+0000","last_fullsized":"2023-12-01T16:00:51.903362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3667","last_scrub_stamp":"2023-12-01T16:00:51.903321+0000","last_deep_scrub":"44'3667","last_deep_scrub_stamp":"2023-12-01T16:00:51.903321+0000","last_clean_scrub_stamp":"2023-12-01T16:00:51.903321+0000","objects_scrubbed":5,"log_size":3667,"log_dups_size":0,"ondisk_log_size":3667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:51:11.226126+0000","scrub_duration":0.056216544,"objects_trimmed":0,"snaptrim_duration":0.13835824199999999,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"44'3522","reported_seq":3006,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.187910+0000","last_change":"2023-12-01T15:59:48.187910+0000","last_active":"2023-12-01T15:59:48.187910+0000","last_peered":"2023-12-01T15:59:48.187910+0000","last_clean":"2023-12-01T15:59:48.187910+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:59:48.187910+0000","last_undegraded":"2023-12-01T15:59:48.187910+0000","last_fullsized":"2023-12-01T15:59:48.187910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3522","last_scrub_stamp":"2023-12-01T15:59:48.187580+0000","last_deep_scrub":"44'3522","last_deep_scrub_stamp":"2023-12-01T15:59:48.187580+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.187580+0000","objects_scrubbed":2,"log_size":3522,"log_dups_size":0,"ondisk_log_size":3522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:21.418682+0000","scrub_duration":0.049219767999999997,"objects_trimmed":0,"snaptrim_duration":0.13490588100000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"44'3995","reported_seq":3333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:26.522607+0000","last_change":"2023-12-01T16:00:26.522607+0000","last_active":"2023-12-01T16:00:26.522607+0000","last_peered":"2023-12-01T16:00:26.522607+0000","last_clean":"2023-12-01T16:00:26.522607+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T16:00:26.522607+0000","last_undegraded":"2023-12-01T16:00:26.522607+0000","last_fullsized":"2023-12-01T16:00:26.522607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3995","last_scrub_stamp":"2023-12-01T16:00:26.522403+0000","last_deep_scrub":"44'3995","last_deep_scrub_stamp":"2023-12-01T16:00:26.522403+0000","last_clean_scrub_stamp":"2023-12-01T16:00:26.522403+0000","objects_scrubbed":1,"log_size":3995,"log_dups_size":0,"ondisk_log_size":3995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:11.306106+0000","scrub_duration":0.045664127999999998,"objects_trimmed":0,"snaptrim_duration":0.65412195699999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"44'3597","reported_seq":3012,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:27.093419+0000","last_change":"2023-12-01T16:00:27.093419+0000","last_active":"2023-12-01T16:00:27.093419+0000","last_peered":"2023-12-01T16:00:27.093419+0000","last_clean":"2023-12-01T16:00:27.093419+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T16:00:27.093419+0000","last_undegraded":"2023-12-01T16:00:27.093419+0000","last_fullsized":"2023-12-01T16:00:27.093419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3597","last_scrub_stamp":"2023-12-01T16:00:27.093268+0000","last_deep_scrub":"44'3597","last_deep_scrub_stamp":"2023-12-01T16:00:27.093268+0000","last_clean_scrub_stamp":"2023-12-01T16:00:27.093268+0000","objects_scrubbed":5,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:25:51.950070+0000","scrub_duration":0.053776247999999999,"objects_trimmed":0,"snaptrim_duration":0.090414480000000005,"stat_sum":{"num_bytes":4118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"44'3662","reported_seq":3075,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:58.388349+0000","last_change":"2023-12-01T15:59:58.388349+0000","last_active":"2023-12-01T15:59:58.388349+0000","last_peered":"2023-12-01T15:59:58.388349+0000","last_clean":"2023-12-01T15:59:58.388349+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:59:58.388349+0000","last_undegraded":"2023-12-01T15:59:58.388349+0000","last_fullsized":"2023-12-01T15:59:58.388349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3662","last_scrub_stamp":"2023-12-01T15:59:58.388055+0000","last_deep_scrub":"44'3662","last_deep_scrub_stamp":"2023-12-01T15:59:58.388055+0000","last_clean_scrub_stamp":"2023-12-01T15:59:58.388055+0000","objects_scrubbed":1,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:31.619158+0000","scrub_duration":0.048690542000000003,"objects_trimmed":0,"snaptrim_duration":0.646838511,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"44'2737","reported_seq":2792,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:32.335426+0000","last_change":"2023-12-01T16:00:32.335578+0000","last_active":"2023-12-01T16:00:32.335426+0000","last_peered":"2023-12-01T16:00:32.335426+0000","last_clean":"2023-12-01T16:00:32.335426+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T16:00:32.335426+0000","last_undegraded":"2023-12-01T16:00:32.335426+0000","last_fullsized":"2023-12-01T16:00:32.335426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2737","last_scrub_stamp":"2023-12-01T16:00:32.335394+0000","last_deep_scrub":"44'2737","last_deep_scrub_stamp":"2023-12-01T16:00:32.335394+0000","last_clean_scrub_stamp":"2023-12-01T16:00:32.335394+0000","objects_scrubbed":3,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:11.793999+0000","scrub_duration":0.040503364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2729,"num_write_kb":18350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"43'3426","reported_seq":2846,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174811+0000","last_change":"2023-12-01T15:59:36.979597+0000","last_active":"2023-12-01T15:59:46.174811+0000","last_peered":"2023-12-01T15:59:46.174811+0000","last_clean":"2023-12-01T15:59:46.174811+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T15:59:46.174811+0000","last_undegraded":"2023-12-01T15:59:46.174811+0000","last_fullsized":"2023-12-01T15:59:46.174811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15458043599999999,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"35'5","reported_seq":60,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:36.838471+0000","last_change":"2023-12-01T16:00:36.838731+0000","last_active":"2023-12-01T16:00:36.838471+0000","last_peered":"2023-12-01T16:00:36.838471+0000","last_clean":"2023-12-01T16:00:36.838471+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T16:00:36.838471+0000","last_undegraded":"2023-12-01T16:00:36.838471+0000","last_fullsized":"2023-12-01T16:00:36.838471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2023-12-01T16:00:36.838414+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2023-12-01T16:00:36.838414+0000","last_clean_scrub_stamp":"2023-12-01T16:00:36.838414+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:06:43.402195+0000","scrub_duration":0.0045544590000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3629","reported_seq":3091,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.506683+0000","last_change":"2023-12-01T15:59:48.506683+0000","last_active":"2023-12-01T15:59:48.506683+0000","last_peered":"2023-12-01T15:59:48.506683+0000","last_clean":"2023-12-01T15:59:48.506683+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:59:48.506683+0000","last_undegraded":"2023-12-01T15:59:48.506683+0000","last_fullsized":"2023-12-01T15:59:48.506683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3629","last_scrub_stamp":"2023-12-01T15:59:48.506533+0000","last_deep_scrub":"44'3629","last_deep_scrub_stamp":"2023-12-01T15:59:48.506533+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.506533+0000","objects_scrubbed":1,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:08:56.880573+0000","scrub_duration":0.046519142999999999,"objects_trimmed":0,"snaptrim_duration":0.13624631700000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"44'1013","reported_seq":1068,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:11.216918+0000","last_change":"2023-12-01T16:00:11.217056+0000","last_active":"2023-12-01T16:00:11.216918+0000","last_peered":"2023-12-01T16:00:11.216918+0000","last_clean":"2023-12-01T16:00:11.216918+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T16:00:11.216918+0000","last_undegraded":"2023-12-01T16:00:11.216918+0000","last_fullsized":"2023-12-01T16:00:11.216918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1013","last_scrub_stamp":"2023-12-01T16:00:11.216892+0000","last_deep_scrub":"44'1013","last_deep_scrub_stamp":"2023-12-01T16:00:11.216892+0000","last_clean_scrub_stamp":"2023-12-01T16:00:11.216892+0000","objects_scrubbed":6,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:32.838433+0000","scrub_duration":0.058295441000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":10007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1316869,"num_omap_keys":2625,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"44'3453","reported_seq":2887,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.543735+0000","last_change":"2023-12-01T15:59:49.543735+0000","last_active":"2023-12-01T15:59:49.543735+0000","last_peered":"2023-12-01T15:59:49.543735+0000","last_clean":"2023-12-01T15:59:49.543735+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:59:49.543735+0000","last_undegraded":"2023-12-01T15:59:49.543735+0000","last_fullsized":"2023-12-01T15:59:49.543735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3453","last_scrub_stamp":"2023-12-01T15:59:49.543577+0000","last_deep_scrub":"44'3453","last_deep_scrub_stamp":"2023-12-01T15:59:49.543577+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.543577+0000","objects_scrubbed":2,"log_size":3453,"log_dups_size":0,"ondisk_log_size":3453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:22.774680+0000","scrub_duration":0.045727260999999998,"objects_trimmed":0,"snaptrim_duration":0.13638832000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'1390","reported_seq":1445,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:02.608754+0000","last_change":"2023-12-01T16:01:02.608882+0000","last_active":"2023-12-01T16:01:02.608754+0000","last_peered":"2023-12-01T16:01:02.608754+0000","last_clean":"2023-12-01T16:01:02.608754+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T16:01:02.608754+0000","last_undegraded":"2023-12-01T16:01:02.608754+0000","last_fullsized":"2023-12-01T16:01:02.608754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1390","last_scrub_stamp":"2023-12-01T16:01:02.608733+0000","last_deep_scrub":"44'1390","last_deep_scrub_stamp":"2023-12-01T16:01:02.608733+0000","last_clean_scrub_stamp":"2023-12-01T16:01:02.608733+0000","objects_scrubbed":6,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:20:19.379610+0000","scrub_duration":0.033745255000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1392,"num_write_kb":12529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16812,"num_omap_keys":28,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'1278","reported_seq":1333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:18.087582+0000","last_change":"2023-12-01T16:00:18.087703+0000","last_active":"2023-12-01T16:00:18.087582+0000","last_peered":"2023-12-01T16:00:18.087582+0000","last_clean":"2023-12-01T16:00:18.087582+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T16:00:18.087582+0000","last_undegraded":"2023-12-01T16:00:18.087582+0000","last_fullsized":"2023-12-01T16:00:18.087582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1278","last_scrub_stamp":"2023-12-01T16:00:18.087555+0000","last_deep_scrub":"44'1278","last_deep_scrub_stamp":"2023-12-01T16:00:18.087555+0000","last_clean_scrub_stamp":"2023-12-01T16:00:18.087555+0000","objects_scrubbed":2,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:13.474736+0000","scrub_duration":0.033204496999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":12495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'3658","reported_seq":3058,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:53.147914+0000","last_change":"2023-12-01T15:59:53.148041+0000","last_active":"2023-12-01T15:59:53.147914+0000","last_peered":"2023-12-01T15:59:53.147914+0000","last_clean":"2023-12-01T15:59:53.147914+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:59:53.147914+0000","last_undegraded":"2023-12-01T15:59:53.147914+0000","last_fullsized":"2023-12-01T15:59:53.147914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3658","last_scrub_stamp":"2023-12-01T15:59:53.147892+0000","last_deep_scrub":"43'3658","last_deep_scrub_stamp":"2023-12-01T15:59:53.147892+0000","last_clean_scrub_stamp":"2023-12-01T15:59:53.147892+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:26.141896+0000","scrub_duration":0.039317244000000001,"objects_trimmed":0,"snaptrim_duration":0.172903538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'1243","reported_seq":1298,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:05.986674+0000","last_change":"2023-12-01T16:00:05.986857+0000","last_active":"2023-12-01T16:00:05.986674+0000","last_peered":"2023-12-01T16:00:05.986674+0000","last_clean":"2023-12-01T16:00:05.986674+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T16:00:05.986674+0000","last_undegraded":"2023-12-01T16:00:05.986674+0000","last_fullsized":"2023-12-01T16:00:05.986674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1243","last_scrub_stamp":"2023-12-01T16:00:05.986638+0000","last_deep_scrub":"44'1243","last_deep_scrub_stamp":"2023-12-01T16:00:05.986638+0000","last_clean_scrub_stamp":"2023-12-01T16:00:05.986638+0000","objects_scrubbed":3,"log_size":1243,"log_dups_size":0,"ondisk_log_size":1243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:27.176778+0000","scrub_duration":0.028165143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1238,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'3445","reported_seq":2884,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:57.046416+0000","last_change":"2023-12-01T15:59:57.046543+0000","last_active":"2023-12-01T15:59:57.046416+0000","last_peered":"2023-12-01T15:59:57.046416+0000","last_clean":"2023-12-01T15:59:57.046416+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:59:57.046416+0000","last_undegraded":"2023-12-01T15:59:57.046416+0000","last_fullsized":"2023-12-01T15:59:57.046416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3445","last_scrub_stamp":"2023-12-01T15:59:57.046388+0000","last_deep_scrub":"44'3445","last_deep_scrub_stamp":"2023-12-01T15:59:57.046388+0000","last_clean_scrub_stamp":"2023-12-01T15:59:57.046388+0000","objects_scrubbed":3,"log_size":3445,"log_dups_size":0,"ondisk_log_size":3445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:06:40.083816+0000","scrub_duration":0.046119563000000002,"objects_trimmed":0,"snaptrim_duration":0.090755167999999997,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1186,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"44'4746","reported_seq":4801,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:42.519833+0000","last_change":"2023-12-01T16:00:42.519960+0000","last_active":"2023-12-01T16:00:42.519833+0000","last_peered":"2023-12-01T16:00:42.519833+0000","last_clean":"2023-12-01T16:00:42.519833+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T16:00:42.519833+0000","last_undegraded":"2023-12-01T16:00:42.519833+0000","last_fullsized":"2023-12-01T16:00:42.519833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4746","last_scrub_stamp":"2023-12-01T16:00:42.519805+0000","last_deep_scrub":"44'4746","last_deep_scrub_stamp":"2023-12-01T16:00:42.519805+0000","last_clean_scrub_stamp":"2023-12-01T16:00:42.519805+0000","objects_scrubbed":4,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:08:09.869538+0000","scrub_duration":0.057596223000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4735,"num_write_kb":27522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3360","reported_seq":2796,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.985855+0000","last_change":"2023-12-01T15:59:49.985964+0000","last_active":"2023-12-01T15:59:49.985855+0000","last_peered":"2023-12-01T15:59:49.985855+0000","last_clean":"2023-12-01T15:59:49.985855+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:59:49.985855+0000","last_undegraded":"2023-12-01T15:59:49.985855+0000","last_fullsized":"2023-12-01T15:59:49.985855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3360","last_scrub_stamp":"2023-12-01T15:59:49.985801+0000","last_deep_scrub":"44'3360","last_deep_scrub_stamp":"2023-12-01T15:59:49.985801+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.985801+0000","objects_scrubbed":1,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:22:12.421111+0000","scrub_duration":0.040212074,"objects_trimmed":0,"snaptrim_duration":0.090274558000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'1994","reported_seq":2049,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.208746+0000","last_change":"2023-12-01T16:00:23.208916+0000","last_active":"2023-12-01T16:00:23.208746+0000","last_peered":"2023-12-01T16:00:23.208746+0000","last_clean":"2023-12-01T16:00:23.208746+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T16:00:23.208746+0000","last_undegraded":"2023-12-01T16:00:23.208746+0000","last_fullsized":"2023-12-01T16:00:23.208746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1994","last_scrub_stamp":"2023-12-01T16:00:23.208718+0000","last_deep_scrub":"44'1994","last_deep_scrub_stamp":"2023-12-01T16:00:23.208718+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.208718+0000","objects_scrubbed":6,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:53.915729+0000","scrub_duration":0.063117909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1987,"num_write_kb":25538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"44'3405","reported_seq":2910,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:59.668323+0000","last_change":"2023-12-01T15:59:59.668525+0000","last_active":"2023-12-01T15:59:59.668323+0000","last_peered":"2023-12-01T15:59:59.668323+0000","last_clean":"2023-12-01T15:59:59.668323+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:59:59.668323+0000","last_undegraded":"2023-12-01T15:59:59.668323+0000","last_fullsized":"2023-12-01T15:59:59.668323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3405","last_scrub_stamp":"2023-12-01T15:59:59.668279+0000","last_deep_scrub":"44'3405","last_deep_scrub_stamp":"2023-12-01T15:59:59.668279+0000","last_clean_scrub_stamp":"2023-12-01T15:59:59.668279+0000","objects_scrubbed":2,"log_size":3405,"log_dups_size":0,"ondisk_log_size":3405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:09.752731+0000","scrub_duration":0.045721932,"objects_trimmed":0,"snaptrim_duration":0.13034463499999999,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1138,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'4352","reported_seq":4407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:04.502682+0000","last_change":"2023-12-01T16:00:04.502810+0000","last_active":"2023-12-01T16:00:04.502682+0000","last_peered":"2023-12-01T16:00:04.502682+0000","last_clean":"2023-12-01T16:00:04.502682+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T16:00:04.502682+0000","last_undegraded":"2023-12-01T16:00:04.502682+0000","last_fullsized":"2023-12-01T16:00:04.502682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4352","last_scrub_stamp":"2023-12-01T16:00:04.502658+0000","last_deep_scrub":"44'4352","last_deep_scrub_stamp":"2023-12-01T16:00:04.502658+0000","last_clean_scrub_stamp":"2023-12-01T16:00:04.502658+0000","objects_scrubbed":4,"log_size":4352,"log_dups_size":0,"ondisk_log_size":4352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:37.496662+0000","scrub_duration":0.054000375000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4337,"num_write_kb":30065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1415,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"44'3800","reported_seq":3193,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:39.434317+0000","last_change":"2023-12-01T16:00:39.434464+0000","last_active":"2023-12-01T16:00:39.434317+0000","last_peered":"2023-12-01T16:00:39.434317+0000","last_clean":"2023-12-01T16:00:39.434317+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T16:00:39.434317+0000","last_undegraded":"2023-12-01T16:00:39.434317+0000","last_fullsized":"2023-12-01T16:00:39.434317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3800","last_scrub_stamp":"2023-12-01T16:00:39.434285+0000","last_deep_scrub":"44'3800","last_deep_scrub_stamp":"2023-12-01T16:00:39.434285+0000","last_clean_scrub_stamp":"2023-12-01T16:00:39.434285+0000","objects_scrubbed":3,"log_size":3800,"log_dups_size":0,"ondisk_log_size":3800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:54:03.676050+0000","scrub_duration":0.048777055999999999,"objects_trimmed":0,"snaptrim_duration":0.165714477,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"41'2491","reported_seq":2535,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.478592+0000","last_change":"2023-12-01T15:43:45.205497+0000","last_active":"2023-12-01T15:59:43.478592+0000","last_peered":"2023-12-01T15:59:43.478592+0000","last_clean":"2023-12-01T15:59:43.478592+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T15:59:43.478592+0000","last_undegraded":"2023-12-01T15:59:43.478592+0000","last_fullsized":"2023-12-01T15:59:43.478592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:44.161907+0000","last_clean_scrub_stamp":"2023-12-01T15:43:44.161907+0000","objects_scrubbed":0,"log_size":2491,"log_dups_size":0,"ondisk_log_size":2491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2494,"num_write_kb":26915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'3462","reported_seq":2932,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:43.479262+0000","last_change":"2023-12-01T15:59:36.980979+0000","last_active":"2023-12-01T15:59:43.479262+0000","last_peered":"2023-12-01T15:59:43.479262+0000","last_clean":"2023-12-01T15:59:43.479262+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T15:59:43.479262+0000","last_undegraded":"2023-12-01T15:59:43.479262+0000","last_fullsized":"2023-12-01T15:59:43.479262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15615646,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1160,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'2354","reported_seq":2410,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:37.412288+0000","last_change":"2023-12-01T16:00:37.412288+0000","last_active":"2023-12-01T16:00:37.412288+0000","last_peered":"2023-12-01T16:00:37.412288+0000","last_clean":"2023-12-01T16:00:37.412288+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T16:00:37.412288+0000","last_undegraded":"2023-12-01T16:00:37.412288+0000","last_fullsized":"2023-12-01T16:00:37.412288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2354","last_scrub_stamp":"2023-12-01T16:00:37.412048+0000","last_deep_scrub":"44'2354","last_deep_scrub_stamp":"2023-12-01T16:00:37.412048+0000","last_clean_scrub_stamp":"2023-12-01T16:00:37.412048+0000","objects_scrubbed":2,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:03.150585+0000","scrub_duration":0.041570694999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2354,"num_write_kb":17078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'3598","reported_seq":2995,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:25.028288+0000","last_change":"2023-12-01T16:00:25.028416+0000","last_active":"2023-12-01T16:00:25.028288+0000","last_peered":"2023-12-01T16:00:25.028288+0000","last_clean":"2023-12-01T16:00:25.028288+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T16:00:25.028288+0000","last_undegraded":"2023-12-01T16:00:25.028288+0000","last_fullsized":"2023-12-01T16:00:25.028288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3598","last_scrub_stamp":"2023-12-01T16:00:25.028260+0000","last_deep_scrub":"44'3598","last_deep_scrub_stamp":"2023-12-01T16:00:25.028260+0000","last_clean_scrub_stamp":"2023-12-01T16:00:25.028260+0000","objects_scrubbed":1,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:09.811963+0000","scrub_duration":0.045226192999999998,"objects_trimmed":0,"snaptrim_duration":0.086977656,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'1540","reported_seq":1596,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.514875+0000","last_change":"2023-12-01T16:00:23.514875+0000","last_active":"2023-12-01T16:00:23.514875+0000","last_peered":"2023-12-01T16:00:23.514875+0000","last_clean":"2023-12-01T16:00:23.514875+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T16:00:23.514875+0000","last_undegraded":"2023-12-01T16:00:23.514875+0000","last_fullsized":"2023-12-01T16:00:23.514875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1540","last_scrub_stamp":"2023-12-01T16:00:23.514701+0000","last_deep_scrub":"44'1540","last_deep_scrub_stamp":"2023-12-01T16:00:23.514701+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.514701+0000","objects_scrubbed":2,"log_size":1540,"log_dups_size":0,"ondisk_log_size":1540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:08.871584+0000","scrub_duration":0.042235796999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1538,"num_write_kb":10132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":636698,"num_omap_keys":1268,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3475","reported_seq":2915,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:55.340040+0000","last_change":"2023-12-01T15:59:55.340335+0000","last_active":"2023-12-01T15:59:55.340040+0000","last_peered":"2023-12-01T15:59:55.340040+0000","last_clean":"2023-12-01T15:59:55.340040+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:59:55.340040+0000","last_undegraded":"2023-12-01T15:59:55.340040+0000","last_fullsized":"2023-12-01T15:59:55.340040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3475","last_scrub_stamp":"2023-12-01T15:59:55.339969+0000","last_deep_scrub":"43'3475","last_deep_scrub_stamp":"2023-12-01T15:59:55.339969+0000","last_clean_scrub_stamp":"2023-12-01T15:59:55.339969+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:16.716385+0000","scrub_duration":0.037072088000000003,"objects_trimmed":0,"snaptrim_duration":0.64740572200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"44'119","reported_seq":214,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:46.492848+0000","last_change":"2023-12-01T16:00:46.493093+0000","last_active":"2023-12-01T16:00:46.492848+0000","last_peered":"2023-12-01T16:00:46.492848+0000","last_clean":"2023-12-01T16:00:46.492848+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T16:00:46.492848+0000","last_undegraded":"2023-12-01T16:00:46.492848+0000","last_fullsized":"2023-12-01T16:00:46.492848+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2023-12-01T16:00:46.492795+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2023-12-01T16:00:46.492795+0000","last_clean_scrub_stamp":"2023-12-01T16:00:46.492795+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:29:41.238531+0000","scrub_duration":0.014373676,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:57.518675+0000","last_change":"2023-12-01T16:00:57.518984+0000","last_active":"2023-12-01T16:00:57.518675+0000","last_peered":"2023-12-01T16:00:57.518675+0000","last_clean":"2023-12-01T16:00:57.518675+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T16:00:57.518675+0000","last_undegraded":"2023-12-01T16:00:57.518675+0000","last_fullsized":"2023-12-01T16:00:57.518675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:57.518630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:57.518630+0000","last_clean_scrub_stamp":"2023-12-01T16:00:57.518630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:33:10.838909+0000","scrub_duration":0.0038586200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"44'4418","reported_seq":4474,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:22.563805+0000","last_change":"2023-12-01T16:00:22.563805+0000","last_active":"2023-12-01T16:00:22.563805+0000","last_peered":"2023-12-01T16:00:22.563805+0000","last_clean":"2023-12-01T16:00:22.563805+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T16:00:22.563805+0000","last_undegraded":"2023-12-01T16:00:22.563805+0000","last_fullsized":"2023-12-01T16:00:22.563805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4418","last_scrub_stamp":"2023-12-01T16:00:22.563645+0000","last_deep_scrub":"44'4418","last_deep_scrub_stamp":"2023-12-01T16:00:22.563645+0000","last_clean_scrub_stamp":"2023-12-01T16:00:22.563645+0000","objects_scrubbed":4,"log_size":4418,"log_dups_size":0,"ondisk_log_size":4418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.311958+0000","scrub_duration":0.064643555000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4406,"num_write_kb":30219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"43'3657","reported_seq":3071,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174769+0000","last_change":"2023-12-01T15:59:36.978939+0000","last_active":"2023-12-01T15:59:46.174769+0000","last_peered":"2023-12-01T15:59:46.174769+0000","last_clean":"2023-12-01T15:59:46.174769+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T15:59:46.174769+0000","last_undegraded":"2023-12-01T15:59:46.174769+0000","last_fullsized":"2023-12-01T15:59:46.174769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3657,"log_dups_size":0,"ondisk_log_size":3657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.144833777,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:49.486411+0000","last_change":"2023-12-01T16:00:49.486659+0000","last_active":"2023-12-01T16:00:49.486411+0000","last_peered":"2023-12-01T16:00:49.486411+0000","last_clean":"2023-12-01T16:00:49.486411+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T16:00:49.486411+0000","last_undegraded":"2023-12-01T16:00:49.486411+0000","last_fullsized":"2023-12-01T16:00:49.486411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:49.486368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:49.486368+0000","last_clean_scrub_stamp":"2023-12-01T16:00:49.486368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:51:08.809173+0000","scrub_duration":0.004290866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'2297","reported_seq":2553,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:33.875936+0000","last_change":"2023-12-01T16:00:33.876097+0000","last_active":"2023-12-01T16:00:33.875936+0000","last_peered":"2023-12-01T16:00:33.875936+0000","last_clean":"2023-12-01T16:00:33.875936+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T16:00:33.875936+0000","last_undegraded":"2023-12-01T16:00:33.875936+0000","last_fullsized":"2023-12-01T16:00:33.875936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2297","last_scrub_stamp":"2023-12-01T16:00:33.875902+0000","last_deep_scrub":"44'2297","last_deep_scrub_stamp":"2023-12-01T16:00:33.875902+0000","last_clean_scrub_stamp":"2023-12-01T16:00:33.875902+0000","objects_scrubbed":2,"log_size":2297,"log_dups_size":0,"ondisk_log_size":2297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:13.334507+0000","scrub_duration":0.034118038000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3359983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":3419,"num_write":2296,"num_write_kb":16044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'3373","reported_seq":2825,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:44.952875+0000","last_change":"2023-12-01T16:00:44.953011+0000","last_active":"2023-12-01T16:00:44.952875+0000","last_peered":"2023-12-01T16:00:44.952875+0000","last_clean":"2023-12-01T16:00:44.952875+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T16:00:44.952875+0000","last_undegraded":"2023-12-01T16:00:44.952875+0000","last_fullsized":"2023-12-01T16:00:44.952875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3373","last_scrub_stamp":"2023-12-01T16:00:44.952852+0000","last_deep_scrub":"44'3373","last_deep_scrub_stamp":"2023-12-01T16:00:44.952852+0000","last_clean_scrub_stamp":"2023-12-01T16:00:44.952852+0000","objects_scrubbed":3,"log_size":3373,"log_dups_size":0,"ondisk_log_size":3373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:08:12.302585+0000","scrub_duration":0.042758393999999998,"objects_trimmed":0,"snaptrim_duration":0.13848359499999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1137,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:08.498717+0000","last_change":"2023-12-01T16:00:08.498717+0000","last_active":"2023-12-01T16:00:08.498717+0000","last_peered":"2023-12-01T16:00:08.498717+0000","last_clean":"2023-12-01T16:00:08.498717+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T16:00:08.498717+0000","last_undegraded":"2023-12-01T16:00:08.498717+0000","last_fullsized":"2023-12-01T16:00:08.498717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:08.498410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:08.498410+0000","last_clean_scrub_stamp":"2023-12-01T16:00:08.498410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:18.582862+0000","scrub_duration":0.0065834630000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"44'2709","reported_seq":2765,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:14.574850+0000","last_change":"2023-12-01T16:00:14.574989+0000","last_active":"2023-12-01T16:00:14.574850+0000","last_peered":"2023-12-01T16:00:14.574850+0000","last_clean":"2023-12-01T16:00:14.574850+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T16:00:14.574850+0000","last_undegraded":"2023-12-01T16:00:14.574850+0000","last_fullsized":"2023-12-01T16:00:14.574850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2709","last_scrub_stamp":"2023-12-01T16:00:14.574824+0000","last_deep_scrub":"44'2709","last_deep_scrub_stamp":"2023-12-01T16:00:14.574824+0000","last_clean_scrub_stamp":"2023-12-01T16:00:14.574824+0000","objects_scrubbed":3,"log_size":2709,"log_dups_size":0,"ondisk_log_size":2709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:31:29.561401+0000","scrub_duration":0.059953542999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2697,"num_write_kb":25331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3393","reported_seq":2878,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.386317+0000","last_change":"2023-12-01T15:59:49.386477+0000","last_active":"2023-12-01T15:59:49.386317+0000","last_peered":"2023-12-01T15:59:49.386317+0000","last_clean":"2023-12-01T15:59:49.386317+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:59:49.386317+0000","last_undegraded":"2023-12-01T15:59:49.386317+0000","last_fullsized":"2023-12-01T15:59:49.386317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3393","last_scrub_stamp":"2023-12-01T15:59:49.386292+0000","last_deep_scrub":"44'3393","last_deep_scrub_stamp":"2023-12-01T15:59:49.386292+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.386292+0000","objects_scrubbed":3,"log_size":3393,"log_dups_size":0,"ondisk_log_size":3393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:21:35.191687+0000","scrub_duration":0.041281799000000001,"objects_trimmed":0,"snaptrim_duration":0.644502672,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1119,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:54.519721+0000","last_change":"2023-12-01T16:00:54.520383+0000","last_active":"2023-12-01T16:00:54.519721+0000","last_peered":"2023-12-01T16:00:54.519721+0000","last_clean":"2023-12-01T16:00:54.519721+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T16:00:54.519721+0000","last_undegraded":"2023-12-01T16:00:54.519721+0000","last_fullsized":"2023-12-01T16:00:54.519721+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:54.519676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:54.519676+0000","last_clean_scrub_stamp":"2023-12-01T16:00:54.519676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:13:55.687653+0000","scrub_duration":0.0054566220000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'3561","reported_seq":3617,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:09.058193+0000","last_change":"2023-12-01T16:00:09.058193+0000","last_active":"2023-12-01T16:00:09.058193+0000","last_peered":"2023-12-01T16:00:09.058193+0000","last_clean":"2023-12-01T16:00:09.058193+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T16:00:09.058193+0000","last_undegraded":"2023-12-01T16:00:09.058193+0000","last_fullsized":"2023-12-01T16:00:09.058193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3561","last_scrub_stamp":"2023-12-01T16:00:09.058006+0000","last_deep_scrub":"44'3561","last_deep_scrub_stamp":"2023-12-01T16:00:09.058006+0000","last_clean_scrub_stamp":"2023-12-01T16:00:09.058006+0000","objects_scrubbed":5,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:19.142458+0000","scrub_duration":0.071950684000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3556,"num_write_kb":20852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1320010,"num_omap_keys":2629,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3573","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:47.437607+0000","last_change":"2023-12-01T15:59:47.437607+0000","last_active":"2023-12-01T15:59:47.437607+0000","last_peered":"2023-12-01T15:59:47.437607+0000","last_clean":"2023-12-01T15:59:47.437607+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:47.437607+0000","last_undegraded":"2023-12-01T15:59:47.437607+0000","last_fullsized":"2023-12-01T15:59:47.437607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3573","last_scrub_stamp":"2023-12-01T15:59:47.437368+0000","last_deep_scrub":"44'3573","last_deep_scrub_stamp":"2023-12-01T15:59:47.437368+0000","last_clean_scrub_stamp":"2023-12-01T15:59:47.437368+0000","objects_scrubbed":1,"log_size":3573,"log_dups_size":0,"ondisk_log_size":3573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:45:47.573028+0000","scrub_duration":0.052350225,"objects_trimmed":0,"snaptrim_duration":0.65789627900000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'2832","reported_seq":2888,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:04.956811+0000","last_change":"2023-12-01T16:00:04.956811+0000","last_active":"2023-12-01T16:00:04.956811+0000","last_peered":"2023-12-01T16:00:04.956811+0000","last_clean":"2023-12-01T16:00:04.956811+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T16:00:04.956811+0000","last_undegraded":"2023-12-01T16:00:04.956811+0000","last_fullsized":"2023-12-01T16:00:04.956811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2832","last_scrub_stamp":"2023-12-01T16:00:04.956554+0000","last_deep_scrub":"44'2832","last_deep_scrub_stamp":"2023-12-01T16:00:04.956554+0000","last_clean_scrub_stamp":"2023-12-01T16:00:04.956554+0000","objects_scrubbed":2,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:37.950558+0000","scrub_duration":0.044932412999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2820,"num_write_kb":26865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":628812,"num_omap_keys":1252,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:05.464028+0000","last_change":"2023-12-01T16:00:05.464028+0000","last_active":"2023-12-01T16:00:05.464028+0000","last_peered":"2023-12-01T16:00:05.464028+0000","last_clean":"2023-12-01T16:00:05.464028+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T16:00:05.464028+0000","last_undegraded":"2023-12-01T16:00:05.464028+0000","last_fullsized":"2023-12-01T16:00:05.464028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:05.463736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:05.463736+0000","last_clean_scrub_stamp":"2023-12-01T16:00:05.463736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:26.653876+0000","scrub_duration":0.0051879350000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"44'3761","reported_seq":3211,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.423729+0000","last_change":"2023-12-01T15:59:48.423729+0000","last_active":"2023-12-01T15:59:48.423729+0000","last_peered":"2023-12-01T15:59:48.423729+0000","last_clean":"2023-12-01T15:59:48.423729+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:59:48.423729+0000","last_undegraded":"2023-12-01T15:59:48.423729+0000","last_fullsized":"2023-12-01T15:59:48.423729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3761","last_scrub_stamp":"2023-12-01T15:59:48.423554+0000","last_deep_scrub":"44'3761","last_deep_scrub_stamp":"2023-12-01T15:59:48.423554+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.423554+0000","objects_scrubbed":2,"log_size":3761,"log_dups_size":0,"ondisk_log_size":3761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:02.504062+0000","scrub_duration":0.041749799999999997,"objects_trimmed":0,"snaptrim_duration":0.64064258500000004,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"44'725","reported_seq":781,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:16.552415+0000","last_change":"2023-12-01T16:00:16.552415+0000","last_active":"2023-12-01T16:00:16.552415+0000","last_peered":"2023-12-01T16:00:16.552415+0000","last_clean":"2023-12-01T16:00:16.552415+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T16:00:16.552415+0000","last_undegraded":"2023-12-01T16:00:16.552415+0000","last_fullsized":"2023-12-01T16:00:16.552415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'725","last_scrub_stamp":"2023-12-01T16:00:16.552270+0000","last_deep_scrub":"44'725","last_deep_scrub_stamp":"2023-12-01T16:00:16.552270+0000","last_clean_scrub_stamp":"2023-12-01T16:00:16.552270+0000","objects_scrubbed":2,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:11.939451+0000","scrub_duration":0.030041060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":8308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:01.587163+0000","last_change":"2023-12-01T16:01:01.587552+0000","last_active":"2023-12-01T16:01:01.587163+0000","last_peered":"2023-12-01T16:01:01.587163+0000","last_clean":"2023-12-01T16:01:01.587163+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T16:01:01.587163+0000","last_undegraded":"2023-12-01T16:01:01.587163+0000","last_fullsized":"2023-12-01T16:01:01.587163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:01:01.587072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:01:01.587072+0000","last_clean_scrub_stamp":"2023-12-01T16:01:01.587072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:32.631555+0000","scrub_duration":0.0060124480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"44'3560","reported_seq":2976,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:11.777890+0000","last_change":"2023-12-01T16:00:11.777890+0000","last_active":"2023-12-01T16:00:11.777890+0000","last_peered":"2023-12-01T16:00:11.777890+0000","last_clean":"2023-12-01T16:00:11.777890+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T16:00:11.777890+0000","last_undegraded":"2023-12-01T16:00:11.777890+0000","last_fullsized":"2023-12-01T16:00:11.777890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3560","last_scrub_stamp":"2023-12-01T16:00:11.777713+0000","last_deep_scrub":"44'3560","last_deep_scrub_stamp":"2023-12-01T16:00:11.777713+0000","last_clean_scrub_stamp":"2023-12-01T16:00:11.777713+0000","objects_scrubbed":2,"log_size":3560,"log_dups_size":0,"ondisk_log_size":3560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:07.164893+0000","scrub_duration":0.046654314000000002,"objects_trimmed":0,"snaptrim_duration":0.13059393599999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1243,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'1640","reported_seq":1696,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:19.517728+0000","last_change":"2023-12-01T16:00:19.517728+0000","last_active":"2023-12-01T16:00:19.517728+0000","last_peered":"2023-12-01T16:00:19.517728+0000","last_clean":"2023-12-01T16:00:19.517728+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T16:00:19.517728+0000","last_undegraded":"2023-12-01T16:00:19.517728+0000","last_fullsized":"2023-12-01T16:00:19.517728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1640","last_scrub_stamp":"2023-12-01T16:00:19.517564+0000","last_deep_scrub":"44'1640","last_deep_scrub_stamp":"2023-12-01T16:00:19.517564+0000","last_clean_scrub_stamp":"2023-12-01T16:00:19.517564+0000","objects_scrubbed":3,"log_size":1640,"log_dups_size":0,"ondisk_log_size":1640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:42:53.178860+0000","scrub_duration":0.036244526999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1642,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:09.510854+0000","last_change":"2023-12-01T16:00:09.510854+0000","last_active":"2023-12-01T16:00:09.510854+0000","last_peered":"2023-12-01T16:00:09.510854+0000","last_clean":"2023-12-01T16:00:09.510854+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T16:00:09.510854+0000","last_undegraded":"2023-12-01T16:00:09.510854+0000","last_fullsized":"2023-12-01T16:00:09.510854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:09.510499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:09.510499+0000","last_clean_scrub_stamp":"2023-12-01T16:00:09.510499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:50:49.026098+0000","scrub_duration":0.005722286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'3700","reported_seq":3078,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.659888+0000","last_change":"2023-12-01T15:59:56.660009+0000","last_active":"2023-12-01T15:59:56.659888+0000","last_peered":"2023-12-01T15:59:56.659888+0000","last_clean":"2023-12-01T15:59:56.659888+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:59:56.659888+0000","last_undegraded":"2023-12-01T15:59:56.659888+0000","last_fullsized":"2023-12-01T15:59:56.659888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3700","last_scrub_stamp":"2023-12-01T15:59:56.659861+0000","last_deep_scrub":"44'3700","last_deep_scrub_stamp":"2023-12-01T15:59:56.659861+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.659861+0000","objects_scrubbed":4,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:17.850001+0000","scrub_duration":0.058770831000000003,"objects_trimmed":0,"snaptrim_duration":0.13319146700000001,"stat_sum":{"num_bytes":4118,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'2000","reported_seq":2056,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:18.918482+0000","last_change":"2023-12-01T16:00:18.918482+0000","last_active":"2023-12-01T16:00:18.918482+0000","last_peered":"2023-12-01T16:00:18.918482+0000","last_clean":"2023-12-01T16:00:18.918482+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T16:00:18.918482+0000","last_undegraded":"2023-12-01T16:00:18.918482+0000","last_fullsized":"2023-12-01T16:00:18.918482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2000","last_scrub_stamp":"2023-12-01T16:00:18.918306+0000","last_deep_scrub":"44'2000","last_deep_scrub_stamp":"2023-12-01T16:00:18.918306+0000","last_clean_scrub_stamp":"2023-12-01T16:00:18.918306+0000","objects_scrubbed":5,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:04.275189+0000","scrub_duration":0.15145572099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2265,"num_write_kb":16414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":702002,"num_omap_keys":1398,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:56.516851+0000","last_change":"2023-12-01T16:00:56.516851+0000","last_active":"2023-12-01T16:00:56.516851+0000","last_peered":"2023-12-01T16:00:56.516851+0000","last_clean":"2023-12-01T16:00:56.516851+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T16:00:56.516851+0000","last_undegraded":"2023-12-01T16:00:56.516851+0000","last_fullsized":"2023-12-01T16:00:56.516851+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:56.516545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:56.516545+0000","last_clean_scrub_stamp":"2023-12-01T16:00:56.516545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:25:42.487092+0000","scrub_duration":0.0054680370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"44'3410","reported_seq":2836,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:31.122991+0000","last_change":"2023-12-01T16:00:31.123172+0000","last_active":"2023-12-01T16:00:31.122991+0000","last_peered":"2023-12-01T16:00:31.122991+0000","last_clean":"2023-12-01T16:00:31.122991+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T16:00:31.122991+0000","last_undegraded":"2023-12-01T16:00:31.122991+0000","last_fullsized":"2023-12-01T16:00:31.122991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3410","last_scrub_stamp":"2023-12-01T16:00:31.122961+0000","last_deep_scrub":"44'3410","last_deep_scrub_stamp":"2023-12-01T16:00:31.122961+0000","last_clean_scrub_stamp":"2023-12-01T16:00:31.122961+0000","objects_scrubbed":5,"log_size":3410,"log_dups_size":0,"ondisk_log_size":3410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:47:20.447314+0000","scrub_duration":0.056985352000000003,"objects_trimmed":0,"snaptrim_duration":0.087179219000000002,"stat_sum":{"num_bytes":12302,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"44'3615","reported_seq":3033,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.027191+0000","last_change":"2023-12-01T15:59:49.027191+0000","last_active":"2023-12-01T15:59:49.027191+0000","last_peered":"2023-12-01T15:59:49.027191+0000","last_clean":"2023-12-01T15:59:49.027191+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:59:49.027191+0000","last_undegraded":"2023-12-01T15:59:49.027191+0000","last_fullsized":"2023-12-01T15:59:49.027191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3615","last_scrub_stamp":"2023-12-01T15:59:49.026983+0000","last_deep_scrub":"44'3615","last_deep_scrub_stamp":"2023-12-01T15:59:49.026983+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.026983+0000","objects_scrubbed":2,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:03.107490+0000","scrub_duration":0.046925306,"objects_trimmed":0,"snaptrim_duration":0.084182759999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'3719","reported_seq":3774,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:17.269725+0000","last_change":"2023-12-01T16:00:17.269901+0000","last_active":"2023-12-01T16:00:17.269725+0000","last_peered":"2023-12-01T16:00:17.269725+0000","last_clean":"2023-12-01T16:00:17.269725+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T16:00:17.269725+0000","last_undegraded":"2023-12-01T16:00:17.269725+0000","last_fullsized":"2023-12-01T16:00:17.269725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3719","last_scrub_stamp":"2023-12-01T16:00:17.269697+0000","last_deep_scrub":"44'3719","last_deep_scrub_stamp":"2023-12-01T16:00:17.269697+0000","last_clean_scrub_stamp":"2023-12-01T16:00:17.269697+0000","objects_scrubbed":7,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:02.626581+0000","scrub_duration":0.068143023999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3712,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":605,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"44'3513","reported_seq":2944,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:32.500021+0000","last_change":"2023-12-01T16:00:32.500141+0000","last_active":"2023-12-01T16:00:32.500021+0000","last_peered":"2023-12-01T16:00:32.500021+0000","last_clean":"2023-12-01T16:00:32.500021+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T16:00:32.500021+0000","last_undegraded":"2023-12-01T16:00:32.500021+0000","last_fullsized":"2023-12-01T16:00:32.500021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3513","last_scrub_stamp":"2023-12-01T16:00:32.499989+0000","last_deep_scrub":"44'3513","last_deep_scrub_stamp":"2023-12-01T16:00:32.499989+0000","last_clean_scrub_stamp":"2023-12-01T16:00:32.499989+0000","objects_scrubbed":5,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:47:21.824342+0000","scrub_duration":0.061740942,"objects_trimmed":0,"snaptrim_duration":0.63296622700000005,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"44'2462","reported_seq":2517,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:19.085189+0000","last_change":"2023-12-01T16:00:19.085189+0000","last_active":"2023-12-01T16:00:19.085189+0000","last_peered":"2023-12-01T16:00:19.085189+0000","last_clean":"2023-12-01T16:00:19.085189+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T16:00:19.085189+0000","last_undegraded":"2023-12-01T16:00:19.085189+0000","last_fullsized":"2023-12-01T16:00:19.085189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2462","last_scrub_stamp":"2023-12-01T16:00:19.085001+0000","last_deep_scrub":"44'2462","last_deep_scrub_stamp":"2023-12-01T16:00:19.085001+0000","last_clean_scrub_stamp":"2023-12-01T16:00:19.085001+0000","objects_scrubbed":5,"log_size":2462,"log_dups_size":0,"ondisk_log_size":2462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:40.706542+0000","scrub_duration":0.035617093000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2453,"num_write_kb":21278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"44'1341","reported_seq":1396,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:20.130338+0000","last_change":"2023-12-01T16:00:20.130338+0000","last_active":"2023-12-01T16:00:20.130338+0000","last_peered":"2023-12-01T16:00:20.130338+0000","last_clean":"2023-12-01T16:00:20.130338+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T16:00:20.130338+0000","last_undegraded":"2023-12-01T16:00:20.130338+0000","last_fullsized":"2023-12-01T16:00:20.130338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1341","last_scrub_stamp":"2023-12-01T16:00:20.129959+0000","last_deep_scrub":"44'1341","last_deep_scrub_stamp":"2023-12-01T16:00:20.129959+0000","last_clean_scrub_stamp":"2023-12-01T16:00:20.129959+0000","objects_scrubbed":2,"log_size":1341,"log_dups_size":0,"ondisk_log_size":1341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:42:53.791254+0000","scrub_duration":0.039957485000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1338,"num_write_kb":26066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'3641","reported_seq":3016,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:17.763808+0000","last_change":"2023-12-01T16:00:17.763921+0000","last_active":"2023-12-01T16:00:17.763808+0000","last_peered":"2023-12-01T16:00:17.763808+0000","last_clean":"2023-12-01T16:00:17.763808+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T16:00:17.763808+0000","last_undegraded":"2023-12-01T16:00:17.763808+0000","last_fullsized":"2023-12-01T16:00:17.763808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3641","last_scrub_stamp":"2023-12-01T16:00:17.763787+0000","last_deep_scrub":"43'3641","last_deep_scrub_stamp":"2023-12-01T16:00:17.763787+0000","last_clean_scrub_stamp":"2023-12-01T16:00:17.763787+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:59.512101+0000","scrub_duration":0.036564379000000001,"objects_trimmed":0,"snaptrim_duration":0.13235097200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"44'903","reported_seq":958,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:22.885656+0000","last_change":"2023-12-01T16:00:22.885656+0000","last_active":"2023-12-01T16:00:22.885656+0000","last_peered":"2023-12-01T16:00:22.885656+0000","last_clean":"2023-12-01T16:00:22.885656+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T16:00:22.885656+0000","last_undegraded":"2023-12-01T16:00:22.885656+0000","last_fullsized":"2023-12-01T16:00:22.885656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'903","last_scrub_stamp":"2023-12-01T16:00:22.885328+0000","last_deep_scrub":"44'903","last_deep_scrub_stamp":"2023-12-01T16:00:22.885328+0000","last_clean_scrub_stamp":"2023-12-01T16:00:22.885328+0000","objects_scrubbed":3,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:25:47.742131+0000","scrub_duration":0.050233486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3459","reported_seq":2882,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:50.437138+0000","last_change":"2023-12-01T15:59:50.437138+0000","last_active":"2023-12-01T15:59:50.437138+0000","last_peered":"2023-12-01T15:59:50.437138+0000","last_clean":"2023-12-01T15:59:50.437138+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:59:50.437138+0000","last_undegraded":"2023-12-01T15:59:50.437138+0000","last_fullsized":"2023-12-01T15:59:50.437138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3459","last_scrub_stamp":"2023-12-01T15:59:50.436956+0000","last_deep_scrub":"44'3459","last_deep_scrub_stamp":"2023-12-01T15:59:50.436956+0000","last_clean_scrub_stamp":"2023-12-01T15:59:50.436956+0000","objects_scrubbed":1,"log_size":3459,"log_dups_size":0,"ondisk_log_size":3459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:48:17.314373+0000","scrub_duration":0.047609585000000003,"objects_trimmed":0,"snaptrim_duration":0.59367497300000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1187,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"43'3413","reported_seq":2910,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.174375+0000","last_change":"2023-12-01T15:59:36.971349+0000","last_active":"2023-12-01T15:59:46.174375+0000","last_peered":"2023-12-01T15:59:46.174375+0000","last_clean":"2023-12-01T15:59:46.174375+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T15:59:46.174375+0000","last_undegraded":"2023-12-01T15:59:46.174375+0000","last_fullsized":"2023-12-01T15:59:46.174375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T15:43:45.166620+0000","last_clean_scrub_stamp":"2023-12-01T15:43:45.166620+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17121966999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4978","reported_seq":5033,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.423763+0000","last_change":"2023-12-01T15:59:54.423763+0000","last_active":"2023-12-01T15:59:54.423763+0000","last_peered":"2023-12-01T15:59:54.423763+0000","last_clean":"2023-12-01T15:59:54.423763+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:59:54.423763+0000","last_undegraded":"2023-12-01T15:59:54.423763+0000","last_fullsized":"2023-12-01T15:59:54.423763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4978","last_scrub_stamp":"2023-12-01T15:59:54.423526+0000","last_deep_scrub":"44'4978","last_deep_scrub_stamp":"2023-12-01T15:59:54.423526+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.423526+0000","objects_scrubbed":5,"log_size":4978,"log_dups_size":0,"ondisk_log_size":4978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:49:35.988154+0000","scrub_duration":0.094740874000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4962,"num_write_kb":39191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670128,"num_omap_keys":1336,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'3228","reported_seq":2710,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:12.801031+0000","last_change":"2023-12-01T16:00:12.801404+0000","last_active":"2023-12-01T16:00:12.801031+0000","last_peered":"2023-12-01T16:00:12.801031+0000","last_clean":"2023-12-01T16:00:12.801031+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T16:00:12.801031+0000","last_undegraded":"2023-12-01T16:00:12.801031+0000","last_fullsized":"2023-12-01T16:00:12.801031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3228","last_scrub_stamp":"2023-12-01T16:00:12.800966+0000","last_deep_scrub":"44'3228","last_deep_scrub_stamp":"2023-12-01T16:00:12.800966+0000","last_clean_scrub_stamp":"2023-12-01T16:00:12.800966+0000","objects_scrubbed":2,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:34.422506+0000","scrub_duration":0.046375222000000001,"objects_trimmed":0,"snaptrim_duration":0.13751970099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'493","reported_seq":548,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.331348+0000","last_change":"2023-12-01T15:59:56.331348+0000","last_active":"2023-12-01T15:59:56.331348+0000","last_peered":"2023-12-01T15:59:56.331348+0000","last_clean":"2023-12-01T15:59:56.331348+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:59:56.331348+0000","last_undegraded":"2023-12-01T15:59:56.331348+0000","last_fullsized":"2023-12-01T15:59:56.331348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'493","last_scrub_stamp":"2023-12-01T15:59:56.331006+0000","last_deep_scrub":"44'493","last_deep_scrub_stamp":"2023-12-01T15:59:56.331006+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.331006+0000","objects_scrubbed":3,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:06:39.368433+0000","scrub_duration":0.040743746999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":17875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'3423","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:47.535135+0000","last_change":"2023-12-01T15:59:47.535337+0000","last_active":"2023-12-01T15:59:47.535135+0000","last_peered":"2023-12-01T15:59:47.535135+0000","last_clean":"2023-12-01T15:59:47.535135+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:59:47.535135+0000","last_undegraded":"2023-12-01T15:59:47.535135+0000","last_fullsized":"2023-12-01T15:59:47.535135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3423","last_scrub_stamp":"2023-12-01T15:59:47.535105+0000","last_deep_scrub":"44'3423","last_deep_scrub_stamp":"2023-12-01T15:59:47.535105+0000","last_clean_scrub_stamp":"2023-12-01T15:59:47.535105+0000","objects_scrubbed":2,"log_size":3423,"log_dups_size":0,"ondisk_log_size":3423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:08.911521+0000","scrub_duration":0.045260416999999997,"objects_trimmed":0,"snaptrim_duration":0.134588554,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"44'3618","reported_seq":3672,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:59.010548+0000","last_change":"2023-12-01T15:59:59.010802+0000","last_active":"2023-12-01T15:59:59.010548+0000","last_peered":"2023-12-01T15:59:59.010548+0000","last_clean":"2023-12-01T15:59:59.010548+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:59:59.010548+0000","last_undegraded":"2023-12-01T15:59:59.010548+0000","last_fullsized":"2023-12-01T15:59:59.010548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3618","last_scrub_stamp":"2023-12-01T15:59:59.010494+0000","last_deep_scrub":"44'3618","last_deep_scrub_stamp":"2023-12-01T15:59:59.010494+0000","last_clean_scrub_stamp":"2023-12-01T15:59:59.010494+0000","objects_scrubbed":2,"log_size":3618,"log_dups_size":0,"ondisk_log_size":3618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:32.241596+0000","scrub_duration":0.048349939000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3601,"num_write_kb":33849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"43'3891","reported_seq":3228,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:29.521261+0000","last_change":"2023-12-01T16:00:29.521372+0000","last_active":"2023-12-01T16:00:29.521261+0000","last_peered":"2023-12-01T16:00:29.521261+0000","last_clean":"2023-12-01T16:00:29.521261+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T16:00:29.521261+0000","last_undegraded":"2023-12-01T16:00:29.521261+0000","last_fullsized":"2023-12-01T16:00:29.521261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3891","last_scrub_stamp":"2023-12-01T16:00:29.521240+0000","last_deep_scrub":"43'3891","last_deep_scrub_stamp":"2023-12-01T16:00:29.521240+0000","last_clean_scrub_stamp":"2023-12-01T16:00:29.521240+0000","objects_scrubbed":0,"log_size":3891,"log_dups_size":0,"ondisk_log_size":3891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:02:00.228252+0000","scrub_duration":0.039399423000000003,"objects_trimmed":0,"snaptrim_duration":0.65050901000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"44'2100","reported_seq":2154,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:21.858238+0000","last_change":"2023-12-01T16:00:21.858509+0000","last_active":"2023-12-01T16:00:21.858238+0000","last_peered":"2023-12-01T16:00:21.858238+0000","last_clean":"2023-12-01T16:00:21.858238+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T16:00:21.858238+0000","last_undegraded":"2023-12-01T16:00:21.858238+0000","last_fullsized":"2023-12-01T16:00:21.858238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2100","last_scrub_stamp":"2023-12-01T16:00:21.858173+0000","last_deep_scrub":"44'2100","last_deep_scrub_stamp":"2023-12-01T16:00:21.858173+0000","last_clean_scrub_stamp":"2023-12-01T16:00:21.858173+0000","objects_scrubbed":2,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:06.641876+0000","scrub_duration":0.043601572999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2089,"num_write_kb":16989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"44'3666","reported_seq":3088,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:21.094948+0000","last_change":"2023-12-01T16:00:21.095073+0000","last_active":"2023-12-01T16:00:21.094948+0000","last_peered":"2023-12-01T16:00:21.094948+0000","last_clean":"2023-12-01T16:00:21.094948+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T16:00:21.094948+0000","last_undegraded":"2023-12-01T16:00:21.094948+0000","last_fullsized":"2023-12-01T16:00:21.094948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3666","last_scrub_stamp":"2023-12-01T16:00:21.094921+0000","last_deep_scrub":"44'3666","last_deep_scrub_stamp":"2023-12-01T16:00:21.094921+0000","last_clean_scrub_stamp":"2023-12-01T16:00:21.094921+0000","objects_scrubbed":1,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:41:15.386618+0000","scrub_duration":0.048431008999999997,"objects_trimmed":0,"snaptrim_duration":0.084960400000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1169,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'641","reported_seq":695,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:10.011211+0000","last_change":"2023-12-01T16:00:10.011337+0000","last_active":"2023-12-01T16:00:10.011211+0000","last_peered":"2023-12-01T16:00:10.011211+0000","last_clean":"2023-12-01T16:00:10.011211+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T16:00:10.011211+0000","last_undegraded":"2023-12-01T16:00:10.011211+0000","last_fullsized":"2023-12-01T16:00:10.011211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'641","last_scrub_stamp":"2023-12-01T16:00:10.011185+0000","last_deep_scrub":"44'641","last_deep_scrub_stamp":"2023-12-01T16:00:10.011185+0000","last_clean_scrub_stamp":"2023-12-01T16:00:10.011185+0000","objects_scrubbed":2,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:50:49.526785+0000","scrub_duration":0.024782471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1891144,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":643,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"43'3570","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:51.023765+0000","last_change":"2023-12-01T15:59:51.023871+0000","last_active":"2023-12-01T15:59:51.023765+0000","last_peered":"2023-12-01T15:59:51.023765+0000","last_clean":"2023-12-01T15:59:51.023765+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:59:51.023765+0000","last_undegraded":"2023-12-01T15:59:51.023765+0000","last_fullsized":"2023-12-01T15:59:51.023765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3570","last_scrub_stamp":"2023-12-01T15:59:51.023745+0000","last_deep_scrub":"43'3570","last_deep_scrub_stamp":"2023-12-01T15:59:51.023745+0000","last_clean_scrub_stamp":"2023-12-01T15:59:51.023745+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:48:17.901162+0000","scrub_duration":0.041221723000000002,"objects_trimmed":0,"snaptrim_duration":0.094045403999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'5943","reported_seq":5997,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:58.274157+0000","last_change":"2023-12-01T15:59:58.274287+0000","last_active":"2023-12-01T15:59:58.274157+0000","last_peered":"2023-12-01T15:59:58.274157+0000","last_clean":"2023-12-01T15:59:58.274157+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:59:58.274157+0000","last_undegraded":"2023-12-01T15:59:58.274157+0000","last_fullsized":"2023-12-01T15:59:58.274157+0000","mapping_epoch":16,"log_start":"21'300","ondisk_log_start":"21'300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'5943","last_scrub_stamp":"2023-12-01T15:59:58.274135+0000","last_deep_scrub":"44'5943","last_deep_scrub_stamp":"2023-12-01T15:59:58.274135+0000","last_clean_scrub_stamp":"2023-12-01T15:59:58.274135+0000","objects_scrubbed":7,"log_size":5643,"log_dups_size":0,"ondisk_log_size":5643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:27:01.882725+0000","scrub_duration":0.087623041999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5940,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1000,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3526","reported_seq":3001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.595288+0000","last_change":"2023-12-01T15:59:54.595288+0000","last_active":"2023-12-01T15:59:54.595288+0000","last_peered":"2023-12-01T15:59:54.595288+0000","last_clean":"2023-12-01T15:59:54.595288+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:59:54.595288+0000","last_undegraded":"2023-12-01T15:59:54.595288+0000","last_fullsized":"2023-12-01T15:59:54.595288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3526","last_scrub_stamp":"2023-12-01T15:59:54.595164+0000","last_deep_scrub":"44'3526","last_deep_scrub_stamp":"2023-12-01T15:59:54.595164+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.595164+0000","objects_scrubbed":1,"log_size":3526,"log_dups_size":0,"ondisk_log_size":3526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:27.589168+0000","scrub_duration":0.038520889000000003,"objects_trimmed":0,"snaptrim_duration":0.134288985,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"44'3430","reported_seq":3486,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:38.898618+0000","last_change":"2023-12-01T16:00:38.898867+0000","last_active":"2023-12-01T16:00:38.898618+0000","last_peered":"2023-12-01T16:00:38.898618+0000","last_clean":"2023-12-01T16:00:38.898618+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T16:00:38.898618+0000","last_undegraded":"2023-12-01T16:00:38.898618+0000","last_fullsized":"2023-12-01T16:00:38.898618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3430","last_scrub_stamp":"2023-12-01T16:00:38.898571+0000","last_deep_scrub":"44'3430","last_deep_scrub_stamp":"2023-12-01T16:00:38.898571+0000","last_clean_scrub_stamp":"2023-12-01T16:00:38.898571+0000","objects_scrubbed":4,"log_size":3430,"log_dups_size":0,"ondisk_log_size":3430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:04.637107+0000","scrub_duration":0.066174637999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3411,"num_write_kb":30086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4050","reported_seq":3343,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.042427+0000","last_change":"2023-12-01T15:59:54.042427+0000","last_active":"2023-12-01T15:59:54.042427+0000","last_peered":"2023-12-01T15:59:54.042427+0000","last_clean":"2023-12-01T15:59:54.042427+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:59:54.042427+0000","last_undegraded":"2023-12-01T15:59:54.042427+0000","last_fullsized":"2023-12-01T15:59:54.042427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4050","last_scrub_stamp":"2023-12-01T15:59:54.042107+0000","last_deep_scrub":"44'4050","last_deep_scrub_stamp":"2023-12-01T15:59:54.042107+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.042107+0000","objects_scrubbed":3,"log_size":4050,"log_dups_size":0,"ondisk_log_size":4050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:49:35.606734+0000","scrub_duration":0.048885451000000003,"objects_trimmed":0,"snaptrim_duration":0.091841191000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"44'1806","reported_seq":1862,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:39.925300+0000","last_change":"2023-12-01T16:00:39.925536+0000","last_active":"2023-12-01T16:00:39.925300+0000","last_peered":"2023-12-01T16:00:39.925300+0000","last_clean":"2023-12-01T16:00:39.925300+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T16:00:39.925300+0000","last_undegraded":"2023-12-01T16:00:39.925300+0000","last_fullsized":"2023-12-01T16:00:39.925300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1806","last_scrub_stamp":"2023-12-01T16:00:39.925228+0000","last_deep_scrub":"44'1806","last_deep_scrub_stamp":"2023-12-01T16:00:39.925228+0000","last_clean_scrub_stamp":"2023-12-01T16:00:39.925228+0000","objects_scrubbed":3,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:32:45.152512+0000","scrub_duration":0.050226169000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1812,"num_write_kb":15324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26782,"num_omap_keys":50,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":76140,"num_write_kb":40588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225611,"ondisk_log_size":225611,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":277882502,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":223,"num_read_kb":3419,"num_write":76837,"num_write_kb":641165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5327133,"num_omap_keys":10604,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":555827200,"data_stored":555765004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76459,"ondisk_log_size":76459,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705878,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":666384,"kb_used_data":134088,"kb_used_omap":0,"kb_used_meta":532288,"kb_avail":93705456,"statfs":{"total":96636764160,"available":95954386944,"internally_reserved":0,"allocated":137306112,"data_stored":136947550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":545062912},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 16:00:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":0.78700000000000003,"15min":0.65900000000000003},"min":{"1min":0.37,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":8.3049999999999997,"5min":10.84,"15min":10.84},"last":0.623},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96199999999999997,"15min":0.72699999999999998},"min":{"1min":0.47199999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.2320000000000002,"5min":11.926,"15min":11.926},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Dec 1 16:00:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":0.81000000000000005,"15min":0.68700000000000006},"min":{"1min":0.372,"5min":0.246,"15min":0.246},"max":{"1min":8.3399999999999999,"5min":10.807,"15min":10.807},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.86099999999999999,"5min":3.552,"15min":3.552},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Dec 1 16:00:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.79600000000000004,"15min":0.64400000000000002},"min":{"1min":0.45900000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":5.0419999999999998,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.751,"15min":0.66100000000000003},"min":{"1min":0.46100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.4039999999999999,"5min":10.715999999999999,"15min":10.715999999999999},"last":0.83899999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705879,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":805988,"kb_used_data":157276,"kb_used_omap":0,"kb_used_meta":648704,"kb_avail":93565852,"statfs":{"total":96636764160,"available":95811432448,"internally_reserved":0,"allocated":161050624,"data_stored":160683934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":664272896},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 16:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71799999999999997,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.88300000000000001,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.626,"15min":0.65200000000000002},"min":{"1min":0.58899999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83699999999999997,"5min":0.91200000000000003,"15min":2.657},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Dec 1 16:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.66000000000000003},"min":{"1min":0.56799999999999995,"5min":0.248,"15min":0.248},"max":{"1min":0.91300000000000003,"5min":8.0779999999999994,"15min":8.0779999999999994},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.629,"15min":0.624},"min":{"1min":0.59399999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.84899999999999998,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Dec 1 16:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.54200000000000004,"15min":0.56200000000000006},"min":{"1min":0.47299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.83099999999999996,"5min":2.048,"15min":7.5289999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70799999999999996,"15min":0.66900000000000004},"min":{"1min":0.499,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.93100000000000005,"5min":8.0370000000000008,"15min":9.8949999999999996},"last":0.55700000000000005}]}]},{"osd":1,"up_from":9,"seq":38654705878,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589244,"kb_used_data":98868,"kb_used_omap":0,"kb_used_meta":490368,"kb_avail":93782596,"statfs":{"total":96636764160,"available":96033378304,"internally_reserved":0,"allocated":101240832,"data_stored":100906009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502136832},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45700000000000002,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.17399999999999999,"15min":0.17299999999999999},"max":{"1min":0.69099999999999995,"5min":0.749,"15min":8.4589999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51500000000000001,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":0.629,"5min":1.669,"15min":1.7729999999999999},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66600000000000004,"15min":0.63900000000000001},"min":{"1min":0.55000000000000004,"5min":0.249,"15min":0.249},"max":{"1min":0.999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.63600000000000001,"15min":0.63500000000000001},"min":{"1min":0.51300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.83999999999999997,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.65500000000000003}]},{"osd":3,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.64300000000000002,"15min":0.66100000000000003},"min":{"1min":0.58599999999999997,"5min":0.28100000000000003,"15min":0.251},"max":{"1min":0.82999999999999996,"5min":1.641,"15min":1.641},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72199999999999998,"15min":0.70199999999999996},"min":{"1min":0.68300000000000005,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.95599999999999996,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.80100000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705878,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814568,"kb_used_data":156000,"kb_used_omap":0,"kb_used_meta":658560,"kb_avail":93557272,"statfs":{"total":96636764160,"available":95802646528,"internally_reserved":0,"allocated":159744000,"data_stored":159387283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":674365440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.42599999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.85499999999999998,"5min":1.595,"15min":1.595},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54100000000000004,"15min":0.624},"min":{"1min":0.499,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.621,"5min":3.3639999999999999,"15min":30.995000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.72799999999999998},"min":{"1min":0.61099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.0029999999999999,"5min":1.5069999999999999,"15min":24.504000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.67400000000000004,"15min":0.75900000000000001},"min":{"1min":0.66100000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.96799999999999997,"5min":1.526,"15min":24.524999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.65100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82799999999999996,"5min":10.250999999999999,"15min":31.038},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.72999999999999998},"min":{"1min":0.63300000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.92900000000000005,"5min":10.209,"15min":10.209},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":158564352,"data_stored":158550118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":160464896,"data_stored":160441193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":136134656,"data_stored":136110397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T16:01:07.988 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:01:07.988 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:01:07.989 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:01:07.989 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:01:07.989 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:01:07.989 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:01:07.990 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:01:07.991 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-01T15:43:44.161907+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=44, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:01:07.991 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:01:07.992 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:01:07.993 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-01T15:43:45.166620+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=43, tm_sec=45, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=15, tm_min=59, tm_sec=43, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T16:01:07.993 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-01T16:01:18.556 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:01:18.559 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:01:18.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:01:27.994 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T16:01:28.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.103+0000 7f6de7fff700 1 Processor -- start 2023-12-01T16:01:28.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.103+0000 7f6de7fff700 1 -- start start 2023-12-01T16:01:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.103+0000 7f6de7fff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6de813e6f0 0x7f6de8140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.103+0000 7f6de7fff700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de80705e0 con 0x7f6de8131770 2023-12-01T16:01:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.103+0000 7f6de7fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de806ea10 con 0x7f6de8131390 2023-12-01T16:01:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.103+0000 7f6de7fff700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de8131bd0 con 0x7f6de813e6f0 2023-12-01T16:01:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.103+0000 7f6de77fe700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6de813e6f0 0x7f6de8140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.103+0000 7f6de67fc700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6de8131770 0x7f6de806e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48366/0 (socket says 172.21.15.63:48366) 2023-12-01T16:01:28.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.103+0000 7f6de67fc700 1 -- 172.21.15.63:0/4059878727 learned_addr learned my addr 172.21.15.63:0/4059878727 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T16:01:28.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de77fe700 1 -- 172.21.15.63:0/4059878727 >> v1:172.21.15.66:6789/0 conn(0x7f6de8131390 legacy=0x7f6de806dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de77fe700 1 -- 172.21.15.63:0/4059878727 >> v1:172.21.15.63:6789/0 conn(0x7f6de8131770 legacy=0x7f6de806e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de5ffb700 1 -- 172.21.15.63:0/4059878727 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334651048 0 0) 0x7f6de80705e0 con 0x7f6de8131770 2023-12-01T16:01:28.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de77fe700 1 -- 172.21.15.63:0/4059878727 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8071d90 con 0x7f6de813e6f0 2023-12-01T16:01:28.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de77fe700 1 --2- 172.21.15.63:0/4059878727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6de813e6f0 0x7f6de8140ae0 secure :-1 s=READY pgs=2965 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009850 tx=0x7f6de0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16c93e759160132 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de5ffb700 1 -- 172.21.15.63:0/4059878727 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0011830 con 0x7f6de813e6f0 2023-12-01T16:01:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de5ffb700 1 -- 172.21.15.63:0/4059878727 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de0011990 con 0x7f6de813e6f0 2023-12-01T16:01:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de5ffb700 1 -- 172.21.15.63:0/4059878727 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0011d20 con 0x7f6de813e6f0 2023-12-01T16:01:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de7fff700 1 -- 172.21.15.63:0/4059878727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6de813e6f0 msgr2=0x7f6de8140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de7fff700 1 --2- 172.21.15.63:0/4059878727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6de813e6f0 0x7f6de8140ae0 secure :-1 s=READY pgs=2965 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009850 tx=0x7f6de0009b60 comp rx=0 tx=0).stop 2023-12-01T16:01:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de7fff700 1 -- 172.21.15.63:0/4059878727 shutdown_connections 2023-12-01T16:01:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de7fff700 1 --2- 172.21.15.63:0/4059878727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6de813e6f0 0x7f6de8140ae0 unknown :-1 s=CLOSED pgs=2965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de7fff700 1 -- 172.21.15.63:0/4059878727 >> 172.21.15.63:0/4059878727 conn(0x7f6de80a8bd0 msgr2=0x7f6de8098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de7fff700 1 -- 172.21.15.63:0/4059878727 shutdown_connections 2023-12-01T16:01:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de7fff700 1 -- 172.21.15.63:0/4059878727 wait complete. 2023-12-01T16:01:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de7fff700 1 Processor -- start 2023-12-01T16:01:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.107+0000 7f6de7fff700 1 -- start start 2023-12-01T16:01:28.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de7fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6de8131390 0x7f6de8130710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de7fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6de8131770 0x7f6de813fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de7fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6de813e6f0 0x7f6de8140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de7fff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de811f760 con 0x7f6de8131770 2023-12-01T16:01:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de7fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de811ed70 con 0x7f6de8131390 2023-12-01T16:01:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de7fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8141b40 con 0x7f6de813e6f0 2023-12-01T16:01:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de67fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6de8131770 0x7f6de813fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de67fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6de8131770 0x7f6de813fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45252/0 (socket says 172.21.15.63:45252) 2023-12-01T16:01:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de67fc700 1 -- 172.21.15.63:0/640721278 learned_addr learned my addr 172.21.15.63:0/640721278 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:01:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de6ffd700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6de8131390 0x7f6de8130710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de77fe700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6de813e6f0 0x7f6de8140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de67fc700 1 -- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6de813e6f0 msgr2=0x7f6de8140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de67fc700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6de813e6f0 0x7f6de8140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de67fc700 1 -- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6de8131390 msgr2=0x7f6de8130710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de67fc700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6de8131390 0x7f6de8130710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de67fc700 1 -- 172.21.15.63:0/640721278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de00094b0 con 0x7f6de8131770 2023-12-01T16:01:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de67fc700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6de8131770 0x7f6de813fe40 secure :-1 s=READY pgs=2966 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800cc80 tx=0x7f6dd800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6dcf7fe700 1 -- 172.21.15.63:0/640721278 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800ab00 con 0x7f6de8131770 2023-12-01T16:01:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6dcf7fe700 1 -- 172.21.15.63:0/640721278 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd800ac60 con 0x7f6de8131770 2023-12-01T16:01:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de7fff700 1 -- 172.21.15.63:0/640721278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de811f980 con 0x7f6de8131770 2023-12-01T16:01:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6dcf7fe700 1 -- 172.21.15.63:0/640721278 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80070d0 con 0x7f6de8131770 2023-12-01T16:01:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de7fff700 1 -- 172.21.15.63:0/640721278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de811f450 con 0x7f6de8131770 2023-12-01T16:01:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.111+0000 7f6de7fff700 1 -- 172.21.15.63:0/640721278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de8065fb0 con 0x7f6de8131770 2023-12-01T16:01:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.115+0000 7f6dcf7fe700 1 -- 172.21.15.63:0/640721278 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6dd8007230 con 0x7f6de8131770 2023-12-01T16:01:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.115+0000 7f6dcf7fe700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6dd4065ad0 0x7f6dd4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.115+0000 7f6dcf7fe700 1 -- 172.21.15.63:0/640721278 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7f6dd8082ad0 con 0x7f6de8131770 2023-12-01T16:01:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.115+0000 7f6de6ffd700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6dd4065ad0 0x7f6dd4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.115+0000 7f6de6ffd700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6dd4065ad0 0x7f6dd4067f90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc000f60 tx=0x7f6ddc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.119+0000 7f6dcf7fe700 1 -- 172.21.15.63:0/640721278 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6dd80509a0 con 0x7f6de8131770 2023-12-01T16:01:28.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.283+0000 7f6de7fff700 1 -- 172.21.15.63:0/640721278 --> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6de806f5b0 con 0x7f6dd4065ad0 2023-12-01T16:01:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.299+0000 7f6dcf7fe700 1 -- 172.21.15.63:0/640721278 <== mgr.4102 v2:172.21.15.66:6816/29681 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282315 (secure 0 0 0) 0x7f6de806f5b0 con 0x7f6dd4065ad0 2023-12-01T16:01:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T16:01:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 -- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6dd4065ad0 msgr2=0x7f6dd4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6dd4065ad0 0x7f6dd4067f90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc000f60 tx=0x7f6ddc009040 comp rx=0 tx=0).stop 2023-12-01T16:01:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 -- 172.21.15.63:0/640721278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6de8131770 msgr2=0x7f6de813fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6de8131770 0x7f6de813fe40 secure :-1 s=READY pgs=2966 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800cc80 tx=0x7f6dd800cf90 comp rx=0 tx=0).stop 2023-12-01T16:01:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 -- 172.21.15.63:0/640721278 shutdown_connections 2023-12-01T16:01:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f6dd4065ad0 0x7f6dd4067f90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6de813e6f0 0x7f6de8140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6de8131770 0x7f6de813fe40 unknown :-1 s=CLOSED pgs=2966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 --2- 172.21.15.63:0/640721278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6de8131390 0x7f6de8130710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 -- 172.21.15.63:0/640721278 >> 172.21.15.63:0/640721278 conn(0x7f6de80a8bd0 msgr2=0x7f6de8127f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 -- 172.21.15.63:0/640721278 shutdown_connections 2023-12-01T16:01:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.307+0000 7f6de7fff700 1 -- 172.21.15.63:0/640721278 wait complete. 2023-12-01T16:01:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-01T16:01:28.334 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":577,"stamp":"2023-12-01T16:01:26.739592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":278600058,"num_objects":242,"num_object_clones":28,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":15,"num_read":370,"num_read_kb":3540,"num_write":153136,"num_write_kb":684169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5327133,"num_omap_keys":10604,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302211,"ondisk_log_size":302211,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":2876184,"kb_used_data":546232,"kb_used_omap":0,"kb_used_meta":2329920,"kb_avail":374611176,"statfs":{"total":386547056640,"available":383601844224,"internally_reserved":0,"allocated":559341568,"data_stored":557924776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2385838080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004495"},"pg_stats":[{"pgid":"4.3f","version":"44'3309","reported_seq":2817,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:07.924003+0000","last_change":"2023-12-01T16:01:07.924132+0000","last_active":"2023-12-01T16:01:07.924003+0000","last_peered":"2023-12-01T16:01:07.924003+0000","last_clean":"2023-12-01T16:01:07.924003+0000","last_became_active":"2023-12-01T15:43:45.574179+0000","last_became_peered":"2023-12-01T15:43:45.574179+0000","last_unstale":"2023-12-01T16:01:07.924003+0000","last_undegraded":"2023-12-01T16:01:07.924003+0000","last_fullsized":"2023-12-01T16:01:07.924003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3309","last_scrub_stamp":"2023-12-01T16:01:07.923982+0000","last_deep_scrub":"44'3309","last_deep_scrub_stamp":"2023-12-01T16:01:07.923982+0000","last_clean_scrub_stamp":"2023-12-01T16:01:07.923982+0000","objects_scrubbed":6,"log_size":3309,"log_dups_size":0,"ondisk_log_size":3309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:24.648879+0000","scrub_duration":0.039543615999999997,"objects_trimmed":0,"snaptrim_duration":0.13670799,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"44'3497","reported_seq":2969,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:37.162739+0000","last_change":"2023-12-01T16:00:37.162955+0000","last_active":"2023-12-01T16:00:37.162739+0000","last_peered":"2023-12-01T16:00:37.162739+0000","last_clean":"2023-12-01T16:00:37.162739+0000","last_became_active":"2023-12-01T15:43:45.574955+0000","last_became_peered":"2023-12-01T15:43:45.574955+0000","last_unstale":"2023-12-01T16:00:37.162739+0000","last_undegraded":"2023-12-01T16:00:37.162739+0000","last_fullsized":"2023-12-01T16:00:37.162739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3497","last_scrub_stamp":"2023-12-01T16:00:37.162676+0000","last_deep_scrub":"44'3497","last_deep_scrub_stamp":"2023-12-01T16:00:37.162676+0000","last_clean_scrub_stamp":"2023-12-01T16:00:37.162676+0000","objects_scrubbed":1,"log_size":3497,"log_dups_size":0,"ondisk_log_size":3497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:47:58.369574+0000","scrub_duration":0.043835766999999998,"objects_trimmed":0,"snaptrim_duration":0.085048589999999993,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'3434","reported_seq":2909,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:18.649924+0000","last_change":"2023-12-01T16:01:18.650041+0000","last_active":"2023-12-01T16:01:18.649924+0000","last_peered":"2023-12-01T16:01:18.649924+0000","last_clean":"2023-12-01T16:01:18.649924+0000","last_became_active":"2023-12-01T15:43:45.585448+0000","last_became_peered":"2023-12-01T15:43:45.585448+0000","last_unstale":"2023-12-01T16:01:18.649924+0000","last_undegraded":"2023-12-01T16:01:18.649924+0000","last_fullsized":"2023-12-01T16:01:18.649924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3434","last_scrub_stamp":"2023-12-01T16:01:18.649900+0000","last_deep_scrub":"43'3434","last_deep_scrub_stamp":"2023-12-01T16:01:18.649900+0000","last_clean_scrub_stamp":"2023-12-01T16:01:18.649900+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:51:19.490954+0000","scrub_duration":0.034426432999999999,"objects_trimmed":0,"snaptrim_duration":0.15483981599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"44'3688","reported_seq":3053,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:46.948071+0000","last_change":"2023-12-01T15:59:46.948071+0000","last_active":"2023-12-01T15:59:46.948071+0000","last_peered":"2023-12-01T15:59:46.948071+0000","last_clean":"2023-12-01T15:59:46.948071+0000","last_became_active":"2023-12-01T15:43:45.572502+0000","last_became_peered":"2023-12-01T15:43:45.572502+0000","last_unstale":"2023-12-01T15:59:46.948071+0000","last_undegraded":"2023-12-01T15:59:46.948071+0000","last_fullsized":"2023-12-01T15:59:46.948071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3688","last_scrub_stamp":"2023-12-01T15:59:46.947938+0000","last_deep_scrub":"44'3688","last_deep_scrub_stamp":"2023-12-01T15:59:46.947938+0000","last_clean_scrub_stamp":"2023-12-01T15:59:46.947938+0000","objects_scrubbed":1,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:14:57.265242+0000","scrub_duration":0.050574905000000003,"objects_trimmed":0,"snaptrim_duration":0.086572531999999994,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"44'3487","reported_seq":2932,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:03.860477+0000","last_change":"2023-12-01T16:01:03.860477+0000","last_active":"2023-12-01T16:01:03.860477+0000","last_peered":"2023-12-01T16:01:03.860477+0000","last_clean":"2023-12-01T16:01:03.860477+0000","last_became_active":"2023-12-01T15:43:45.572681+0000","last_became_peered":"2023-12-01T15:43:45.572681+0000","last_unstale":"2023-12-01T16:01:03.860477+0000","last_undegraded":"2023-12-01T16:01:03.860477+0000","last_fullsized":"2023-12-01T16:01:03.860477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3487","last_scrub_stamp":"2023-12-01T16:01:03.860317+0000","last_deep_scrub":"44'3487","last_deep_scrub_stamp":"2023-12-01T16:01:03.860317+0000","last_clean_scrub_stamp":"2023-12-01T16:01:03.860317+0000","objects_scrubbed":2,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:34.904800+0000","scrub_duration":0.043185085999999998,"objects_trimmed":0,"snaptrim_duration":0.13014335599999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'3421","reported_seq":2875,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:10.245065+0000","last_change":"2023-12-01T16:00:10.245065+0000","last_active":"2023-12-01T16:00:10.245065+0000","last_peered":"2023-12-01T16:00:10.245065+0000","last_clean":"2023-12-01T16:00:10.245065+0000","last_became_active":"2023-12-01T15:43:45.586512+0000","last_became_peered":"2023-12-01T15:43:45.586512+0000","last_unstale":"2023-12-01T16:00:10.245065+0000","last_undegraded":"2023-12-01T16:00:10.245065+0000","last_fullsized":"2023-12-01T16:00:10.245065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3421","last_scrub_stamp":"2023-12-01T16:00:10.244912+0000","last_deep_scrub":"44'3421","last_deep_scrub_stamp":"2023-12-01T16:00:10.244912+0000","last_clean_scrub_stamp":"2023-12-01T16:00:10.244912+0000","objects_scrubbed":2,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:05.632092+0000","scrub_duration":0.052734889,"objects_trimmed":0,"snaptrim_duration":0.133828119,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"44'3768","reported_seq":3235,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:26.267141+0000","last_change":"2023-12-01T16:00:26.267141+0000","last_active":"2023-12-01T16:00:26.267141+0000","last_peered":"2023-12-01T16:00:26.267141+0000","last_clean":"2023-12-01T16:00:26.267141+0000","last_became_active":"2023-12-01T15:43:45.586548+0000","last_became_peered":"2023-12-01T15:43:45.586548+0000","last_unstale":"2023-12-01T16:00:26.267141+0000","last_undegraded":"2023-12-01T16:00:26.267141+0000","last_fullsized":"2023-12-01T16:00:26.267141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3768","last_scrub_stamp":"2023-12-01T16:00:26.267005+0000","last_deep_scrub":"44'3768","last_deep_scrub_stamp":"2023-12-01T16:00:26.267005+0000","last_clean_scrub_stamp":"2023-12-01T16:00:26.267005+0000","objects_scrubbed":4,"log_size":3768,"log_dups_size":0,"ondisk_log_size":3768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:47:15.591358+0000","scrub_duration":0.046986235000000001,"objects_trimmed":0,"snaptrim_duration":0.16251290900000001,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"44'3435","reported_seq":2852,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:08.569869+0000","last_change":"2023-12-01T16:01:08.569869+0000","last_active":"2023-12-01T16:01:08.569869+0000","last_peered":"2023-12-01T16:01:08.569869+0000","last_clean":"2023-12-01T16:01:08.569869+0000","last_became_active":"2023-12-01T15:43:45.588568+0000","last_became_peered":"2023-12-01T15:43:45.588568+0000","last_unstale":"2023-12-01T16:01:08.569869+0000","last_undegraded":"2023-12-01T16:01:08.569869+0000","last_fullsized":"2023-12-01T16:01:08.569869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3435","last_scrub_stamp":"2023-12-01T16:01:08.569515+0000","last_deep_scrub":"44'3435","last_deep_scrub_stamp":"2023-12-01T16:01:08.569515+0000","last_clean_scrub_stamp":"2023-12-01T16:01:08.569515+0000","objects_scrubbed":2,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:12:04.687233+0000","scrub_duration":0.054797723,"objects_trimmed":0,"snaptrim_duration":0.173046373,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"44'3525","reported_seq":2956,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:04.827163+0000","last_change":"2023-12-01T16:01:04.827278+0000","last_active":"2023-12-01T16:01:04.827163+0000","last_peered":"2023-12-01T16:01:04.827163+0000","last_clean":"2023-12-01T16:01:04.827163+0000","last_became_active":"2023-12-01T15:43:45.574316+0000","last_became_peered":"2023-12-01T15:43:45.574316+0000","last_unstale":"2023-12-01T16:01:04.827163+0000","last_undegraded":"2023-12-01T16:01:04.827163+0000","last_fullsized":"2023-12-01T16:01:04.827163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3525","last_scrub_stamp":"2023-12-01T16:01:04.827140+0000","last_deep_scrub":"44'3525","last_deep_scrub_stamp":"2023-12-01T16:01:04.827140+0000","last_clean_scrub_stamp":"2023-12-01T16:01:04.827140+0000","objects_scrubbed":1,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:20:21.598017+0000","scrub_duration":0.052240481999999998,"objects_trimmed":0,"snaptrim_duration":0.13648046599999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'3320","reported_seq":2822,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:11.617663+0000","last_change":"2023-12-01T16:01:11.617770+0000","last_active":"2023-12-01T16:01:11.617663+0000","last_peered":"2023-12-01T16:01:11.617663+0000","last_clean":"2023-12-01T16:01:11.617663+0000","last_became_active":"2023-12-01T15:43:45.585594+0000","last_became_peered":"2023-12-01T15:43:45.585594+0000","last_unstale":"2023-12-01T16:01:11.617663+0000","last_undegraded":"2023-12-01T16:01:11.617663+0000","last_fullsized":"2023-12-01T16:01:11.617663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3320","last_scrub_stamp":"2023-12-01T16:01:11.617642+0000","last_deep_scrub":"43'3320","last_deep_scrub_stamp":"2023-12-01T16:01:11.617642+0000","last_clean_scrub_stamp":"2023-12-01T16:01:11.617642+0000","objects_scrubbed":0,"log_size":3320,"log_dups_size":0,"ondisk_log_size":3320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:07:35.677939+0000","scrub_duration":0.036477794000000001,"objects_trimmed":0,"snaptrim_duration":0.160523057,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"44'3408","reported_seq":2882,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.074578+0000","last_change":"2023-12-01T15:59:56.074578+0000","last_active":"2023-12-01T15:59:56.074578+0000","last_peered":"2023-12-01T15:59:56.074578+0000","last_clean":"2023-12-01T15:59:56.074578+0000","last_became_active":"2023-12-01T15:43:45.580765+0000","last_became_peered":"2023-12-01T15:43:45.580765+0000","last_unstale":"2023-12-01T15:59:56.074578+0000","last_undegraded":"2023-12-01T15:59:56.074578+0000","last_fullsized":"2023-12-01T15:59:56.074578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3408","last_scrub_stamp":"2023-12-01T15:59:56.074209+0000","last_deep_scrub":"44'3408","last_deep_scrub_stamp":"2023-12-01T15:59:56.074209+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.074209+0000","objects_scrubbed":1,"log_size":3408,"log_dups_size":0,"ondisk_log_size":3408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:17.450625+0000","scrub_duration":0.044446310000000003,"objects_trimmed":0,"snaptrim_duration":0.080275320999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"43'3529","reported_seq":2915,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:49.279167+0000","last_change":"2023-12-01T16:00:49.279281+0000","last_active":"2023-12-01T16:00:49.279167+0000","last_peered":"2023-12-01T16:00:49.279167+0000","last_clean":"2023-12-01T16:00:49.279167+0000","last_became_active":"2023-12-01T15:43:45.572973+0000","last_became_peered":"2023-12-01T15:43:45.572973+0000","last_unstale":"2023-12-01T16:00:49.279167+0000","last_undegraded":"2023-12-01T16:00:49.279167+0000","last_fullsized":"2023-12-01T16:00:49.279167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3529","last_scrub_stamp":"2023-12-01T16:00:49.279144+0000","last_deep_scrub":"43'3529","last_deep_scrub_stamp":"2023-12-01T16:00:49.279144+0000","last_clean_scrub_stamp":"2023-12-01T16:00:49.279144+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:08:16.628877+0000","scrub_duration":0.036435990000000001,"objects_trimmed":0,"snaptrim_duration":0.63957533600000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"44'3183","reported_seq":2667,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:59.957039+0000","last_change":"2023-12-01T16:00:59.957213+0000","last_active":"2023-12-01T16:00:59.957039+0000","last_peered":"2023-12-01T16:00:59.957039+0000","last_clean":"2023-12-01T16:00:59.957039+0000","last_became_active":"2023-12-01T15:43:45.566207+0000","last_became_peered":"2023-12-01T15:43:45.566207+0000","last_unstale":"2023-12-01T16:00:59.957039+0000","last_undegraded":"2023-12-01T16:00:59.957039+0000","last_fullsized":"2023-12-01T16:00:59.957039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3183","last_scrub_stamp":"2023-12-01T16:00:59.957004+0000","last_deep_scrub":"44'3183","last_deep_scrub_stamp":"2023-12-01T16:00:59.957004+0000","last_clean_scrub_stamp":"2023-12-01T16:00:59.957004+0000","objects_scrubbed":5,"log_size":3183,"log_dups_size":0,"ondisk_log_size":3183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:33:13.277284+0000","scrub_duration":0.063358216999999994,"objects_trimmed":0,"snaptrim_duration":0.138334033,"stat_sum":{"num_bytes":12297,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"43'3508","reported_seq":2945,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.031371+0000","last_change":"2023-12-01T16:00:23.031526+0000","last_active":"2023-12-01T16:00:23.031371+0000","last_peered":"2023-12-01T16:00:23.031371+0000","last_clean":"2023-12-01T16:00:23.031371+0000","last_became_active":"2023-12-01T15:43:45.574532+0000","last_became_peered":"2023-12-01T15:43:45.574532+0000","last_unstale":"2023-12-01T16:00:23.031371+0000","last_undegraded":"2023-12-01T16:00:23.031371+0000","last_fullsized":"2023-12-01T16:00:23.031371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3508","last_scrub_stamp":"2023-12-01T16:00:23.031325+0000","last_deep_scrub":"43'3508","last_deep_scrub_stamp":"2023-12-01T16:00:23.031325+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.031325+0000","objects_scrubbed":0,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:08.388208+0000","scrub_duration":0.040441997,"objects_trimmed":0,"snaptrim_duration":0.091404182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"44'3602","reported_seq":3022,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:41.172312+0000","last_change":"2023-12-01T16:00:41.172431+0000","last_active":"2023-12-01T16:00:41.172312+0000","last_peered":"2023-12-01T16:00:41.172312+0000","last_clean":"2023-12-01T16:00:41.172312+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T16:00:41.172312+0000","last_undegraded":"2023-12-01T16:00:41.172312+0000","last_fullsized":"2023-12-01T16:00:41.172312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3602","last_scrub_stamp":"2023-12-01T16:00:41.172283+0000","last_deep_scrub":"44'3602","last_deep_scrub_stamp":"2023-12-01T16:00:41.172283+0000","last_clean_scrub_stamp":"2023-12-01T16:00:41.172283+0000","objects_scrubbed":2,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:06.910819+0000","scrub_duration":0.043202600000000001,"objects_trimmed":0,"snaptrim_duration":0.086861997999999996,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1247,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"44'3536","reported_seq":2958,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:35.372431+0000","last_change":"2023-12-01T16:00:35.372603+0000","last_active":"2023-12-01T16:00:35.372431+0000","last_peered":"2023-12-01T16:00:35.372431+0000","last_clean":"2023-12-01T16:00:35.372431+0000","last_became_active":"2023-12-01T15:43:45.585542+0000","last_became_peered":"2023-12-01T15:43:45.585542+0000","last_unstale":"2023-12-01T16:00:35.372431+0000","last_undegraded":"2023-12-01T16:00:35.372431+0000","last_fullsized":"2023-12-01T16:00:35.372431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3536","last_scrub_stamp":"2023-12-01T16:00:35.372401+0000","last_deep_scrub":"44'3536","last_deep_scrub_stamp":"2023-12-01T16:00:35.372401+0000","last_clean_scrub_stamp":"2023-12-01T16:00:35.372401+0000","objects_scrubbed":3,"log_size":3536,"log_dups_size":0,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:06:41.936183+0000","scrub_duration":0.066751594999999997,"objects_trimmed":0,"snaptrim_duration":0.17327173600000001,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"43'3588","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:58.919901+0000","last_change":"2023-12-01T16:00:58.920190+0000","last_active":"2023-12-01T16:00:58.919901+0000","last_peered":"2023-12-01T16:00:58.919901+0000","last_clean":"2023-12-01T16:00:58.919901+0000","last_became_active":"2023-12-01T15:43:45.571564+0000","last_became_peered":"2023-12-01T15:43:45.571564+0000","last_unstale":"2023-12-01T16:00:58.919901+0000","last_undegraded":"2023-12-01T16:00:58.919901+0000","last_fullsized":"2023-12-01T16:00:58.919901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3588","last_scrub_stamp":"2023-12-01T16:00:58.919824+0000","last_deep_scrub":"43'3588","last_deep_scrub_stamp":"2023-12-01T16:00:58.919824+0000","last_clean_scrub_stamp":"2023-12-01T16:00:58.919824+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:25:44.890371+0000","scrub_duration":0.034805932999999997,"objects_trimmed":0,"snaptrim_duration":0.13630616600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'3287","reported_seq":2802,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:20.266022+0000","last_change":"2023-12-01T16:00:20.266155+0000","last_active":"2023-12-01T16:00:20.266022+0000","last_peered":"2023-12-01T16:00:20.266022+0000","last_clean":"2023-12-01T16:00:20.266022+0000","last_became_active":"2023-12-01T15:43:45.587632+0000","last_became_peered":"2023-12-01T15:43:45.587632+0000","last_unstale":"2023-12-01T16:00:20.266022+0000","last_undegraded":"2023-12-01T16:00:20.266022+0000","last_fullsized":"2023-12-01T16:00:20.266022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3287","last_scrub_stamp":"2023-12-01T16:00:20.265995+0000","last_deep_scrub":"44'3287","last_deep_scrub_stamp":"2023-12-01T16:00:20.265995+0000","last_clean_scrub_stamp":"2023-12-01T16:00:20.265995+0000","objects_scrubbed":5,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:05.049698+0000","scrub_duration":0.052120284000000003,"objects_trimmed":0,"snaptrim_duration":0.159652814,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1044,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"43'3337","reported_seq":2789,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:56.885842+0000","last_change":"2023-12-01T16:00:56.886180+0000","last_active":"2023-12-01T16:00:56.885842+0000","last_peered":"2023-12-01T16:00:56.885842+0000","last_clean":"2023-12-01T16:00:56.885842+0000","last_became_active":"2023-12-01T15:43:45.580660+0000","last_became_peered":"2023-12-01T15:43:45.580660+0000","last_unstale":"2023-12-01T16:00:56.885842+0000","last_undegraded":"2023-12-01T16:00:56.885842+0000","last_fullsized":"2023-12-01T16:00:56.885842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3337","last_scrub_stamp":"2023-12-01T16:00:56.885792+0000","last_deep_scrub":"43'3337","last_deep_scrub_stamp":"2023-12-01T16:00:56.885792+0000","last_clean_scrub_stamp":"2023-12-01T16:00:56.885792+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:13:58.053769+0000","scrub_duration":0.041491897,"objects_trimmed":0,"snaptrim_duration":0.134439324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"44'3656","reported_seq":3104,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:07.513634+0000","last_change":"2023-12-01T16:01:07.513929+0000","last_active":"2023-12-01T16:01:07.513634+0000","last_peered":"2023-12-01T16:01:07.513634+0000","last_clean":"2023-12-01T16:01:07.513634+0000","last_became_active":"2023-12-01T15:43:45.585551+0000","last_became_peered":"2023-12-01T15:43:45.585551+0000","last_unstale":"2023-12-01T16:01:07.513634+0000","last_undegraded":"2023-12-01T16:01:07.513634+0000","last_fullsized":"2023-12-01T16:01:07.513634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3656","last_scrub_stamp":"2023-12-01T16:01:07.513565+0000","last_deep_scrub":"44'3656","last_deep_scrub_stamp":"2023-12-01T16:01:07.513565+0000","last_clean_scrub_stamp":"2023-12-01T16:01:07.513565+0000","objects_scrubbed":1,"log_size":3656,"log_dups_size":0,"ondisk_log_size":3656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:15:07.745894+0000","scrub_duration":0.049094741999999997,"objects_trimmed":0,"snaptrim_duration":0.16502647100000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"43'3592","reported_seq":3041,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:36.187374+0000","last_change":"2023-12-01T16:00:36.187561+0000","last_active":"2023-12-01T16:00:36.187374+0000","last_peered":"2023-12-01T16:00:36.187374+0000","last_clean":"2023-12-01T16:00:36.187374+0000","last_became_active":"2023-12-01T15:43:45.577021+0000","last_became_peered":"2023-12-01T15:43:45.577021+0000","last_unstale":"2023-12-01T16:00:36.187374+0000","last_undegraded":"2023-12-01T16:00:36.187374+0000","last_fullsized":"2023-12-01T16:00:36.187374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3592","last_scrub_stamp":"2023-12-01T16:00:36.187327+0000","last_deep_scrub":"43'3592","last_deep_scrub_stamp":"2023-12-01T16:00:36.187327+0000","last_clean_scrub_stamp":"2023-12-01T16:00:36.187327+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:15.645932+0000","scrub_duration":0.049762045999999997,"objects_trimmed":0,"snaptrim_duration":0.082049368999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"44'3500","reported_seq":2885,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:48.924370+0000","last_change":"2023-12-01T16:00:48.924735+0000","last_active":"2023-12-01T16:00:48.924370+0000","last_peered":"2023-12-01T16:00:48.924370+0000","last_clean":"2023-12-01T16:00:48.924370+0000","last_became_active":"2023-12-01T15:44:30.528283+0000","last_became_peered":"2023-12-01T15:44:30.528283+0000","last_unstale":"2023-12-01T16:00:48.924370+0000","last_undegraded":"2023-12-01T16:00:48.924370+0000","last_fullsized":"2023-12-01T16:00:48.924370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3500","last_scrub_stamp":"2023-12-01T16:00:48.924303+0000","last_deep_scrub":"44'3500","last_deep_scrub_stamp":"2023-12-01T16:00:48.924303+0000","last_clean_scrub_stamp":"2023-12-01T16:00:48.924303+0000","objects_scrubbed":6,"log_size":3500,"log_dups_size":0,"ondisk_log_size":3500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:29:43.670040+0000","scrub_duration":0.059716822000000003,"objects_trimmed":0,"snaptrim_duration":0.13495370100000001,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'3469","reported_seq":2938,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:43.353888+0000","last_change":"2023-12-01T16:00:43.354064+0000","last_active":"2023-12-01T16:00:43.353888+0000","last_peered":"2023-12-01T16:00:43.353888+0000","last_clean":"2023-12-01T16:00:43.353888+0000","last_became_active":"2023-12-01T15:43:45.570951+0000","last_became_peered":"2023-12-01T15:43:45.570951+0000","last_unstale":"2023-12-01T16:00:43.353888+0000","last_undegraded":"2023-12-01T16:00:43.353888+0000","last_fullsized":"2023-12-01T16:00:43.353888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3469","last_scrub_stamp":"2023-12-01T16:00:43.353860+0000","last_deep_scrub":"44'3469","last_deep_scrub_stamp":"2023-12-01T16:00:43.353860+0000","last_clean_scrub_stamp":"2023-12-01T16:00:43.353860+0000","objects_scrubbed":3,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:09.092397+0000","scrub_duration":0.046109907999999998,"objects_trimmed":0,"snaptrim_duration":0.62816057700000005,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"44'3578","reported_seq":2962,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:55.212383+0000","last_change":"2023-12-01T15:59:55.212383+0000","last_active":"2023-12-01T15:59:55.212383+0000","last_peered":"2023-12-01T15:59:55.212383+0000","last_clean":"2023-12-01T15:59:55.212383+0000","last_became_active":"2023-12-01T15:43:45.588066+0000","last_became_peered":"2023-12-01T15:43:45.588066+0000","last_unstale":"2023-12-01T15:59:55.212383+0000","last_undegraded":"2023-12-01T15:59:55.212383+0000","last_fullsized":"2023-12-01T15:59:55.212383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3578","last_scrub_stamp":"2023-12-01T15:59:55.212209+0000","last_deep_scrub":"44'3578","last_deep_scrub_stamp":"2023-12-01T15:59:55.212209+0000","last_clean_scrub_stamp":"2023-12-01T15:59:55.212209+0000","objects_scrubbed":1,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:16.402349+0000","scrub_duration":0.042530062,"objects_trimmed":0,"snaptrim_duration":0.17330785400000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"44'3345","reported_seq":2836,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:38.376863+0000","last_change":"2023-12-01T16:00:38.376863+0000","last_active":"2023-12-01T16:00:38.376863+0000","last_peered":"2023-12-01T16:00:38.376863+0000","last_clean":"2023-12-01T16:00:38.376863+0000","last_became_active":"2023-12-01T15:43:45.581048+0000","last_became_peered":"2023-12-01T15:43:45.581048+0000","last_unstale":"2023-12-01T16:00:38.376863+0000","last_undegraded":"2023-12-01T16:00:38.376863+0000","last_fullsized":"2023-12-01T16:00:38.376863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3345","last_scrub_stamp":"2023-12-01T16:00:38.376670+0000","last_deep_scrub":"44'3345","last_deep_scrub_stamp":"2023-12-01T16:00:38.376670+0000","last_clean_scrub_stamp":"2023-12-01T16:00:38.376670+0000","objects_scrubbed":1,"log_size":3345,"log_dups_size":0,"ondisk_log_size":3345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:17.835274+0000","scrub_duration":0.046600474000000003,"objects_trimmed":0,"snaptrim_duration":0.63729295699999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"44'3413","reported_seq":2878,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:41.366080+0000","last_change":"2023-12-01T16:00:41.366080+0000","last_active":"2023-12-01T16:00:41.366080+0000","last_peered":"2023-12-01T16:00:41.366080+0000","last_clean":"2023-12-01T16:00:41.366080+0000","last_became_active":"2023-12-01T15:43:45.570864+0000","last_became_peered":"2023-12-01T15:43:45.570864+0000","last_unstale":"2023-12-01T16:00:41.366080+0000","last_undegraded":"2023-12-01T16:00:41.366080+0000","last_fullsized":"2023-12-01T16:00:41.366080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3413","last_scrub_stamp":"2023-12-01T16:00:41.365907+0000","last_deep_scrub":"44'3413","last_deep_scrub_stamp":"2023-12-01T16:00:41.365907+0000","last_clean_scrub_stamp":"2023-12-01T16:00:41.365907+0000","objects_scrubbed":2,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:06:47.929689+0000","scrub_duration":0.039734258000000001,"objects_trimmed":0,"snaptrim_duration":0.611917673,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'3318","reported_seq":2757,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:16.227914+0000","last_change":"2023-12-01T16:00:16.227914+0000","last_active":"2023-12-01T16:00:16.227914+0000","last_peered":"2023-12-01T16:00:16.227914+0000","last_clean":"2023-12-01T16:00:16.227914+0000","last_became_active":"2023-12-01T15:43:45.588143+0000","last_became_peered":"2023-12-01T15:43:45.588143+0000","last_unstale":"2023-12-01T16:00:16.227914+0000","last_undegraded":"2023-12-01T16:00:16.227914+0000","last_fullsized":"2023-12-01T16:00:16.227914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3318","last_scrub_stamp":"2023-12-01T16:00:16.227776+0000","last_deep_scrub":"44'3318","last_deep_scrub_stamp":"2023-12-01T16:00:16.227776+0000","last_clean_scrub_stamp":"2023-12-01T16:00:16.227776+0000","objects_scrubbed":6,"log_size":3318,"log_dups_size":0,"ondisk_log_size":3318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:57.976090+0000","scrub_duration":0.063500757000000005,"objects_trimmed":0,"snaptrim_duration":0.146734475,"stat_sum":{"num_bytes":4116,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'3312","reported_seq":2785,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:44.354616+0000","last_change":"2023-12-01T16:00:44.354616+0000","last_active":"2023-12-01T16:00:44.354616+0000","last_peered":"2023-12-01T16:00:44.354616+0000","last_clean":"2023-12-01T16:00:44.354616+0000","last_became_active":"2023-12-01T15:43:45.579060+0000","last_became_peered":"2023-12-01T15:43:45.579060+0000","last_unstale":"2023-12-01T16:00:44.354616+0000","last_undegraded":"2023-12-01T16:00:44.354616+0000","last_fullsized":"2023-12-01T16:00:44.354616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3312","last_scrub_stamp":"2023-12-01T16:00:44.354488+0000","last_deep_scrub":"43'3312","last_deep_scrub_stamp":"2023-12-01T16:00:44.354488+0000","last_clean_scrub_stamp":"2023-12-01T16:00:44.354488+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:32:49.581772+0000","scrub_duration":0.043847218,"objects_trimmed":0,"snaptrim_duration":0.65414528699999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"44'3667","reported_seq":3056,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:51.903362+0000","last_change":"2023-12-01T16:00:51.903522+0000","last_active":"2023-12-01T16:00:51.903362+0000","last_peered":"2023-12-01T16:00:51.903362+0000","last_clean":"2023-12-01T16:00:51.903362+0000","last_became_active":"2023-12-01T15:43:45.572353+0000","last_became_peered":"2023-12-01T15:43:45.572353+0000","last_unstale":"2023-12-01T16:00:51.903362+0000","last_undegraded":"2023-12-01T16:00:51.903362+0000","last_fullsized":"2023-12-01T16:00:51.903362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3667","last_scrub_stamp":"2023-12-01T16:00:51.903321+0000","last_deep_scrub":"44'3667","last_deep_scrub_stamp":"2023-12-01T16:00:51.903321+0000","last_clean_scrub_stamp":"2023-12-01T16:00:51.903321+0000","objects_scrubbed":5,"log_size":3667,"log_dups_size":0,"ondisk_log_size":3667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:51:11.226126+0000","scrub_duration":0.056216544,"objects_trimmed":0,"snaptrim_duration":0.13835824199999999,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"44'3522","reported_seq":3006,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.187910+0000","last_change":"2023-12-01T15:59:48.187910+0000","last_active":"2023-12-01T15:59:48.187910+0000","last_peered":"2023-12-01T15:59:48.187910+0000","last_clean":"2023-12-01T15:59:48.187910+0000","last_became_active":"2023-12-01T15:43:45.586863+0000","last_became_peered":"2023-12-01T15:43:45.586863+0000","last_unstale":"2023-12-01T15:59:48.187910+0000","last_undegraded":"2023-12-01T15:59:48.187910+0000","last_fullsized":"2023-12-01T15:59:48.187910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3522","last_scrub_stamp":"2023-12-01T15:59:48.187580+0000","last_deep_scrub":"44'3522","last_deep_scrub_stamp":"2023-12-01T15:59:48.187580+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.187580+0000","objects_scrubbed":2,"log_size":3522,"log_dups_size":0,"ondisk_log_size":3522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:21.418682+0000","scrub_duration":0.049219767999999997,"objects_trimmed":0,"snaptrim_duration":0.13490588100000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"44'3995","reported_seq":3333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:26.522607+0000","last_change":"2023-12-01T16:00:26.522607+0000","last_active":"2023-12-01T16:00:26.522607+0000","last_peered":"2023-12-01T16:00:26.522607+0000","last_clean":"2023-12-01T16:00:26.522607+0000","last_became_active":"2023-12-01T15:43:45.574688+0000","last_became_peered":"2023-12-01T15:43:45.574688+0000","last_unstale":"2023-12-01T16:00:26.522607+0000","last_undegraded":"2023-12-01T16:00:26.522607+0000","last_fullsized":"2023-12-01T16:00:26.522607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3995","last_scrub_stamp":"2023-12-01T16:00:26.522403+0000","last_deep_scrub":"44'3995","last_deep_scrub_stamp":"2023-12-01T16:00:26.522403+0000","last_clean_scrub_stamp":"2023-12-01T16:00:26.522403+0000","objects_scrubbed":1,"log_size":3995,"log_dups_size":0,"ondisk_log_size":3995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:11.306106+0000","scrub_duration":0.045664127999999998,"objects_trimmed":0,"snaptrim_duration":0.65412195699999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"44'3597","reported_seq":3012,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:27.093419+0000","last_change":"2023-12-01T16:00:27.093419+0000","last_active":"2023-12-01T16:00:27.093419+0000","last_peered":"2023-12-01T16:00:27.093419+0000","last_clean":"2023-12-01T16:00:27.093419+0000","last_became_active":"2023-12-01T15:43:45.572490+0000","last_became_peered":"2023-12-01T15:43:45.572490+0000","last_unstale":"2023-12-01T16:00:27.093419+0000","last_undegraded":"2023-12-01T16:00:27.093419+0000","last_fullsized":"2023-12-01T16:00:27.093419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3597","last_scrub_stamp":"2023-12-01T16:00:27.093268+0000","last_deep_scrub":"44'3597","last_deep_scrub_stamp":"2023-12-01T16:00:27.093268+0000","last_clean_scrub_stamp":"2023-12-01T16:00:27.093268+0000","objects_scrubbed":5,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:25:51.950070+0000","scrub_duration":0.053776247999999999,"objects_trimmed":0,"snaptrim_duration":0.090414480000000005,"stat_sum":{"num_bytes":4118,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"44'3662","reported_seq":3075,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:58.388349+0000","last_change":"2023-12-01T15:59:58.388349+0000","last_active":"2023-12-01T15:59:58.388349+0000","last_peered":"2023-12-01T15:59:58.388349+0000","last_clean":"2023-12-01T15:59:58.388349+0000","last_became_active":"2023-12-01T15:43:45.580599+0000","last_became_peered":"2023-12-01T15:43:45.580599+0000","last_unstale":"2023-12-01T15:59:58.388349+0000","last_undegraded":"2023-12-01T15:59:58.388349+0000","last_fullsized":"2023-12-01T15:59:58.388349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3662","last_scrub_stamp":"2023-12-01T15:59:58.388055+0000","last_deep_scrub":"44'3662","last_deep_scrub_stamp":"2023-12-01T15:59:58.388055+0000","last_clean_scrub_stamp":"2023-12-01T15:59:58.388055+0000","objects_scrubbed":1,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:31.619158+0000","scrub_duration":0.048690542000000003,"objects_trimmed":0,"snaptrim_duration":0.646838511,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"44'2737","reported_seq":2792,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:32.335426+0000","last_change":"2023-12-01T16:00:32.335578+0000","last_active":"2023-12-01T16:00:32.335426+0000","last_peered":"2023-12-01T16:00:32.335426+0000","last_clean":"2023-12-01T16:00:32.335426+0000","last_became_active":"2023-12-01T15:43:45.205155+0000","last_became_peered":"2023-12-01T15:43:45.205155+0000","last_unstale":"2023-12-01T16:00:32.335426+0000","last_undegraded":"2023-12-01T16:00:32.335426+0000","last_fullsized":"2023-12-01T16:00:32.335426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2737","last_scrub_stamp":"2023-12-01T16:00:32.335394+0000","last_deep_scrub":"44'2737","last_deep_scrub_stamp":"2023-12-01T16:00:32.335394+0000","last_clean_scrub_stamp":"2023-12-01T16:00:32.335394+0000","objects_scrubbed":3,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:11.793999+0000","scrub_duration":0.040503364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2729,"num_write_kb":18350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"44'3427","reported_seq":2858,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:14.591238+0000","last_change":"2023-12-01T16:01:14.591419+0000","last_active":"2023-12-01T16:01:14.591238+0000","last_peered":"2023-12-01T16:01:14.591238+0000","last_clean":"2023-12-01T16:01:14.591238+0000","last_became_active":"2023-12-01T15:43:45.587175+0000","last_became_peered":"2023-12-01T15:43:45.587175+0000","last_unstale":"2023-12-01T16:01:14.591238+0000","last_undegraded":"2023-12-01T16:01:14.591238+0000","last_fullsized":"2023-12-01T16:01:14.591238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3427","last_scrub_stamp":"2023-12-01T16:01:14.591204+0000","last_deep_scrub":"44'3427","last_deep_scrub_stamp":"2023-12-01T16:01:14.591204+0000","last_clean_scrub_stamp":"2023-12-01T16:01:14.591204+0000","objects_scrubbed":1,"log_size":3427,"log_dups_size":0,"ondisk_log_size":3427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:37:51.243473+0000","scrub_duration":0.050056468,"objects_trimmed":0,"snaptrim_duration":0.15458043599999999,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"35'5","reported_seq":60,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:36.838471+0000","last_change":"2023-12-01T16:00:36.838731+0000","last_active":"2023-12-01T16:00:36.838471+0000","last_peered":"2023-12-01T16:00:36.838471+0000","last_clean":"2023-12-01T16:00:36.838471+0000","last_became_active":"2023-12-01T15:43:45.203166+0000","last_became_peered":"2023-12-01T15:43:45.203166+0000","last_unstale":"2023-12-01T16:00:36.838471+0000","last_undegraded":"2023-12-01T16:00:36.838471+0000","last_fullsized":"2023-12-01T16:00:36.838471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2023-12-01T16:00:36.838414+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2023-12-01T16:00:36.838414+0000","last_clean_scrub_stamp":"2023-12-01T16:00:36.838414+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:06:43.402195+0000","scrub_duration":0.0045544590000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3629","reported_seq":3091,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.506683+0000","last_change":"2023-12-01T15:59:48.506683+0000","last_active":"2023-12-01T15:59:48.506683+0000","last_peered":"2023-12-01T15:59:48.506683+0000","last_clean":"2023-12-01T15:59:48.506683+0000","last_became_active":"2023-12-01T15:43:45.566605+0000","last_became_peered":"2023-12-01T15:43:45.566605+0000","last_unstale":"2023-12-01T15:59:48.506683+0000","last_undegraded":"2023-12-01T15:59:48.506683+0000","last_fullsized":"2023-12-01T15:59:48.506683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3629","last_scrub_stamp":"2023-12-01T15:59:48.506533+0000","last_deep_scrub":"44'3629","last_deep_scrub_stamp":"2023-12-01T15:59:48.506533+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.506533+0000","objects_scrubbed":1,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:08:56.880573+0000","scrub_duration":0.046519142999999999,"objects_trimmed":0,"snaptrim_duration":0.13624631700000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"44'1013","reported_seq":1068,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:11.216918+0000","last_change":"2023-12-01T16:00:11.217056+0000","last_active":"2023-12-01T16:00:11.216918+0000","last_peered":"2023-12-01T16:00:11.216918+0000","last_clean":"2023-12-01T16:00:11.216918+0000","last_became_active":"2023-12-01T15:43:45.205040+0000","last_became_peered":"2023-12-01T15:43:45.205040+0000","last_unstale":"2023-12-01T16:00:11.216918+0000","last_undegraded":"2023-12-01T16:00:11.216918+0000","last_fullsized":"2023-12-01T16:00:11.216918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1013","last_scrub_stamp":"2023-12-01T16:00:11.216892+0000","last_deep_scrub":"44'1013","last_deep_scrub_stamp":"2023-12-01T16:00:11.216892+0000","last_clean_scrub_stamp":"2023-12-01T16:00:11.216892+0000","objects_scrubbed":6,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:32.838433+0000","scrub_duration":0.058295441000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":10007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1316869,"num_omap_keys":2625,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"44'3453","reported_seq":2887,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.543735+0000","last_change":"2023-12-01T15:59:49.543735+0000","last_active":"2023-12-01T15:59:49.543735+0000","last_peered":"2023-12-01T15:59:49.543735+0000","last_clean":"2023-12-01T15:59:49.543735+0000","last_became_active":"2023-12-01T15:43:45.580095+0000","last_became_peered":"2023-12-01T15:43:45.580095+0000","last_unstale":"2023-12-01T15:59:49.543735+0000","last_undegraded":"2023-12-01T15:59:49.543735+0000","last_fullsized":"2023-12-01T15:59:49.543735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3453","last_scrub_stamp":"2023-12-01T15:59:49.543577+0000","last_deep_scrub":"44'3453","last_deep_scrub_stamp":"2023-12-01T15:59:49.543577+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.543577+0000","objects_scrubbed":2,"log_size":3453,"log_dups_size":0,"ondisk_log_size":3453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:22.774680+0000","scrub_duration":0.045727260999999998,"objects_trimmed":0,"snaptrim_duration":0.13638832000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'1390","reported_seq":1445,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:02.608754+0000","last_change":"2023-12-01T16:01:02.608882+0000","last_active":"2023-12-01T16:01:02.608754+0000","last_peered":"2023-12-01T16:01:02.608754+0000","last_clean":"2023-12-01T16:01:02.608754+0000","last_became_active":"2023-12-01T15:43:45.207366+0000","last_became_peered":"2023-12-01T15:43:45.207366+0000","last_unstale":"2023-12-01T16:01:02.608754+0000","last_undegraded":"2023-12-01T16:01:02.608754+0000","last_fullsized":"2023-12-01T16:01:02.608754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1390","last_scrub_stamp":"2023-12-01T16:01:02.608733+0000","last_deep_scrub":"44'1390","last_deep_scrub_stamp":"2023-12-01T16:01:02.608733+0000","last_clean_scrub_stamp":"2023-12-01T16:01:02.608733+0000","objects_scrubbed":6,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:20:19.379610+0000","scrub_duration":0.033745255000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1392,"num_write_kb":12529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16812,"num_omap_keys":28,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'1278","reported_seq":1333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:18.087582+0000","last_change":"2023-12-01T16:00:18.087703+0000","last_active":"2023-12-01T16:00:18.087582+0000","last_peered":"2023-12-01T16:00:18.087582+0000","last_clean":"2023-12-01T16:00:18.087582+0000","last_became_active":"2023-12-01T15:43:45.203596+0000","last_became_peered":"2023-12-01T15:43:45.203596+0000","last_unstale":"2023-12-01T16:00:18.087582+0000","last_undegraded":"2023-12-01T16:00:18.087582+0000","last_fullsized":"2023-12-01T16:00:18.087582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1278","last_scrub_stamp":"2023-12-01T16:00:18.087555+0000","last_deep_scrub":"44'1278","last_deep_scrub_stamp":"2023-12-01T16:00:18.087555+0000","last_clean_scrub_stamp":"2023-12-01T16:00:18.087555+0000","objects_scrubbed":2,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:13.474736+0000","scrub_duration":0.033204496999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":12495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'3658","reported_seq":3059,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:53.148041+0000","last_change":"2023-12-01T15:59:53.148041+0000","last_active":"2023-12-01T15:59:53.148041+0000","last_peered":"2023-12-01T15:59:53.148041+0000","last_clean":"2023-12-01T15:59:53.148041+0000","last_became_active":"2023-12-01T15:43:45.589429+0000","last_became_peered":"2023-12-01T15:43:45.589429+0000","last_unstale":"2023-12-01T15:59:53.148041+0000","last_undegraded":"2023-12-01T15:59:53.148041+0000","last_fullsized":"2023-12-01T15:59:53.148041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3658","last_scrub_stamp":"2023-12-01T15:59:53.147892+0000","last_deep_scrub":"43'3658","last_deep_scrub_stamp":"2023-12-01T15:59:53.147892+0000","last_clean_scrub_stamp":"2023-12-01T15:59:53.147892+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:26.141896+0000","scrub_duration":0.039317244000000001,"objects_trimmed":0,"snaptrim_duration":0.172903538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'1243","reported_seq":1298,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:05.986674+0000","last_change":"2023-12-01T16:00:05.986857+0000","last_active":"2023-12-01T16:00:05.986674+0000","last_peered":"2023-12-01T16:00:05.986674+0000","last_clean":"2023-12-01T16:00:05.986674+0000","last_became_active":"2023-12-01T15:43:45.200248+0000","last_became_peered":"2023-12-01T15:43:45.200248+0000","last_unstale":"2023-12-01T16:00:05.986674+0000","last_undegraded":"2023-12-01T16:00:05.986674+0000","last_fullsized":"2023-12-01T16:00:05.986674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1243","last_scrub_stamp":"2023-12-01T16:00:05.986638+0000","last_deep_scrub":"44'1243","last_deep_scrub_stamp":"2023-12-01T16:00:05.986638+0000","last_clean_scrub_stamp":"2023-12-01T16:00:05.986638+0000","objects_scrubbed":3,"log_size":1243,"log_dups_size":0,"ondisk_log_size":1243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:27.176778+0000","scrub_duration":0.028165143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1238,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'3445","reported_seq":2885,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:57.046543+0000","last_change":"2023-12-01T15:59:57.046543+0000","last_active":"2023-12-01T15:59:57.046543+0000","last_peered":"2023-12-01T15:59:57.046543+0000","last_clean":"2023-12-01T15:59:57.046543+0000","last_became_active":"2023-12-01T15:43:45.573252+0000","last_became_peered":"2023-12-01T15:43:45.573252+0000","last_unstale":"2023-12-01T15:59:57.046543+0000","last_undegraded":"2023-12-01T15:59:57.046543+0000","last_fullsized":"2023-12-01T15:59:57.046543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3445","last_scrub_stamp":"2023-12-01T15:59:57.046388+0000","last_deep_scrub":"44'3445","last_deep_scrub_stamp":"2023-12-01T15:59:57.046388+0000","last_clean_scrub_stamp":"2023-12-01T15:59:57.046388+0000","objects_scrubbed":3,"log_size":3445,"log_dups_size":0,"ondisk_log_size":3445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:06:40.083816+0000","scrub_duration":0.046119563000000002,"objects_trimmed":0,"snaptrim_duration":0.090755167999999997,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1186,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"44'4746","reported_seq":4801,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:42.519833+0000","last_change":"2023-12-01T16:00:42.519960+0000","last_active":"2023-12-01T16:00:42.519833+0000","last_peered":"2023-12-01T16:00:42.519833+0000","last_clean":"2023-12-01T16:00:42.519833+0000","last_became_active":"2023-12-01T15:43:45.206733+0000","last_became_peered":"2023-12-01T15:43:45.206733+0000","last_unstale":"2023-12-01T16:00:42.519833+0000","last_undegraded":"2023-12-01T16:00:42.519833+0000","last_fullsized":"2023-12-01T16:00:42.519833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4746","last_scrub_stamp":"2023-12-01T16:00:42.519805+0000","last_deep_scrub":"44'4746","last_deep_scrub_stamp":"2023-12-01T16:00:42.519805+0000","last_clean_scrub_stamp":"2023-12-01T16:00:42.519805+0000","objects_scrubbed":4,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:08:09.869538+0000","scrub_duration":0.057596223000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4735,"num_write_kb":27522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3360","reported_seq":2797,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.985964+0000","last_change":"2023-12-01T15:59:49.985964+0000","last_active":"2023-12-01T15:59:49.985964+0000","last_peered":"2023-12-01T15:59:49.985964+0000","last_clean":"2023-12-01T15:59:49.985964+0000","last_became_active":"2023-12-01T15:43:45.581440+0000","last_became_peered":"2023-12-01T15:43:45.581440+0000","last_unstale":"2023-12-01T15:59:49.985964+0000","last_undegraded":"2023-12-01T15:59:49.985964+0000","last_fullsized":"2023-12-01T15:59:49.985964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3360","last_scrub_stamp":"2023-12-01T15:59:49.985801+0000","last_deep_scrub":"44'3360","last_deep_scrub_stamp":"2023-12-01T15:59:49.985801+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.985801+0000","objects_scrubbed":1,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:22:12.421111+0000","scrub_duration":0.040212074,"objects_trimmed":0,"snaptrim_duration":0.090274558000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'1994","reported_seq":2049,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.208746+0000","last_change":"2023-12-01T16:00:23.208916+0000","last_active":"2023-12-01T16:00:23.208746+0000","last_peered":"2023-12-01T16:00:23.208746+0000","last_clean":"2023-12-01T16:00:23.208746+0000","last_became_active":"2023-12-01T15:43:45.206127+0000","last_became_peered":"2023-12-01T15:43:45.206127+0000","last_unstale":"2023-12-01T16:00:23.208746+0000","last_undegraded":"2023-12-01T16:00:23.208746+0000","last_fullsized":"2023-12-01T16:00:23.208746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1994","last_scrub_stamp":"2023-12-01T16:00:23.208718+0000","last_deep_scrub":"44'1994","last_deep_scrub_stamp":"2023-12-01T16:00:23.208718+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.208718+0000","objects_scrubbed":6,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:01:53.915729+0000","scrub_duration":0.063117909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1987,"num_write_kb":25538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"44'3405","reported_seq":2910,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:59.668323+0000","last_change":"2023-12-01T15:59:59.668525+0000","last_active":"2023-12-01T15:59:59.668323+0000","last_peered":"2023-12-01T15:59:59.668323+0000","last_clean":"2023-12-01T15:59:59.668323+0000","last_became_active":"2023-12-01T15:43:45.572032+0000","last_became_peered":"2023-12-01T15:43:45.572032+0000","last_unstale":"2023-12-01T15:59:59.668323+0000","last_undegraded":"2023-12-01T15:59:59.668323+0000","last_fullsized":"2023-12-01T15:59:59.668323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3405","last_scrub_stamp":"2023-12-01T15:59:59.668279+0000","last_deep_scrub":"44'3405","last_deep_scrub_stamp":"2023-12-01T15:59:59.668279+0000","last_clean_scrub_stamp":"2023-12-01T15:59:59.668279+0000","objects_scrubbed":2,"log_size":3405,"log_dups_size":0,"ondisk_log_size":3405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:09.752731+0000","scrub_duration":0.045721932,"objects_trimmed":0,"snaptrim_duration":0.13034463499999999,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1138,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'4352","reported_seq":4407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:04.502682+0000","last_change":"2023-12-01T16:00:04.502810+0000","last_active":"2023-12-01T16:00:04.502682+0000","last_peered":"2023-12-01T16:00:04.502682+0000","last_clean":"2023-12-01T16:00:04.502682+0000","last_became_active":"2023-12-01T15:43:45.203643+0000","last_became_peered":"2023-12-01T15:43:45.203643+0000","last_unstale":"2023-12-01T16:00:04.502682+0000","last_undegraded":"2023-12-01T16:00:04.502682+0000","last_fullsized":"2023-12-01T16:00:04.502682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4352","last_scrub_stamp":"2023-12-01T16:00:04.502658+0000","last_deep_scrub":"44'4352","last_deep_scrub_stamp":"2023-12-01T16:00:04.502658+0000","last_clean_scrub_stamp":"2023-12-01T16:00:04.502658+0000","objects_scrubbed":4,"log_size":4352,"log_dups_size":0,"ondisk_log_size":4352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:37.496662+0000","scrub_duration":0.054000375000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4337,"num_write_kb":30065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1415,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"44'3800","reported_seq":3193,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:39.434317+0000","last_change":"2023-12-01T16:00:39.434464+0000","last_active":"2023-12-01T16:00:39.434317+0000","last_peered":"2023-12-01T16:00:39.434317+0000","last_clean":"2023-12-01T16:00:39.434317+0000","last_became_active":"2023-12-01T15:43:45.586209+0000","last_became_peered":"2023-12-01T15:43:45.586209+0000","last_unstale":"2023-12-01T16:00:39.434317+0000","last_undegraded":"2023-12-01T16:00:39.434317+0000","last_fullsized":"2023-12-01T16:00:39.434317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3800","last_scrub_stamp":"2023-12-01T16:00:39.434285+0000","last_deep_scrub":"44'3800","last_deep_scrub_stamp":"2023-12-01T16:00:39.434285+0000","last_clean_scrub_stamp":"2023-12-01T16:00:39.434285+0000","objects_scrubbed":3,"log_size":3800,"log_dups_size":0,"ondisk_log_size":3800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:54:03.676050+0000","scrub_duration":0.048777055999999999,"objects_trimmed":0,"snaptrim_duration":0.165714477,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"44'2495","reported_seq":2551,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:05.577178+0000","last_change":"2023-12-01T16:01:05.577178+0000","last_active":"2023-12-01T16:01:05.577178+0000","last_peered":"2023-12-01T16:01:05.577178+0000","last_clean":"2023-12-01T16:01:05.577178+0000","last_became_active":"2023-12-01T15:43:45.205126+0000","last_became_peered":"2023-12-01T15:43:45.205126+0000","last_unstale":"2023-12-01T16:01:05.577178+0000","last_undegraded":"2023-12-01T16:01:05.577178+0000","last_fullsized":"2023-12-01T16:01:05.577178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2495","last_scrub_stamp":"2023-12-01T16:01:05.576882+0000","last_deep_scrub":"44'2495","last_deep_scrub_stamp":"2023-12-01T16:01:05.576882+0000","last_clean_scrub_stamp":"2023-12-01T16:01:05.576882+0000","objects_scrubbed":4,"log_size":2495,"log_dups_size":0,"ondisk_log_size":2495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:22.301779+0000","scrub_duration":0.062815932000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2494,"num_write_kb":26915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'3466","reported_seq":2947,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:17.674482+0000","last_change":"2023-12-01T16:01:17.674642+0000","last_active":"2023-12-01T16:01:17.674482+0000","last_peered":"2023-12-01T16:01:17.674482+0000","last_clean":"2023-12-01T16:01:17.674482+0000","last_became_active":"2023-12-01T15:43:45.586265+0000","last_became_peered":"2023-12-01T15:43:45.586265+0000","last_unstale":"2023-12-01T16:01:17.674482+0000","last_undegraded":"2023-12-01T16:01:17.674482+0000","last_fullsized":"2023-12-01T16:01:17.674482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3466","last_scrub_stamp":"2023-12-01T16:01:17.674458+0000","last_deep_scrub":"44'3466","last_deep_scrub_stamp":"2023-12-01T16:01:17.674458+0000","last_clean_scrub_stamp":"2023-12-01T16:01:17.674458+0000","objects_scrubbed":4,"log_size":3466,"log_dups_size":0,"ondisk_log_size":3466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:58:59.053794+0000","scrub_duration":0.051363391000000001,"objects_trimmed":0,"snaptrim_duration":0.15615646,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1160,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'2354","reported_seq":2410,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:37.412288+0000","last_change":"2023-12-01T16:00:37.412288+0000","last_active":"2023-12-01T16:00:37.412288+0000","last_peered":"2023-12-01T16:00:37.412288+0000","last_clean":"2023-12-01T16:00:37.412288+0000","last_became_active":"2023-12-01T15:43:45.205554+0000","last_became_peered":"2023-12-01T15:43:45.205554+0000","last_unstale":"2023-12-01T16:00:37.412288+0000","last_undegraded":"2023-12-01T16:00:37.412288+0000","last_fullsized":"2023-12-01T16:00:37.412288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2354","last_scrub_stamp":"2023-12-01T16:00:37.412048+0000","last_deep_scrub":"44'2354","last_deep_scrub_stamp":"2023-12-01T16:00:37.412048+0000","last_clean_scrub_stamp":"2023-12-01T16:00:37.412048+0000","objects_scrubbed":2,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:03.150585+0000","scrub_duration":0.041570694999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2354,"num_write_kb":17078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'3598","reported_seq":2995,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:25.028288+0000","last_change":"2023-12-01T16:00:25.028416+0000","last_active":"2023-12-01T16:00:25.028288+0000","last_peered":"2023-12-01T16:00:25.028288+0000","last_clean":"2023-12-01T16:00:25.028288+0000","last_became_active":"2023-12-01T15:43:45.574319+0000","last_became_peered":"2023-12-01T15:43:45.574319+0000","last_unstale":"2023-12-01T16:00:25.028288+0000","last_undegraded":"2023-12-01T16:00:25.028288+0000","last_fullsized":"2023-12-01T16:00:25.028288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3598","last_scrub_stamp":"2023-12-01T16:00:25.028260+0000","last_deep_scrub":"44'3598","last_deep_scrub_stamp":"2023-12-01T16:00:25.028260+0000","last_clean_scrub_stamp":"2023-12-01T16:00:25.028260+0000","objects_scrubbed":1,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:09.811963+0000","scrub_duration":0.045226192999999998,"objects_trimmed":0,"snaptrim_duration":0.086977656,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'1540","reported_seq":1596,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:23.514875+0000","last_change":"2023-12-01T16:00:23.514875+0000","last_active":"2023-12-01T16:00:23.514875+0000","last_peered":"2023-12-01T16:00:23.514875+0000","last_clean":"2023-12-01T16:00:23.514875+0000","last_became_active":"2023-12-01T15:43:45.200132+0000","last_became_peered":"2023-12-01T15:43:45.200132+0000","last_unstale":"2023-12-01T16:00:23.514875+0000","last_undegraded":"2023-12-01T16:00:23.514875+0000","last_fullsized":"2023-12-01T16:00:23.514875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1540","last_scrub_stamp":"2023-12-01T16:00:23.514701+0000","last_deep_scrub":"44'1540","last_deep_scrub_stamp":"2023-12-01T16:00:23.514701+0000","last_clean_scrub_stamp":"2023-12-01T16:00:23.514701+0000","objects_scrubbed":2,"log_size":1540,"log_dups_size":0,"ondisk_log_size":1540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:08.871584+0000","scrub_duration":0.042235796999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1538,"num_write_kb":10132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":636698,"num_omap_keys":1268,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3475","reported_seq":2915,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:55.340040+0000","last_change":"2023-12-01T15:59:55.340335+0000","last_active":"2023-12-01T15:59:55.340040+0000","last_peered":"2023-12-01T15:59:55.340040+0000","last_clean":"2023-12-01T15:59:55.340040+0000","last_became_active":"2023-12-01T15:43:45.582890+0000","last_became_peered":"2023-12-01T15:43:45.582890+0000","last_unstale":"2023-12-01T15:59:55.340040+0000","last_undegraded":"2023-12-01T15:59:55.340040+0000","last_fullsized":"2023-12-01T15:59:55.340040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3475","last_scrub_stamp":"2023-12-01T15:59:55.339969+0000","last_deep_scrub":"43'3475","last_deep_scrub_stamp":"2023-12-01T15:59:55.339969+0000","last_clean_scrub_stamp":"2023-12-01T15:59:55.339969+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:16.716385+0000","scrub_duration":0.037072088000000003,"objects_trimmed":0,"snaptrim_duration":0.64740572200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"44'119","reported_seq":214,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:46.492848+0000","last_change":"2023-12-01T16:00:46.493093+0000","last_active":"2023-12-01T16:00:46.492848+0000","last_peered":"2023-12-01T16:00:46.492848+0000","last_clean":"2023-12-01T16:00:46.492848+0000","last_became_active":"2023-12-01T15:43:35.842478+0000","last_became_peered":"2023-12-01T15:43:35.842478+0000","last_unstale":"2023-12-01T16:00:46.492848+0000","last_undegraded":"2023-12-01T16:00:46.492848+0000","last_fullsized":"2023-12-01T16:00:46.492848+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2023-12-01T16:00:46.492795+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2023-12-01T16:00:46.492795+0000","last_clean_scrub_stamp":"2023-12-01T16:00:46.492795+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:29:41.238531+0000","scrub_duration":0.014373676,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:57.518675+0000","last_change":"2023-12-01T16:00:57.518984+0000","last_active":"2023-12-01T16:00:57.518675+0000","last_peered":"2023-12-01T16:00:57.518675+0000","last_clean":"2023-12-01T16:00:57.518675+0000","last_became_active":"2023-12-01T15:43:41.047606+0000","last_became_peered":"2023-12-01T15:43:41.047606+0000","last_unstale":"2023-12-01T16:00:57.518675+0000","last_undegraded":"2023-12-01T16:00:57.518675+0000","last_fullsized":"2023-12-01T16:00:57.518675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:57.518630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:57.518630+0000","last_clean_scrub_stamp":"2023-12-01T16:00:57.518630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:33:10.838909+0000","scrub_duration":0.0038586200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"44'4418","reported_seq":4474,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:22.563805+0000","last_change":"2023-12-01T16:00:22.563805+0000","last_active":"2023-12-01T16:00:22.563805+0000","last_peered":"2023-12-01T16:00:22.563805+0000","last_clean":"2023-12-01T16:00:22.563805+0000","last_became_active":"2023-12-01T15:43:45.201309+0000","last_became_peered":"2023-12-01T15:43:45.201309+0000","last_unstale":"2023-12-01T16:00:22.563805+0000","last_undegraded":"2023-12-01T16:00:22.563805+0000","last_fullsized":"2023-12-01T16:00:22.563805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4418","last_scrub_stamp":"2023-12-01T16:00:22.563645+0000","last_deep_scrub":"44'4418","last_deep_scrub_stamp":"2023-12-01T16:00:22.563645+0000","last_clean_scrub_stamp":"2023-12-01T16:00:22.563645+0000","objects_scrubbed":4,"log_size":4418,"log_dups_size":0,"ondisk_log_size":4418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.311958+0000","scrub_duration":0.064643555000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4406,"num_write_kb":30219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"44'3658","reported_seq":3083,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:06.538561+0000","last_change":"2023-12-01T16:01:06.538721+0000","last_active":"2023-12-01T16:01:06.538561+0000","last_peered":"2023-12-01T16:01:06.538561+0000","last_clean":"2023-12-01T16:01:06.538561+0000","last_became_active":"2023-12-01T15:43:45.590085+0000","last_became_peered":"2023-12-01T15:43:45.590085+0000","last_unstale":"2023-12-01T16:01:06.538561+0000","last_undegraded":"2023-12-01T16:01:06.538561+0000","last_fullsized":"2023-12-01T16:01:06.538561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3658","last_scrub_stamp":"2023-12-01T16:01:06.538534+0000","last_deep_scrub":"44'3658","last_deep_scrub_stamp":"2023-12-01T16:01:06.538534+0000","last_clean_scrub_stamp":"2023-12-01T16:01:06.538534+0000","objects_scrubbed":1,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:00:19.204125+0000","scrub_duration":0.041558115999999999,"objects_trimmed":0,"snaptrim_duration":0.144833777,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:49.486411+0000","last_change":"2023-12-01T16:00:49.486659+0000","last_active":"2023-12-01T16:00:49.486411+0000","last_peered":"2023-12-01T16:00:49.486411+0000","last_clean":"2023-12-01T16:00:49.486411+0000","last_became_active":"2023-12-01T15:43:41.046322+0000","last_became_peered":"2023-12-01T15:43:41.046322+0000","last_unstale":"2023-12-01T16:00:49.486411+0000","last_undegraded":"2023-12-01T16:00:49.486411+0000","last_fullsized":"2023-12-01T16:00:49.486411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:49.486368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:49.486368+0000","last_clean_scrub_stamp":"2023-12-01T16:00:49.486368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:51:08.809173+0000","scrub_duration":0.004290866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'2297","reported_seq":2553,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:33.875936+0000","last_change":"2023-12-01T16:00:33.876097+0000","last_active":"2023-12-01T16:00:33.875936+0000","last_peered":"2023-12-01T16:00:33.875936+0000","last_clean":"2023-12-01T16:00:33.875936+0000","last_became_active":"2023-12-01T15:43:45.208728+0000","last_became_peered":"2023-12-01T15:43:45.208728+0000","last_unstale":"2023-12-01T16:00:33.875936+0000","last_undegraded":"2023-12-01T16:00:33.875936+0000","last_fullsized":"2023-12-01T16:00:33.875936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2297","last_scrub_stamp":"2023-12-01T16:00:33.875902+0000","last_deep_scrub":"44'2297","last_deep_scrub_stamp":"2023-12-01T16:00:33.875902+0000","last_clean_scrub_stamp":"2023-12-01T16:00:33.875902+0000","objects_scrubbed":2,"log_size":2297,"log_dups_size":0,"ondisk_log_size":2297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:13.334507+0000","scrub_duration":0.034118038000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3359983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":3419,"num_write":2296,"num_write_kb":16044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'3373","reported_seq":2826,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:44.953011+0000","last_change":"2023-12-01T16:00:44.953011+0000","last_active":"2023-12-01T16:00:44.953011+0000","last_peered":"2023-12-01T16:00:44.953011+0000","last_clean":"2023-12-01T16:00:44.953011+0000","last_became_active":"2023-12-01T15:43:45.571262+0000","last_became_peered":"2023-12-01T15:43:45.571262+0000","last_unstale":"2023-12-01T16:00:44.953011+0000","last_undegraded":"2023-12-01T16:00:44.953011+0000","last_fullsized":"2023-12-01T16:00:44.953011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3373","last_scrub_stamp":"2023-12-01T16:00:44.952852+0000","last_deep_scrub":"44'3373","last_deep_scrub_stamp":"2023-12-01T16:00:44.952852+0000","last_clean_scrub_stamp":"2023-12-01T16:00:44.952852+0000","objects_scrubbed":3,"log_size":3373,"log_dups_size":0,"ondisk_log_size":3373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:08:12.302585+0000","scrub_duration":0.042758393999999998,"objects_trimmed":0,"snaptrim_duration":0.13848359499999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1137,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:08.498717+0000","last_change":"2023-12-01T16:00:08.498717+0000","last_active":"2023-12-01T16:00:08.498717+0000","last_peered":"2023-12-01T16:00:08.498717+0000","last_clean":"2023-12-01T16:00:08.498717+0000","last_became_active":"2023-12-01T15:43:41.043257+0000","last_became_peered":"2023-12-01T15:43:41.043257+0000","last_unstale":"2023-12-01T16:00:08.498717+0000","last_undegraded":"2023-12-01T16:00:08.498717+0000","last_fullsized":"2023-12-01T16:00:08.498717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:08.498410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:08.498410+0000","last_clean_scrub_stamp":"2023-12-01T16:00:08.498410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:18.582862+0000","scrub_duration":0.0065834630000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"44'2709","reported_seq":2765,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:14.574850+0000","last_change":"2023-12-01T16:00:14.574989+0000","last_active":"2023-12-01T16:00:14.574850+0000","last_peered":"2023-12-01T16:00:14.574850+0000","last_clean":"2023-12-01T16:00:14.574850+0000","last_became_active":"2023-12-01T15:43:45.203807+0000","last_became_peered":"2023-12-01T15:43:45.203807+0000","last_unstale":"2023-12-01T16:00:14.574850+0000","last_undegraded":"2023-12-01T16:00:14.574850+0000","last_fullsized":"2023-12-01T16:00:14.574850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2709","last_scrub_stamp":"2023-12-01T16:00:14.574824+0000","last_deep_scrub":"44'2709","last_deep_scrub_stamp":"2023-12-01T16:00:14.574824+0000","last_clean_scrub_stamp":"2023-12-01T16:00:14.574824+0000","objects_scrubbed":3,"log_size":2709,"log_dups_size":0,"ondisk_log_size":2709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:31:29.561401+0000","scrub_duration":0.059953542999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2697,"num_write_kb":25331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3393","reported_seq":2879,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.386477+0000","last_change":"2023-12-01T15:59:49.386477+0000","last_active":"2023-12-01T15:59:49.386477+0000","last_peered":"2023-12-01T15:59:49.386477+0000","last_clean":"2023-12-01T15:59:49.386477+0000","last_became_active":"2023-12-01T15:43:45.581690+0000","last_became_peered":"2023-12-01T15:43:45.581690+0000","last_unstale":"2023-12-01T15:59:49.386477+0000","last_undegraded":"2023-12-01T15:59:49.386477+0000","last_fullsized":"2023-12-01T15:59:49.386477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3393","last_scrub_stamp":"2023-12-01T15:59:49.386292+0000","last_deep_scrub":"44'3393","last_deep_scrub_stamp":"2023-12-01T15:59:49.386292+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.386292+0000","objects_scrubbed":3,"log_size":3393,"log_dups_size":0,"ondisk_log_size":3393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:21:35.191687+0000","scrub_duration":0.041281799000000001,"objects_trimmed":0,"snaptrim_duration":0.644502672,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1119,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:54.519721+0000","last_change":"2023-12-01T16:00:54.520383+0000","last_active":"2023-12-01T16:00:54.519721+0000","last_peered":"2023-12-01T16:00:54.519721+0000","last_clean":"2023-12-01T16:00:54.519721+0000","last_became_active":"2023-12-01T15:43:41.048738+0000","last_became_peered":"2023-12-01T15:43:41.048738+0000","last_unstale":"2023-12-01T16:00:54.519721+0000","last_undegraded":"2023-12-01T16:00:54.519721+0000","last_fullsized":"2023-12-01T16:00:54.519721+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:54.519676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:54.519676+0000","last_clean_scrub_stamp":"2023-12-01T16:00:54.519676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:13:55.687653+0000","scrub_duration":0.0054566220000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'3561","reported_seq":3617,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:09.058193+0000","last_change":"2023-12-01T16:00:09.058193+0000","last_active":"2023-12-01T16:00:09.058193+0000","last_peered":"2023-12-01T16:00:09.058193+0000","last_clean":"2023-12-01T16:00:09.058193+0000","last_became_active":"2023-12-01T15:43:45.207223+0000","last_became_peered":"2023-12-01T15:43:45.207223+0000","last_unstale":"2023-12-01T16:00:09.058193+0000","last_undegraded":"2023-12-01T16:00:09.058193+0000","last_fullsized":"2023-12-01T16:00:09.058193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3561","last_scrub_stamp":"2023-12-01T16:00:09.058006+0000","last_deep_scrub":"44'3561","last_deep_scrub_stamp":"2023-12-01T16:00:09.058006+0000","last_clean_scrub_stamp":"2023-12-01T16:00:09.058006+0000","objects_scrubbed":5,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:59:19.142458+0000","scrub_duration":0.071950684000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3556,"num_write_kb":20852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1320010,"num_omap_keys":2629,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3573","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:47.437607+0000","last_change":"2023-12-01T15:59:47.437607+0000","last_active":"2023-12-01T15:59:47.437607+0000","last_peered":"2023-12-01T15:59:47.437607+0000","last_clean":"2023-12-01T15:59:47.437607+0000","last_became_active":"2023-12-01T15:43:45.574271+0000","last_became_peered":"2023-12-01T15:43:45.574271+0000","last_unstale":"2023-12-01T15:59:47.437607+0000","last_undegraded":"2023-12-01T15:59:47.437607+0000","last_fullsized":"2023-12-01T15:59:47.437607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3573","last_scrub_stamp":"2023-12-01T15:59:47.437368+0000","last_deep_scrub":"44'3573","last_deep_scrub_stamp":"2023-12-01T15:59:47.437368+0000","last_clean_scrub_stamp":"2023-12-01T15:59:47.437368+0000","objects_scrubbed":1,"log_size":3573,"log_dups_size":0,"ondisk_log_size":3573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T18:45:47.573028+0000","scrub_duration":0.052350225,"objects_trimmed":0,"snaptrim_duration":0.65789627900000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'2832","reported_seq":2888,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:04.956811+0000","last_change":"2023-12-01T16:00:04.956811+0000","last_active":"2023-12-01T16:00:04.956811+0000","last_peered":"2023-12-01T16:00:04.956811+0000","last_clean":"2023-12-01T16:00:04.956811+0000","last_became_active":"2023-12-01T15:43:45.210343+0000","last_became_peered":"2023-12-01T15:43:45.210343+0000","last_unstale":"2023-12-01T16:00:04.956811+0000","last_undegraded":"2023-12-01T16:00:04.956811+0000","last_fullsized":"2023-12-01T16:00:04.956811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2832","last_scrub_stamp":"2023-12-01T16:00:04.956554+0000","last_deep_scrub":"44'2832","last_deep_scrub_stamp":"2023-12-01T16:00:04.956554+0000","last_clean_scrub_stamp":"2023-12-01T16:00:04.956554+0000","objects_scrubbed":2,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:37.950558+0000","scrub_duration":0.044932412999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2820,"num_write_kb":26865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":628812,"num_omap_keys":1252,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:05.464028+0000","last_change":"2023-12-01T16:00:05.464028+0000","last_active":"2023-12-01T16:00:05.464028+0000","last_peered":"2023-12-01T16:00:05.464028+0000","last_clean":"2023-12-01T16:00:05.464028+0000","last_became_active":"2023-12-01T15:43:41.043306+0000","last_became_peered":"2023-12-01T15:43:41.043306+0000","last_unstale":"2023-12-01T16:00:05.464028+0000","last_undegraded":"2023-12-01T16:00:05.464028+0000","last_fullsized":"2023-12-01T16:00:05.464028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:05.463736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:05.463736+0000","last_clean_scrub_stamp":"2023-12-01T16:00:05.463736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:26.653876+0000","scrub_duration":0.0051879350000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"44'3761","reported_seq":3211,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:48.423729+0000","last_change":"2023-12-01T15:59:48.423729+0000","last_active":"2023-12-01T15:59:48.423729+0000","last_peered":"2023-12-01T15:59:48.423729+0000","last_clean":"2023-12-01T15:59:48.423729+0000","last_became_active":"2023-12-01T15:43:45.581312+0000","last_became_peered":"2023-12-01T15:43:45.581312+0000","last_unstale":"2023-12-01T15:59:48.423729+0000","last_undegraded":"2023-12-01T15:59:48.423729+0000","last_fullsized":"2023-12-01T15:59:48.423729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3761","last_scrub_stamp":"2023-12-01T15:59:48.423554+0000","last_deep_scrub":"44'3761","last_deep_scrub_stamp":"2023-12-01T15:59:48.423554+0000","last_clean_scrub_stamp":"2023-12-01T15:59:48.423554+0000","objects_scrubbed":2,"log_size":3761,"log_dups_size":0,"ondisk_log_size":3761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:02.504062+0000","scrub_duration":0.041749799999999997,"objects_trimmed":0,"snaptrim_duration":0.64064258500000004,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"44'725","reported_seq":781,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:16.552415+0000","last_change":"2023-12-01T16:00:16.552415+0000","last_active":"2023-12-01T16:00:16.552415+0000","last_peered":"2023-12-01T16:00:16.552415+0000","last_clean":"2023-12-01T16:00:16.552415+0000","last_became_active":"2023-12-01T15:43:45.200083+0000","last_became_peered":"2023-12-01T15:43:45.200083+0000","last_unstale":"2023-12-01T16:00:16.552415+0000","last_undegraded":"2023-12-01T16:00:16.552415+0000","last_fullsized":"2023-12-01T16:00:16.552415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'725","last_scrub_stamp":"2023-12-01T16:00:16.552270+0000","last_deep_scrub":"44'725","last_deep_scrub_stamp":"2023-12-01T16:00:16.552270+0000","last_clean_scrub_stamp":"2023-12-01T16:00:16.552270+0000","objects_scrubbed":2,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:11.939451+0000","scrub_duration":0.030041060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":8308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:01.587163+0000","last_change":"2023-12-01T16:01:01.587552+0000","last_active":"2023-12-01T16:01:01.587163+0000","last_peered":"2023-12-01T16:01:01.587163+0000","last_clean":"2023-12-01T16:01:01.587163+0000","last_became_active":"2023-12-01T15:43:41.047566+0000","last_became_peered":"2023-12-01T15:43:41.047566+0000","last_unstale":"2023-12-01T16:01:01.587163+0000","last_undegraded":"2023-12-01T16:01:01.587163+0000","last_fullsized":"2023-12-01T16:01:01.587163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:01:01.587072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:01:01.587072+0000","last_clean_scrub_stamp":"2023-12-01T16:01:01.587072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:32.631555+0000","scrub_duration":0.0060124480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"44'3560","reported_seq":2976,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:11.777890+0000","last_change":"2023-12-01T16:00:11.777890+0000","last_active":"2023-12-01T16:00:11.777890+0000","last_peered":"2023-12-01T16:00:11.777890+0000","last_clean":"2023-12-01T16:00:11.777890+0000","last_became_active":"2023-12-01T15:43:45.575153+0000","last_became_peered":"2023-12-01T15:43:45.575153+0000","last_unstale":"2023-12-01T16:00:11.777890+0000","last_undegraded":"2023-12-01T16:00:11.777890+0000","last_fullsized":"2023-12-01T16:00:11.777890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3560","last_scrub_stamp":"2023-12-01T16:00:11.777713+0000","last_deep_scrub":"44'3560","last_deep_scrub_stamp":"2023-12-01T16:00:11.777713+0000","last_clean_scrub_stamp":"2023-12-01T16:00:11.777713+0000","objects_scrubbed":2,"log_size":3560,"log_dups_size":0,"ondisk_log_size":3560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:34:07.164893+0000","scrub_duration":0.046654314000000002,"objects_trimmed":0,"snaptrim_duration":0.13059393599999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1243,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'1640","reported_seq":1696,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:19.517728+0000","last_change":"2023-12-01T16:00:19.517728+0000","last_active":"2023-12-01T16:00:19.517728+0000","last_peered":"2023-12-01T16:00:19.517728+0000","last_clean":"2023-12-01T16:00:19.517728+0000","last_became_active":"2023-12-01T15:43:45.202912+0000","last_became_peered":"2023-12-01T15:43:45.202912+0000","last_unstale":"2023-12-01T16:00:19.517728+0000","last_undegraded":"2023-12-01T16:00:19.517728+0000","last_fullsized":"2023-12-01T16:00:19.517728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1640","last_scrub_stamp":"2023-12-01T16:00:19.517564+0000","last_deep_scrub":"44'1640","last_deep_scrub_stamp":"2023-12-01T16:00:19.517564+0000","last_clean_scrub_stamp":"2023-12-01T16:00:19.517564+0000","objects_scrubbed":3,"log_size":1640,"log_dups_size":0,"ondisk_log_size":1640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:42:53.178860+0000","scrub_duration":0.036244526999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1642,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:09.510854+0000","last_change":"2023-12-01T16:00:09.510854+0000","last_active":"2023-12-01T16:00:09.510854+0000","last_peered":"2023-12-01T16:00:09.510854+0000","last_clean":"2023-12-01T16:00:09.510854+0000","last_became_active":"2023-12-01T15:43:41.044095+0000","last_became_peered":"2023-12-01T15:43:41.044095+0000","last_unstale":"2023-12-01T16:00:09.510854+0000","last_undegraded":"2023-12-01T16:00:09.510854+0000","last_fullsized":"2023-12-01T16:00:09.510854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:09.510499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:09.510499+0000","last_clean_scrub_stamp":"2023-12-01T16:00:09.510499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:50:49.026098+0000","scrub_duration":0.005722286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'3700","reported_seq":3078,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.659888+0000","last_change":"2023-12-01T15:59:56.660009+0000","last_active":"2023-12-01T15:59:56.659888+0000","last_peered":"2023-12-01T15:59:56.659888+0000","last_clean":"2023-12-01T15:59:56.659888+0000","last_became_active":"2023-12-01T15:43:45.566157+0000","last_became_peered":"2023-12-01T15:43:45.566157+0000","last_unstale":"2023-12-01T15:59:56.659888+0000","last_undegraded":"2023-12-01T15:59:56.659888+0000","last_fullsized":"2023-12-01T15:59:56.659888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3700","last_scrub_stamp":"2023-12-01T15:59:56.659861+0000","last_deep_scrub":"44'3700","last_deep_scrub_stamp":"2023-12-01T15:59:56.659861+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.659861+0000","objects_scrubbed":4,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:46:17.850001+0000","scrub_duration":0.058770831000000003,"objects_trimmed":0,"snaptrim_duration":0.13319146700000001,"stat_sum":{"num_bytes":4118,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'2000","reported_seq":2056,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:18.918482+0000","last_change":"2023-12-01T16:00:18.918482+0000","last_active":"2023-12-01T16:00:18.918482+0000","last_peered":"2023-12-01T16:00:18.918482+0000","last_clean":"2023-12-01T16:00:18.918482+0000","last_became_active":"2023-12-01T15:43:45.204989+0000","last_became_peered":"2023-12-01T15:43:45.204989+0000","last_unstale":"2023-12-01T16:00:18.918482+0000","last_undegraded":"2023-12-01T16:00:18.918482+0000","last_fullsized":"2023-12-01T16:00:18.918482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2000","last_scrub_stamp":"2023-12-01T16:00:18.918306+0000","last_deep_scrub":"44'2000","last_deep_scrub_stamp":"2023-12-01T16:00:18.918306+0000","last_clean_scrub_stamp":"2023-12-01T16:00:18.918306+0000","objects_scrubbed":5,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:04.275189+0000","scrub_duration":0.15145572099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2265,"num_write_kb":16414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":702002,"num_omap_keys":1398,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:56.516851+0000","last_change":"2023-12-01T16:00:56.516851+0000","last_active":"2023-12-01T16:00:56.516851+0000","last_peered":"2023-12-01T16:00:56.516851+0000","last_clean":"2023-12-01T16:00:56.516851+0000","last_became_active":"2023-12-01T15:43:41.047468+0000","last_became_peered":"2023-12-01T15:43:41.047468+0000","last_unstale":"2023-12-01T16:00:56.516851+0000","last_undegraded":"2023-12-01T16:00:56.516851+0000","last_fullsized":"2023-12-01T16:00:56.516851+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T16:00:56.516545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T16:00:56.516545+0000","last_clean_scrub_stamp":"2023-12-01T16:00:56.516545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:25:42.487092+0000","scrub_duration":0.0054680370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"44'3410","reported_seq":2836,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:31.122991+0000","last_change":"2023-12-01T16:00:31.123172+0000","last_active":"2023-12-01T16:00:31.122991+0000","last_peered":"2023-12-01T16:00:31.122991+0000","last_clean":"2023-12-01T16:00:31.122991+0000","last_became_active":"2023-12-01T15:43:45.580767+0000","last_became_peered":"2023-12-01T15:43:45.580767+0000","last_unstale":"2023-12-01T16:00:31.122991+0000","last_undegraded":"2023-12-01T16:00:31.122991+0000","last_fullsized":"2023-12-01T16:00:31.122991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3410","last_scrub_stamp":"2023-12-01T16:00:31.122961+0000","last_deep_scrub":"44'3410","last_deep_scrub_stamp":"2023-12-01T16:00:31.122961+0000","last_clean_scrub_stamp":"2023-12-01T16:00:31.122961+0000","objects_scrubbed":5,"log_size":3410,"log_dups_size":0,"ondisk_log_size":3410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:47:20.447314+0000","scrub_duration":0.056985352000000003,"objects_trimmed":0,"snaptrim_duration":0.087179219000000002,"stat_sum":{"num_bytes":12302,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1220,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"44'3615","reported_seq":3033,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:49.027191+0000","last_change":"2023-12-01T15:59:49.027191+0000","last_active":"2023-12-01T15:59:49.027191+0000","last_peered":"2023-12-01T15:59:49.027191+0000","last_clean":"2023-12-01T15:59:49.027191+0000","last_became_active":"2023-12-01T15:43:45.573943+0000","last_became_peered":"2023-12-01T15:43:45.573943+0000","last_unstale":"2023-12-01T15:59:49.027191+0000","last_undegraded":"2023-12-01T15:59:49.027191+0000","last_fullsized":"2023-12-01T15:59:49.027191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3615","last_scrub_stamp":"2023-12-01T15:59:49.026983+0000","last_deep_scrub":"44'3615","last_deep_scrub_stamp":"2023-12-01T15:59:49.026983+0000","last_clean_scrub_stamp":"2023-12-01T15:59:49.026983+0000","objects_scrubbed":2,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:16:03.107490+0000","scrub_duration":0.046925306,"objects_trimmed":0,"snaptrim_duration":0.084182759999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'3719","reported_seq":3774,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:17.269725+0000","last_change":"2023-12-01T16:00:17.269901+0000","last_active":"2023-12-01T16:00:17.269725+0000","last_peered":"2023-12-01T16:00:17.269725+0000","last_clean":"2023-12-01T16:00:17.269725+0000","last_became_active":"2023-12-01T15:43:45.207695+0000","last_became_peered":"2023-12-01T15:43:45.207695+0000","last_unstale":"2023-12-01T16:00:17.269725+0000","last_undegraded":"2023-12-01T16:00:17.269725+0000","last_fullsized":"2023-12-01T16:00:17.269725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3719","last_scrub_stamp":"2023-12-01T16:00:17.269697+0000","last_deep_scrub":"44'3719","last_deep_scrub_stamp":"2023-12-01T16:00:17.269697+0000","last_clean_scrub_stamp":"2023-12-01T16:00:17.269697+0000","objects_scrubbed":7,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:19:02.626581+0000","scrub_duration":0.068143023999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3712,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":605,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"44'3513","reported_seq":2944,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:32.500021+0000","last_change":"2023-12-01T16:00:32.500141+0000","last_active":"2023-12-01T16:00:32.500021+0000","last_peered":"2023-12-01T16:00:32.500021+0000","last_clean":"2023-12-01T16:00:32.500021+0000","last_became_active":"2023-12-01T15:43:45.581173+0000","last_became_peered":"2023-12-01T15:43:45.581173+0000","last_unstale":"2023-12-01T16:00:32.500021+0000","last_undegraded":"2023-12-01T16:00:32.500021+0000","last_fullsized":"2023-12-01T16:00:32.500021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3513","last_scrub_stamp":"2023-12-01T16:00:32.499989+0000","last_deep_scrub":"44'3513","last_deep_scrub_stamp":"2023-12-01T16:00:32.499989+0000","last_clean_scrub_stamp":"2023-12-01T16:00:32.499989+0000","objects_scrubbed":5,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:47:21.824342+0000","scrub_duration":0.061740942,"objects_trimmed":0,"snaptrim_duration":0.63296622700000005,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"44'2462","reported_seq":2517,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:19.085189+0000","last_change":"2023-12-01T16:00:19.085189+0000","last_active":"2023-12-01T16:00:19.085189+0000","last_peered":"2023-12-01T16:00:19.085189+0000","last_clean":"2023-12-01T16:00:19.085189+0000","last_became_active":"2023-12-01T15:43:45.210286+0000","last_became_peered":"2023-12-01T15:43:45.210286+0000","last_unstale":"2023-12-01T16:00:19.085189+0000","last_undegraded":"2023-12-01T16:00:19.085189+0000","last_fullsized":"2023-12-01T16:00:19.085189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2462","last_scrub_stamp":"2023-12-01T16:00:19.085001+0000","last_deep_scrub":"44'2462","last_deep_scrub_stamp":"2023-12-01T16:00:19.085001+0000","last_clean_scrub_stamp":"2023-12-01T16:00:19.085001+0000","objects_scrubbed":5,"log_size":2462,"log_dups_size":0,"ondisk_log_size":2462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:40.706542+0000","scrub_duration":0.035617093000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2453,"num_write_kb":21278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"44'1341","reported_seq":1396,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:20.130338+0000","last_change":"2023-12-01T16:00:20.130338+0000","last_active":"2023-12-01T16:00:20.130338+0000","last_peered":"2023-12-01T16:00:20.130338+0000","last_clean":"2023-12-01T16:00:20.130338+0000","last_became_active":"2023-12-01T15:43:45.204031+0000","last_became_peered":"2023-12-01T15:43:45.204031+0000","last_unstale":"2023-12-01T16:00:20.130338+0000","last_undegraded":"2023-12-01T16:00:20.130338+0000","last_fullsized":"2023-12-01T16:00:20.130338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1341","last_scrub_stamp":"2023-12-01T16:00:20.129959+0000","last_deep_scrub":"44'1341","last_deep_scrub_stamp":"2023-12-01T16:00:20.129959+0000","last_clean_scrub_stamp":"2023-12-01T16:00:20.129959+0000","objects_scrubbed":2,"log_size":1341,"log_dups_size":0,"ondisk_log_size":1341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:42:53.791254+0000","scrub_duration":0.039957485000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1338,"num_write_kb":26066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'3641","reported_seq":3016,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:17.763808+0000","last_change":"2023-12-01T16:00:17.763921+0000","last_active":"2023-12-01T16:00:17.763808+0000","last_peered":"2023-12-01T16:00:17.763808+0000","last_clean":"2023-12-01T16:00:17.763808+0000","last_became_active":"2023-12-01T15:43:45.583644+0000","last_became_peered":"2023-12-01T15:43:45.583644+0000","last_unstale":"2023-12-01T16:00:17.763808+0000","last_undegraded":"2023-12-01T16:00:17.763808+0000","last_fullsized":"2023-12-01T16:00:17.763808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3641","last_scrub_stamp":"2023-12-01T16:00:17.763787+0000","last_deep_scrub":"43'3641","last_deep_scrub_stamp":"2023-12-01T16:00:17.763787+0000","last_clean_scrub_stamp":"2023-12-01T16:00:17.763787+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:59.512101+0000","scrub_duration":0.036564379000000001,"objects_trimmed":0,"snaptrim_duration":0.13235097200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"44'903","reported_seq":958,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:22.885656+0000","last_change":"2023-12-01T16:00:22.885656+0000","last_active":"2023-12-01T16:00:22.885656+0000","last_peered":"2023-12-01T16:00:22.885656+0000","last_clean":"2023-12-01T16:00:22.885656+0000","last_became_active":"2023-12-01T15:43:45.203067+0000","last_became_peered":"2023-12-01T15:43:45.203067+0000","last_unstale":"2023-12-01T16:00:22.885656+0000","last_undegraded":"2023-12-01T16:00:22.885656+0000","last_fullsized":"2023-12-01T16:00:22.885656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'903","last_scrub_stamp":"2023-12-01T16:00:22.885328+0000","last_deep_scrub":"44'903","last_deep_scrub_stamp":"2023-12-01T16:00:22.885328+0000","last_clean_scrub_stamp":"2023-12-01T16:00:22.885328+0000","objects_scrubbed":3,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:25:47.742131+0000","scrub_duration":0.050233486000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3459","reported_seq":2882,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:50.437138+0000","last_change":"2023-12-01T15:59:50.437138+0000","last_active":"2023-12-01T15:59:50.437138+0000","last_peered":"2023-12-01T15:59:50.437138+0000","last_clean":"2023-12-01T15:59:50.437138+0000","last_became_active":"2023-12-01T15:43:45.572660+0000","last_became_peered":"2023-12-01T15:43:45.572660+0000","last_unstale":"2023-12-01T15:59:50.437138+0000","last_undegraded":"2023-12-01T15:59:50.437138+0000","last_fullsized":"2023-12-01T15:59:50.437138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3459","last_scrub_stamp":"2023-12-01T15:59:50.436956+0000","last_deep_scrub":"44'3459","last_deep_scrub_stamp":"2023-12-01T15:59:50.436956+0000","last_clean_scrub_stamp":"2023-12-01T15:59:50.436956+0000","objects_scrubbed":1,"log_size":3459,"log_dups_size":0,"ondisk_log_size":3459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:48:17.314373+0000","scrub_duration":0.047609585000000003,"objects_trimmed":0,"snaptrim_duration":0.59367497300000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1187,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"44'3415","reported_seq":2923,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:01:13.617222+0000","last_change":"2023-12-01T16:01:13.617390+0000","last_active":"2023-12-01T16:01:13.617222+0000","last_peered":"2023-12-01T16:01:13.617222+0000","last_clean":"2023-12-01T16:01:13.617222+0000","last_became_active":"2023-12-01T15:43:45.587603+0000","last_became_peered":"2023-12-01T15:43:45.587603+0000","last_unstale":"2023-12-01T16:01:13.617222+0000","last_undegraded":"2023-12-01T16:01:13.617222+0000","last_fullsized":"2023-12-01T16:01:13.617222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3415","last_scrub_stamp":"2023-12-01T16:01:13.617191+0000","last_deep_scrub":"44'3415","last_deep_scrub_stamp":"2023-12-01T16:01:13.617191+0000","last_clean_scrub_stamp":"2023-12-01T16:01:13.617191+0000","objects_scrubbed":2,"log_size":3415,"log_dups_size":0,"ondisk_log_size":3415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T19:21:45.020656+0000","scrub_duration":0.039258633000000001,"objects_trimmed":0,"snaptrim_duration":0.17121966999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4978","reported_seq":5033,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.423763+0000","last_change":"2023-12-01T15:59:54.423763+0000","last_active":"2023-12-01T15:59:54.423763+0000","last_peered":"2023-12-01T15:59:54.423763+0000","last_clean":"2023-12-01T15:59:54.423763+0000","last_became_active":"2023-12-01T15:43:45.204425+0000","last_became_peered":"2023-12-01T15:43:45.204425+0000","last_unstale":"2023-12-01T15:59:54.423763+0000","last_undegraded":"2023-12-01T15:59:54.423763+0000","last_fullsized":"2023-12-01T15:59:54.423763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4978","last_scrub_stamp":"2023-12-01T15:59:54.423526+0000","last_deep_scrub":"44'4978","last_deep_scrub_stamp":"2023-12-01T15:59:54.423526+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.423526+0000","objects_scrubbed":5,"log_size":4978,"log_dups_size":0,"ondisk_log_size":4978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:49:35.988154+0000","scrub_duration":0.094740874000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4962,"num_write_kb":39191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":670128,"num_omap_keys":1336,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'3228","reported_seq":2710,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:12.801031+0000","last_change":"2023-12-01T16:00:12.801404+0000","last_active":"2023-12-01T16:00:12.801031+0000","last_peered":"2023-12-01T16:00:12.801031+0000","last_clean":"2023-12-01T16:00:12.801031+0000","last_became_active":"2023-12-01T15:43:45.574044+0000","last_became_peered":"2023-12-01T15:43:45.574044+0000","last_unstale":"2023-12-01T16:00:12.801031+0000","last_undegraded":"2023-12-01T16:00:12.801031+0000","last_fullsized":"2023-12-01T16:00:12.801031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3228","last_scrub_stamp":"2023-12-01T16:00:12.800966+0000","last_deep_scrub":"44'3228","last_deep_scrub_stamp":"2023-12-01T16:00:12.800966+0000","last_clean_scrub_stamp":"2023-12-01T16:00:12.800966+0000","objects_scrubbed":2,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T20:57:34.422506+0000","scrub_duration":0.046375222000000001,"objects_trimmed":0,"snaptrim_duration":0.13751970099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'493","reported_seq":548,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:56.331348+0000","last_change":"2023-12-01T15:59:56.331348+0000","last_active":"2023-12-01T15:59:56.331348+0000","last_peered":"2023-12-01T15:59:56.331348+0000","last_clean":"2023-12-01T15:59:56.331348+0000","last_became_active":"2023-12-01T15:43:45.200070+0000","last_became_peered":"2023-12-01T15:43:45.200070+0000","last_unstale":"2023-12-01T15:59:56.331348+0000","last_undegraded":"2023-12-01T15:59:56.331348+0000","last_fullsized":"2023-12-01T15:59:56.331348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'493","last_scrub_stamp":"2023-12-01T15:59:56.331006+0000","last_deep_scrub":"44'493","last_deep_scrub_stamp":"2023-12-01T15:59:56.331006+0000","last_clean_scrub_stamp":"2023-12-01T15:59:56.331006+0000","objects_scrubbed":3,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:06:39.368433+0000","scrub_duration":0.040743746999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":17875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'3423","reported_seq":2875,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:47.535337+0000","last_change":"2023-12-01T15:59:47.535337+0000","last_active":"2023-12-01T15:59:47.535337+0000","last_peered":"2023-12-01T15:59:47.535337+0000","last_clean":"2023-12-01T15:59:47.535337+0000","last_became_active":"2023-12-01T15:43:45.570016+0000","last_became_peered":"2023-12-01T15:43:45.570016+0000","last_unstale":"2023-12-01T15:59:47.535337+0000","last_undegraded":"2023-12-01T15:59:47.535337+0000","last_fullsized":"2023-12-01T15:59:47.535337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3423","last_scrub_stamp":"2023-12-01T15:59:47.535105+0000","last_deep_scrub":"44'3423","last_deep_scrub_stamp":"2023-12-01T15:59:47.535105+0000","last_clean_scrub_stamp":"2023-12-01T15:59:47.535105+0000","objects_scrubbed":2,"log_size":3423,"log_dups_size":0,"ondisk_log_size":3423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:08.911521+0000","scrub_duration":0.045260416999999997,"objects_trimmed":0,"snaptrim_duration":0.134588554,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"44'3618","reported_seq":3673,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:59.010802+0000","last_change":"2023-12-01T15:59:59.010802+0000","last_active":"2023-12-01T15:59:59.010802+0000","last_peered":"2023-12-01T15:59:59.010802+0000","last_clean":"2023-12-01T15:59:59.010802+0000","last_became_active":"2023-12-01T15:43:45.200276+0000","last_became_peered":"2023-12-01T15:43:45.200276+0000","last_unstale":"2023-12-01T15:59:59.010802+0000","last_undegraded":"2023-12-01T15:59:59.010802+0000","last_fullsized":"2023-12-01T15:59:59.010802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3618","last_scrub_stamp":"2023-12-01T15:59:59.010494+0000","last_deep_scrub":"44'3618","last_deep_scrub_stamp":"2023-12-01T15:59:59.010494+0000","last_clean_scrub_stamp":"2023-12-01T15:59:59.010494+0000","objects_scrubbed":2,"log_size":3618,"log_dups_size":0,"ondisk_log_size":3618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:38:32.241596+0000","scrub_duration":0.048349939000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3601,"num_write_kb":33849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"43'3891","reported_seq":3229,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:29.521372+0000","last_change":"2023-12-01T16:00:29.521372+0000","last_active":"2023-12-01T16:00:29.521372+0000","last_peered":"2023-12-01T16:00:29.521372+0000","last_clean":"2023-12-01T16:00:29.521372+0000","last_became_active":"2023-12-01T15:43:45.574535+0000","last_became_peered":"2023-12-01T15:43:45.574535+0000","last_unstale":"2023-12-01T16:00:29.521372+0000","last_undegraded":"2023-12-01T16:00:29.521372+0000","last_fullsized":"2023-12-01T16:00:29.521372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3891","last_scrub_stamp":"2023-12-01T16:00:29.521240+0000","last_deep_scrub":"43'3891","last_deep_scrub_stamp":"2023-12-01T16:00:29.521240+0000","last_clean_scrub_stamp":"2023-12-01T16:00:29.521240+0000","objects_scrubbed":0,"log_size":3891,"log_dups_size":0,"ondisk_log_size":3891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:02:00.228252+0000","scrub_duration":0.039399423000000003,"objects_trimmed":0,"snaptrim_duration":0.65050901000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"44'2100","reported_seq":2155,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:21.858509+0000","last_change":"2023-12-01T16:00:21.858509+0000","last_active":"2023-12-01T16:00:21.858509+0000","last_peered":"2023-12-01T16:00:21.858509+0000","last_clean":"2023-12-01T16:00:21.858509+0000","last_became_active":"2023-12-01T15:43:45.208579+0000","last_became_peered":"2023-12-01T15:43:45.208579+0000","last_unstale":"2023-12-01T16:00:21.858509+0000","last_undegraded":"2023-12-01T16:00:21.858509+0000","last_fullsized":"2023-12-01T16:00:21.858509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2100","last_scrub_stamp":"2023-12-01T16:00:21.858173+0000","last_deep_scrub":"44'2100","last_deep_scrub_stamp":"2023-12-01T16:00:21.858173+0000","last_clean_scrub_stamp":"2023-12-01T16:00:21.858173+0000","objects_scrubbed":2,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T17:15:06.641876+0000","scrub_duration":0.043601572999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2089,"num_write_kb":16989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"44'3666","reported_seq":3089,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:21.095073+0000","last_change":"2023-12-01T16:00:21.095073+0000","last_active":"2023-12-01T16:00:21.095073+0000","last_peered":"2023-12-01T16:00:21.095073+0000","last_clean":"2023-12-01T16:00:21.095073+0000","last_became_active":"2023-12-01T15:43:45.577574+0000","last_became_peered":"2023-12-01T15:43:45.577574+0000","last_unstale":"2023-12-01T16:00:21.095073+0000","last_undegraded":"2023-12-01T16:00:21.095073+0000","last_fullsized":"2023-12-01T16:00:21.095073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3666","last_scrub_stamp":"2023-12-01T16:00:21.094921+0000","last_deep_scrub":"44'3666","last_deep_scrub_stamp":"2023-12-01T16:00:21.094921+0000","last_clean_scrub_stamp":"2023-12-01T16:00:21.094921+0000","objects_scrubbed":1,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:41:15.386618+0000","scrub_duration":0.048431008999999997,"objects_trimmed":0,"snaptrim_duration":0.084960400000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1169,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'641","reported_seq":696,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:10.011337+0000","last_change":"2023-12-01T16:00:10.011337+0000","last_active":"2023-12-01T16:00:10.011337+0000","last_peered":"2023-12-01T16:00:10.011337+0000","last_clean":"2023-12-01T16:00:10.011337+0000","last_became_active":"2023-12-01T15:43:45.203190+0000","last_became_peered":"2023-12-01T15:43:45.203190+0000","last_unstale":"2023-12-01T16:00:10.011337+0000","last_undegraded":"2023-12-01T16:00:10.011337+0000","last_fullsized":"2023-12-01T16:00:10.011337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'641","last_scrub_stamp":"2023-12-01T16:00:10.011185+0000","last_deep_scrub":"44'641","last_deep_scrub_stamp":"2023-12-01T16:00:10.011185+0000","last_clean_scrub_stamp":"2023-12-01T16:00:10.011185+0000","objects_scrubbed":2,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:50:49.526785+0000","scrub_duration":0.024782471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1891144,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":643,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"43'3570","reported_seq":2978,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:51.023871+0000","last_change":"2023-12-01T15:59:51.023871+0000","last_active":"2023-12-01T15:59:51.023871+0000","last_peered":"2023-12-01T15:59:51.023871+0000","last_clean":"2023-12-01T15:59:51.023871+0000","last_became_active":"2023-12-01T15:43:45.572781+0000","last_became_peered":"2023-12-01T15:43:45.572781+0000","last_unstale":"2023-12-01T15:59:51.023871+0000","last_undegraded":"2023-12-01T15:59:51.023871+0000","last_fullsized":"2023-12-01T15:59:51.023871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3570","last_scrub_stamp":"2023-12-01T15:59:51.023745+0000","last_deep_scrub":"43'3570","last_deep_scrub_stamp":"2023-12-01T15:59:51.023745+0000","last_clean_scrub_stamp":"2023-12-01T15:59:51.023745+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T21:48:17.901162+0000","scrub_duration":0.041221723000000002,"objects_trimmed":0,"snaptrim_duration":0.094045403999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'5943","reported_seq":5998,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:58.274287+0000","last_change":"2023-12-01T15:59:58.274287+0000","last_active":"2023-12-01T15:59:58.274287+0000","last_peered":"2023-12-01T15:59:58.274287+0000","last_clean":"2023-12-01T15:59:58.274287+0000","last_became_active":"2023-12-01T15:43:45.207696+0000","last_became_peered":"2023-12-01T15:43:45.207696+0000","last_unstale":"2023-12-01T15:59:58.274287+0000","last_undegraded":"2023-12-01T15:59:58.274287+0000","last_fullsized":"2023-12-01T15:59:58.274287+0000","mapping_epoch":16,"log_start":"21'300","ondisk_log_start":"21'300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'5943","last_scrub_stamp":"2023-12-01T15:59:58.274135+0000","last_deep_scrub":"44'5943","last_deep_scrub_stamp":"2023-12-01T15:59:58.274135+0000","last_clean_scrub_stamp":"2023-12-01T15:59:58.274135+0000","objects_scrubbed":7,"log_size":5643,"log_dups_size":0,"ondisk_log_size":5643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:27:01.882725+0000","scrub_duration":0.087623041999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5940,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1000,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3526","reported_seq":3001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.595288+0000","last_change":"2023-12-01T15:59:54.595288+0000","last_active":"2023-12-01T15:59:54.595288+0000","last_peered":"2023-12-01T15:59:54.595288+0000","last_clean":"2023-12-01T15:59:54.595288+0000","last_became_active":"2023-12-01T15:43:45.571223+0000","last_became_peered":"2023-12-01T15:43:45.571223+0000","last_unstale":"2023-12-01T15:59:54.595288+0000","last_undegraded":"2023-12-01T15:59:54.595288+0000","last_fullsized":"2023-12-01T15:59:54.595288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3526","last_scrub_stamp":"2023-12-01T15:59:54.595164+0000","last_deep_scrub":"44'3526","last_deep_scrub_stamp":"2023-12-01T15:59:54.595164+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.595164+0000","objects_scrubbed":1,"log_size":3526,"log_dups_size":0,"ondisk_log_size":3526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T16:35:27.589168+0000","scrub_duration":0.038520889000000003,"objects_trimmed":0,"snaptrim_duration":0.134288985,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"44'3430","reported_seq":3486,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:38.898618+0000","last_change":"2023-12-01T16:00:38.898867+0000","last_active":"2023-12-01T16:00:38.898618+0000","last_peered":"2023-12-01T16:00:38.898618+0000","last_clean":"2023-12-01T16:00:38.898618+0000","last_became_active":"2023-12-01T15:43:45.207956+0000","last_became_peered":"2023-12-01T15:43:45.207956+0000","last_unstale":"2023-12-01T16:00:38.898618+0000","last_undegraded":"2023-12-01T16:00:38.898618+0000","last_fullsized":"2023-12-01T16:00:38.898618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3430","last_scrub_stamp":"2023-12-01T16:00:38.898571+0000","last_deep_scrub":"44'3430","last_deep_scrub_stamp":"2023-12-01T16:00:38.898571+0000","last_clean_scrub_stamp":"2023-12-01T16:00:38.898571+0000","objects_scrubbed":4,"log_size":3430,"log_dups_size":0,"ondisk_log_size":3430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:52:04.637107+0000","scrub_duration":0.066174637999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3411,"num_write_kb":30086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4050","reported_seq":3343,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T15:59:54.042427+0000","last_change":"2023-12-01T15:59:54.042427+0000","last_active":"2023-12-01T15:59:54.042427+0000","last_peered":"2023-12-01T15:59:54.042427+0000","last_clean":"2023-12-01T15:59:54.042427+0000","last_became_active":"2023-12-01T15:43:45.574868+0000","last_became_peered":"2023-12-01T15:43:45.574868+0000","last_unstale":"2023-12-01T15:59:54.042427+0000","last_undegraded":"2023-12-01T15:59:54.042427+0000","last_fullsized":"2023-12-01T15:59:54.042427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4050","last_scrub_stamp":"2023-12-01T15:59:54.042107+0000","last_deep_scrub":"44'4050","last_deep_scrub_stamp":"2023-12-01T15:59:54.042107+0000","last_clean_scrub_stamp":"2023-12-01T15:59:54.042107+0000","objects_scrubbed":3,"log_size":4050,"log_dups_size":0,"ondisk_log_size":4050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T22:49:35.606734+0000","scrub_duration":0.048885451000000003,"objects_trimmed":0,"snaptrim_duration":0.091841191000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"44'1806","reported_seq":1862,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-01T16:00:39.925300+0000","last_change":"2023-12-01T16:00:39.925536+0000","last_active":"2023-12-01T16:00:39.925300+0000","last_peered":"2023-12-01T16:00:39.925300+0000","last_clean":"2023-12-01T16:00:39.925300+0000","last_became_active":"2023-12-01T15:43:45.203082+0000","last_became_peered":"2023-12-01T15:43:45.203082+0000","last_unstale":"2023-12-01T16:00:39.925300+0000","last_undegraded":"2023-12-01T16:00:39.925300+0000","last_fullsized":"2023-12-01T16:00:39.925300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1806","last_scrub_stamp":"2023-12-01T16:00:39.925228+0000","last_deep_scrub":"44'1806","last_deep_scrub_stamp":"2023-12-01T16:00:39.925228+0000","last_clean_scrub_stamp":"2023-12-01T16:00:39.925228+0000","objects_scrubbed":3,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:32:45.152512+0000","scrub_duration":0.050226169000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1812,"num_write_kb":15324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26782,"num_omap_keys":50,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":76140,"num_write_kb":40588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225629,"ondisk_log_size":225629,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":277882502,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":223,"num_read_kb":3419,"num_write":76837,"num_write_kb":641165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5327133,"num_omap_keys":10604,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":555827200,"data_stored":555765004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76463,"ondisk_log_size":76463,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705882,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":666384,"kb_used_data":134088,"kb_used_omap":0,"kb_used_meta":532288,"kb_avail":93705456,"statfs":{"total":96636764160,"available":95954386944,"internally_reserved":0,"allocated":137306112,"data_stored":136947550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":545062912},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 16:01:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.81499999999999995,"15min":0.66300000000000003},"min":{"1min":0.51900000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.878,"5min":10.84,"15min":10.84},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.96599999999999997,"15min":0.72999999999999998},"min":{"1min":0.58199999999999996,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83099999999999996,"5min":11.926,"15min":11.926},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Dec 1 16:01:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83999999999999997,"15min":0.69199999999999995},"min":{"1min":0.56499999999999995,"5min":0.246,"15min":0.246},"max":{"1min":0.91900000000000004,"5min":10.807,"15min":10.807},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.61299999999999999,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.81200000000000006,"5min":3.552,"15min":3.552},"last":0.623}]},{"osd":2,"last update":"Fri Dec 1 16:01:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.79200000000000004,"15min":0.65100000000000002},"min":{"1min":0.501,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.81699999999999995,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.751,"15min":0.66500000000000004},"min":{"1min":0.48599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.90900000000000003,"5min":10.715999999999999,"15min":10.715999999999999},"last":0.67500000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705883,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":805988,"kb_used_data":157276,"kb_used_omap":0,"kb_used_meta":648704,"kb_avail":93565852,"statfs":{"total":96636764160,"available":95811432448,"internally_reserved":0,"allocated":161050624,"data_stored":160683934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":664272896},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 16:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71799999999999997,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.88300000000000001,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.626,"15min":0.65200000000000002},"min":{"1min":0.58899999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83699999999999997,"5min":0.91200000000000003,"15min":2.657},"last":0.68700000000000006}]},{"osd":1,"last update":"Fri Dec 1 16:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.66000000000000003},"min":{"1min":0.56799999999999995,"5min":0.248,"15min":0.248},"max":{"1min":0.91300000000000003,"5min":8.0779999999999994,"15min":8.0779999999999994},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.629,"15min":0.624},"min":{"1min":0.59399999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.84899999999999998,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.622}]},{"osd":3,"last update":"Fri Dec 1 16:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.54200000000000004,"15min":0.56200000000000006},"min":{"1min":0.47299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.83099999999999996,"5min":2.048,"15min":7.5289999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70799999999999996,"15min":0.66900000000000004},"min":{"1min":0.499,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.93100000000000005,"5min":8.0370000000000008,"15min":9.8949999999999996},"last":0.51100000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705882,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589244,"kb_used_data":98868,"kb_used_omap":0,"kb_used_meta":490368,"kb_avail":93782596,"statfs":{"total":96636764160,"available":96033378304,"internally_reserved":0,"allocated":101240832,"data_stored":100906009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502136832},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45700000000000002,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.17399999999999999,"15min":0.17299999999999999},"max":{"1min":0.69099999999999995,"5min":0.749,"15min":8.4589999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51500000000000001,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":0.629,"5min":1.669,"15min":1.7729999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66600000000000004,"15min":0.63900000000000001},"min":{"1min":0.55000000000000004,"5min":0.249,"15min":0.249},"max":{"1min":0.999,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.63600000000000001,"15min":0.63500000000000001},"min":{"1min":0.51300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.83999999999999997,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.64300000000000002,"15min":0.66100000000000003},"min":{"1min":0.58599999999999997,"5min":0.28100000000000003,"15min":0.251},"max":{"1min":0.82999999999999996,"5min":1.641,"15min":1.641},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72199999999999998,"15min":0.70199999999999996},"min":{"1min":0.68300000000000005,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.95599999999999996,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.75}]}]},{"osd":0,"up_from":9,"seq":38654705882,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814568,"kb_used_data":156000,"kb_used_omap":0,"kb_used_meta":658560,"kb_avail":93557272,"statfs":{"total":96636764160,"available":95802646528,"internally_reserved":0,"allocated":159744000,"data_stored":159387283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":674365440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.42599999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.85499999999999998,"5min":1.595,"15min":1.595},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54100000000000004,"15min":0.624},"min":{"1min":0.499,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":0.621,"5min":3.3639999999999999,"15min":30.995000000000001},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.72799999999999998},"min":{"1min":0.61099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.0029999999999999,"5min":1.5069999999999999,"15min":24.504000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.67400000000000004,"15min":0.75900000000000001},"min":{"1min":0.66100000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.96799999999999997,"5min":1.526,"15min":24.524999999999999},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Dec 1 16:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.65100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82799999999999996,"5min":10.250999999999999,"15min":31.038},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.72999999999999998},"min":{"1min":0.63300000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.92900000000000005,"5min":10.209,"15min":10.209},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":158564352,"data_stored":158550118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":160464896,"data_stored":160441193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":136134656,"data_stored":136110397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T16:01:28.341 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-01T16:01:28.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbdac840700 1 Processor -- start 2023-12-01T16:01:28.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbdac840700 1 -- start start 2023-12-01T16:01:28.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbdac840700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbda8141760 0x7fbda8143b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbdac840700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda8137fa0 con 0x7fbda8137b90 2023-12-01T16:01:28.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbdac840700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda80ab9c0 con 0x7fbda81377b0 2023-12-01T16:01:28.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbdac840700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda813b200 con 0x7fbda8141760 2023-12-01T16:01:28.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbd9effd700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbda8137b90 0x7fbda813aaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48370/0 (socket says 172.21.15.63:48370) 2023-12-01T16:01:28.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbd9effd700 1 -- 172.21.15.63:0/2557759993 learned_addr learned my addr 172.21.15.63:0/2557759993 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T16:01:28.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbda7fff700 1 --2- 172.21.15.63:0/2557759993 >> v2:172.21.15.63:3300/0 conn(0x7fbda8141760 0x7fbda8143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbda6ffd700 1 -- 172.21.15.63:0/2557759993 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342961411 0 0) 0x7fbd90001110 con 0x7fbda8137b90 2023-12-01T16:01:28.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbda6ffd700 1 -- 172.21.15.63:0/2557759993 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd940035d0 con 0x7fbda8137b90 2023-12-01T16:01:28.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbda7fff700 1 -- 172.21.15.63:0/2557759993 >> v1:172.21.15.66:6789/0 conn(0x7fbda81377b0 legacy=0x7fbda813a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbda7fff700 1 -- 172.21.15.63:0/2557759993 >> v1:172.21.15.63:6789/0 conn(0x7fbda8137b90 legacy=0x7fbda813aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.447+0000 7fbda7fff700 1 -- 172.21.15.63:0/2557759993 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80aafc0 con 0x7fbda8141760 2023-12-01T16:01:28.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.451+0000 7fbda7fff700 1 --2- 172.21.15.63:0/2557759993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbda8141760 0x7fbda8143b50 secure :-1 s=READY pgs=2968 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009d90 tx=0x7fbda000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f027475784e02e44 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:28.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.451+0000 7fbda6ffd700 1 -- 172.21.15.63:0/2557759993 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda000e070 con 0x7fbda8141760 2023-12-01T16:01:28.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.451+0000 7fbda6ffd700 1 -- 172.21.15.63:0/2557759993 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda000bb20 con 0x7fbda8141760 2023-12-01T16:01:28.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.451+0000 7fbda6ffd700 1 -- 172.21.15.63:0/2557759993 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0012430 con 0x7fbda8141760 2023-12-01T16:01:28.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.451+0000 7fbdac840700 1 -- 172.21.15.63:0/2557759993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbda8141760 msgr2=0x7fbda8143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.451+0000 7fbdac840700 1 --2- 172.21.15.63:0/2557759993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbda8141760 0x7fbda8143b50 secure :-1 s=READY pgs=2968 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009d90 tx=0x7fbda000b330 comp rx=0 tx=0).stop 2023-12-01T16:01:28.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.451+0000 7fbdac840700 1 -- 172.21.15.63:0/2557759993 shutdown_connections 2023-12-01T16:01:28.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.451+0000 7fbdac840700 1 --2- 172.21.15.63:0/2557759993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbda8141760 0x7fbda8143b50 unknown :-1 s=CLOSED pgs=2968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.451+0000 7fbdac840700 1 -- 172.21.15.63:0/2557759993 >> 172.21.15.63:0/2557759993 conn(0x7fbda8073710 msgr2=0x7fbda80ac9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:28.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.451+0000 7fbdac840700 1 -- 172.21.15.63:0/2557759993 shutdown_connections 2023-12-01T16:01:28.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.451+0000 7fbdac840700 1 -- 172.21.15.63:0/2557759993 wait complete. 2023-12-01T16:01:28.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbdac840700 1 Processor -- start 2023-12-01T16:01:28.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbdac840700 1 -- start start 2023-12-01T16:01:28.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbdac840700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbda81377b0 0x7fbda812f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbdac840700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda8137b90 0x7fbda812f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbdac840700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbda8141760 0x7fbda812fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbdac840700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda813d330 con 0x7fbda81377b0 2023-12-01T16:01:28.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbdac840700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8136600 con 0x7fbda8137b90 2023-12-01T16:01:28.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbdac840700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda813e0a0 con 0x7fbda8141760 2023-12-01T16:01:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbda81377b0 0x7fbda812f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbda81377b0 0x7fbda812f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45282/0 (socket says 172.21.15.63:45282) 2023-12-01T16:01:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda77fe700 1 -- 172.21.15.63:0/160414887 learned_addr learned my addr 172.21.15.63:0/160414887 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:01:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbd9effd700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda8137b90 0x7fbda812f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda7fff700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbda8141760 0x7fbda812fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda77fe700 1 -- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbda8141760 msgr2=0x7fbda812fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda77fe700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbda8141760 0x7fbda812fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda77fe700 1 -- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda8137b90 msgr2=0x7fbda812f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda77fe700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda8137b90 0x7fbda812f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda77fe700 1 -- 172.21.15.63:0/160414887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda0009a70 con 0x7fbda81377b0 2023-12-01T16:01:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbd9effd700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda8137b90 0x7fbda812f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T16:01:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda77fe700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbda81377b0 0x7fbda812f0b0 secure :-1 s=READY pgs=2969 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800c530 tx=0x7fbd9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda4ff9700 1 -- 172.21.15.63:0/160414887 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd980052d0 con 0x7fbda81377b0 2023-12-01T16:01:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda4ff9700 1 -- 172.21.15.63:0/160414887 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd98005430 con 0x7fbda81377b0 2023-12-01T16:01:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbdac840700 1 -- 172.21.15.63:0/160414887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda8136440 con 0x7fbda81377b0 2023-12-01T16:01:28.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbda4ff9700 1 -- 172.21.15.63:0/160414887 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd980055a0 con 0x7fbda81377b0 2023-12-01T16:01:28.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbdac840700 1 -- 172.21.15.63:0/160414887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda813e2f0 con 0x7fbda81377b0 2023-12-01T16:01:28.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.455+0000 7fbdac840700 1 -- 172.21.15.63:0/160414887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda8065fb0 con 0x7fbda81377b0 2023-12-01T16:01:28.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.459+0000 7fbda4ff9700 1 -- 172.21.15.63:0/160414887 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd980038e0 con 0x7fbda81377b0 2023-12-01T16:01:28.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.459+0000 7fbda4ff9700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbd88065ad0 0x7fbd88067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.459+0000 7fbda4ff9700 1 -- 172.21.15.63:0/160414887 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7fbd98081e70 con 0x7fbda81377b0 2023-12-01T16:01:28.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.459+0000 7fbd9effd700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbd88065ad0 0x7fbd88067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.459+0000 7fbd9effd700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbd88065ad0 0x7fbd88067f90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbda8138320 tx=0x7fbd90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:28.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.463+0000 7fbda4ff9700 1 -- 172.21.15.63:0/160414887 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fbd9804fde0 con 0x7fbda81377b0 2023-12-01T16:01:28.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.627+0000 7fbdac840700 1 -- 172.21.15.63:0/160414887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fbda8136440 con 0x7fbda81377b0 2023-12-01T16:01:28.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.639+0000 7fbda4ff9700 1 -- 172.21.15.63:0/160414887 <== mon.0 v2:172.21.15.63:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbd980011c0 con 0x7fbda81377b0 2023-12-01T16:01:28.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.639+0000 7fbda4ff9700 1 -- 172.21.15.63:0/160414887 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7fbda8136440 con 0x7fbda81377b0 2023-12-01T16:01:28.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 -- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbd88065ad0 msgr2=0x7fbd88067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbd88065ad0 0x7fbd88067f90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbda8138320 tx=0x7fbd90009040 comp rx=0 tx=0).stop 2023-12-01T16:01:28.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 -- 172.21.15.63:0/160414887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbda81377b0 msgr2=0x7fbda812f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbda81377b0 0x7fbda812f0b0 secure :-1 s=READY pgs=2969 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800c530 tx=0x7fbd9800c8f0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 -- 172.21.15.63:0/160414887 shutdown_connections 2023-12-01T16:01:28.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fbd88065ad0 0x7fbd88067f90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbda8141760 0x7fbda812fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda8137b90 0x7fbda812f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 --2- 172.21.15.63:0/160414887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbda81377b0 0x7fbda812f0b0 unknown :-1 s=CLOSED pgs=2969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 -- 172.21.15.63:0/160414887 >> 172.21.15.63:0/160414887 conn(0x7fbda8073710 msgr2=0x7fbda8136d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:28.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 -- 172.21.15.63:0/160414887 shutdown_connections 2023-12-01T16:01:28.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.643+0000 7fbdac840700 1 -- 172.21.15.63:0/160414887 wait complete. 2023-12-01T16:01:28.667 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-01T16:01:28.668 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T16:01:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.767+0000 7f3468a2f700 1 Processor -- start 2023-12-01T16:01:28.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.767+0000 7f3468a2f700 1 -- start start 2023-12-01T16:01:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3468a2f700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3464137ac0 0x7f346406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3468a2f700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346409c240 con 0x7f34641376e0 2023-12-01T16:01:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3468a2f700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346409bc90 con 0x7f34641408b0 2023-12-01T16:01:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3468a2f700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346409bf80 con 0x7f3464137ac0 2023-12-01T16:01:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3462ffd700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3464137ac0 0x7f346406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f34637fe700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f34641376e0 0x7f346406ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48374/0 (socket says 172.21.15.63:48374) 2023-12-01T16:01:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f34637fe700 1 -- 172.21.15.63:0/1843032355 learned_addr learned my addr 172.21.15.63:0/1843032355 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T16:01:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3462ffd700 1 -- 172.21.15.63:0/1843032355 >> v1:172.21.15.66:6789/0 conn(0x7f34641408b0 legacy=0x7f3464142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3462ffd700 1 -- 172.21.15.63:0/1843032355 >> v1:172.21.15.63:6789/0 conn(0x7f34641376e0 legacy=0x7f346406ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3462ffd700 1 -- 172.21.15.63:0/1843032355 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346409ebd0 con 0x7f3464137ac0 2023-12-01T16:01:28.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3462ffd700 1 --2- 172.21.15.63:0/1843032355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464137ac0 0x7f346406c160 secure :-1 s=READY pgs=2971 cs=0 l=1 rev1=1 crypto rx=0x7f3454009850 tx=0x7f3454009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d866b06f1ab7f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:28.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f34627fc700 1 -- 172.21.15.63:0/1843032355 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011830 con 0x7f3464137ac0 2023-12-01T16:01:28.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f34627fc700 1 -- 172.21.15.63:0/1843032355 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3454011990 con 0x7f3464137ac0 2023-12-01T16:01:28.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f34627fc700 1 -- 172.21.15.63:0/1843032355 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011d40 con 0x7f3464137ac0 2023-12-01T16:01:28.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3468a2f700 1 -- 172.21.15.63:0/1843032355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464137ac0 msgr2=0x7f346406c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3468a2f700 1 --2- 172.21.15.63:0/1843032355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464137ac0 0x7f346406c160 secure :-1 s=READY pgs=2971 cs=0 l=1 rev1=1 crypto rx=0x7f3454009850 tx=0x7f3454009b60 comp rx=0 tx=0).stop 2023-12-01T16:01:28.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3468a2f700 1 -- 172.21.15.63:0/1843032355 shutdown_connections 2023-12-01T16:01:28.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3468a2f700 1 --2- 172.21.15.63:0/1843032355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464137ac0 0x7f346406c160 unknown :-1 s=CLOSED pgs=2971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3468a2f700 1 -- 172.21.15.63:0/1843032355 >> 172.21.15.63:0/1843032355 conn(0x7f34640737a0 msgr2=0x7f34640ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:28.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3468a2f700 1 -- 172.21.15.63:0/1843032355 shutdown_connections 2023-12-01T16:01:28.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.771+0000 7f3468a2f700 1 -- 172.21.15.63:0/1843032355 wait complete. 2023-12-01T16:01:28.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3468a2f700 1 Processor -- start 2023-12-01T16:01:28.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3468a2f700 1 -- start start 2023-12-01T16:01:28.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3468a2f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34641376e0 0x7f34641cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3468a2f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3464137ac0 0x7f34641cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3468a2f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34641408b0 0x7f34641cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3468a2f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346413e780 con 0x7f34641376e0 2023-12-01T16:01:28.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3468a2f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346413f740 con 0x7f34641408b0 2023-12-01T16:01:28.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3468a2f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34641cbc80 con 0x7f3464137ac0 2023-12-01T16:01:28.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f34637fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34641376e0 0x7f34641cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f34637fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34641376e0 0x7f34641cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45296/0 (socket says 172.21.15.63:45296) 2023-12-01T16:01:28.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f34637fe700 1 -- 172.21.15.63:0/1894110493 learned_addr learned my addr 172.21.15.63:0/1894110493 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:01:28.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3462ffd700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3464137ac0 0x7f34641cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3463fff700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34641408b0 0x7f34641cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f34637fe700 1 -- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3464137ac0 msgr2=0x7f34641cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f34637fe700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3464137ac0 0x7f34641cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f34637fe700 1 -- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34641408b0 msgr2=0x7f34641cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:28.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f34637fe700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34641408b0 0x7f34641cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:28.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f34637fe700 1 -- 172.21.15.63:0/1894110493 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34540094b0 con 0x7f34641376e0 2023-12-01T16:01:28.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3463fff700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34641408b0 0x7f34641cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T16:01:28.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f34637fe700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34641376e0 0x7f34641cc140 secure :-1 s=READY pgs=2972 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c700 tx=0x7f344c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:28.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f345bfff700 1 -- 172.21.15.63:0/1894110493 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c005d90 con 0x7f34641376e0 2023-12-01T16:01:28.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f345bfff700 1 -- 172.21.15.63:0/1894110493 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f344c0070d0 con 0x7f34641376e0 2023-12-01T16:01:28.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3468a2f700 1 -- 172.21.15.63:0/1894110493 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346413dbc0 con 0x7f34641376e0 2023-12-01T16:01:28.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f345bfff700 1 -- 172.21.15.63:0/1894110493 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c007440 con 0x7f34641376e0 2023-12-01T16:01:28.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.775+0000 7f3468a2f700 1 -- 172.21.15.63:0/1894110493 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34641ccbc0 con 0x7f34641376e0 2023-12-01T16:01:28.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.779+0000 7f3468a2f700 1 -- 172.21.15.63:0/1894110493 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3464065fb0 con 0x7f34641376e0 2023-12-01T16:01:28.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.779+0000 7f345bfff700 1 -- 172.21.15.63:0/1894110493 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f344c0075a0 con 0x7f34641376e0 2023-12-01T16:01:28.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.779+0000 7f345bfff700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3444065b00 0x7f3444067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:28.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.779+0000 7f345bfff700 1 -- 172.21.15.63:0/1894110493 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7f344c081ff0 con 0x7f34641376e0 2023-12-01T16:01:28.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.779+0000 7f3462ffd700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3444065b00 0x7f3444067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:28.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.783+0000 7f3462ffd700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3444065b00 0x7f3444067fc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3454009fd0 tx=0x7f3454008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:28.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.787+0000 7f345bfff700 1 -- 172.21.15.63:0/1894110493 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f344c04ff60 con 0x7f34641376e0 2023-12-01T16:01:28.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.987+0000 7f3468a2f700 1 -- 172.21.15.63:0/1894110493 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3464061d90 con 0x7f34641376e0 2023-12-01T16:01:29.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.987+0000 7f345bfff700 1 -- 172.21.15.63:0/1894110493 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3130 (secure 0 0 0) 0x7f344c017c50 con 0x7f34641376e0 2023-12-01T16:01:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T16:01:29.001 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6817/2060518783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2060518783},{"type":"v1","addr":"172.21.15.63:6817","nonce":2060518783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T15:43:45.544844+0000","modified":"2023-12-01T15:43:48.562365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6819/2416365697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2416365697},{"type":"v1","addr":"172.21.15.66:6819","nonce":2416365697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T16:01:29.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 -- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3444065b00 msgr2=0x7f3444067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3444065b00 0x7f3444067fc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3454009fd0 tx=0x7f3454008030 comp rx=0 tx=0).stop 2023-12-01T16:01:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 -- 172.21.15.63:0/1894110493 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34641376e0 msgr2=0x7f34641cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34641376e0 0x7f34641cc140 secure :-1 s=READY pgs=2972 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c700 tx=0x7f344c00ca10 comp rx=0 tx=0).stop 2023-12-01T16:01:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 -- 172.21.15.63:0/1894110493 shutdown_connections 2023-12-01T16:01:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f3444065b00 0x7f3444067fc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3464137ac0 0x7f34641cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34641408b0 0x7f34641cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 --2- 172.21.15.63:0/1894110493 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34641376e0 0x7f34641cc140 unknown :-1 s=CLOSED pgs=2972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 -- 172.21.15.63:0/1894110493 >> 172.21.15.63:0/1894110493 conn(0x7f34640737a0 msgr2=0x7f3464136b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 -- 172.21.15.63:0/1894110493 shutdown_connections 2023-12-01T16:01:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:28.991+0000 7f3468a2f700 1 -- 172.21.15.63:0/1894110493 wait complete. 2023-12-01T16:01:29.006 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2023-12-01T16:01:29.017 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T16:01:29.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c77224700 1 Processor -- start 2023-12-01T16:01:29.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c77224700 1 -- start start 2023-12-01T16:01:29.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c77224700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c701384d0 0x7f0c70138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c77224700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c70071470 con 0x7f0c70135ab0 2023-12-01T16:01:29.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c77224700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c70070ca0 con 0x7f0c70134f60 2023-12-01T16:01:29.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c77224700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c70071d10 con 0x7f0c701384d0 2023-12-01T16:01:29.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c76a23700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0c70135ab0 0x7f0c70140810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48380/0 (socket says 172.21.15.63:48380) 2023-12-01T16:01:29.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c76a23700 1 -- 172.21.15.63:0/2424238305 learned_addr learned my addr 172.21.15.63:0/2424238305 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T16:01:29.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215443409 0 0) 0x7f0c70071470 con 0x7f0c70135ab0 2023-12-01T16:01:29.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c76222700 1 --2- 172.21.15.63:0/2424238305 >> v2:172.21.15.66:3300/0 conn(0x7f0c701384d0 0x7f0c70138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c5c0035d0 con 0x7f0c70135ab0 2023-12-01T16:01:29.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2896126798 0 0) 0x7f0c5c0035d0 con 0x7f0c70135ab0 2023-12-01T16:01:29.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 >> v2:172.21.15.66:3300/0 conn(0x7f0c701384d0 msgr2=0x7f0c70138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:29.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 --2- 172.21.15.63:0/2424238305 >> v2:172.21.15.66:3300/0 conn(0x7f0c701384d0 0x7f0c70138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 >> v1:172.21.15.66:6789/0 conn(0x7f0c70134f60 legacy=0x7f0c701353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700719e0 con 0x7f0c70135ab0 2023-12-01T16:01:29.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3363315130 0 0) 0x7f0c680019f0 con 0x7f0c70135ab0 2023-12-01T16:01:29.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 >> v1:172.21.15.63:6789/0 conn(0x7f0c70135ab0 legacy=0x7f0c70140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c5c003a90 0x7f0c5c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c004870 0x7f0c5c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c5c0053e0 0x7f0c5c00ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70071d10 con 0x7f0c5c004870 2023-12-01T16:01:29.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c00c330 con 0x7f0c5c003a90 2023-12-01T16:01:29.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c00c4f0 con 0x7f0c5c0053e0 2023-12-01T16:01:29.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75a21700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c004870 0x7f0c5c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c76222700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c5c003a90 0x7f0c5c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c76a23700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c5c0053e0 0x7f0c5c00ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75a21700 1 -- 172.21.15.63:0/2424238305 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c5c0053e0 msgr2=0x7f0c5c00ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:29.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75a21700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c5c0053e0 0x7f0c5c00ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75a21700 1 -- 172.21.15.63:0/2424238305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c5c003a90 msgr2=0x7f0c5c003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:29.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75a21700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c5c003a90 0x7f0c5c003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75a21700 1 -- 172.21.15.63:0/2424238305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c0035d0 con 0x7f0c5c004870 2023-12-01T16:01:29.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c76a23700 1 -- 172.21.15.63:0/2424238305 reap_dead start 2023-12-01T16:01:29.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c76222700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c5c003a90 0x7f0c5c003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T16:01:29.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75a21700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c004870 0x7f0c5c004cf0 secure :-1 s=READY pgs=2974 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0017e0 tx=0x7f0c5c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc82236fb5dd123 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:29.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0052d0 con 0x7f0c5c004870 2023-12-01T16:01:29.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0c6c005430 con 0x7f0c5c004870 2023-12-01T16:01:29.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c75220700 1 -- 172.21.15.63:0/2424238305 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0055a0 con 0x7f0c5c004870 2023-12-01T16:01:29.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c77224700 1 -- 172.21.15.63:0/2424238305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c004870 msgr2=0x7f0c5c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.119+0000 7f0c77224700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c004870 0x7f0c5c004cf0 secure :-1 s=READY pgs=2974 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0017e0 tx=0x7f0c5c0058a0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.123+0000 7f0c77224700 1 -- 172.21.15.63:0/2424238305 shutdown_connections 2023-12-01T16:01:29.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.123+0000 7f0c77224700 1 --2- 172.21.15.63:0/2424238305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c004870 0x7f0c5c004cf0 unknown :-1 s=CLOSED pgs=2974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.123+0000 7f0c77224700 1 -- 172.21.15.63:0/2424238305 >> 172.21.15.63:0/2424238305 conn(0x7f0c700a8bd0 msgr2=0x7f0c70098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:29.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.123+0000 7f0c77224700 1 -- 172.21.15.63:0/2424238305 shutdown_connections 2023-12-01T16:01:29.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.123+0000 7f0c77224700 1 -- 172.21.15.63:0/2424238305 wait complete. 2023-12-01T16:01:29.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.123+0000 7f0c77224700 1 Processor -- start 2023-12-01T16:01:29.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.123+0000 7f0c77224700 1 -- start start 2023-12-01T16:01:29.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.123+0000 7f0c77224700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c5c004870 0x7f0c701cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c77224700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c700a4ba0 0x7f0c701cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c77224700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c701cfd70 0x7f0c70131d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c77224700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700a34e0 con 0x7f0c700a4ba0 2023-12-01T16:01:29.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c77224700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700a39b0 con 0x7f0c5c004870 2023-12-01T16:01:29.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c77224700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700a2d20 con 0x7f0c701cfd70 2023-12-01T16:01:29.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c75a21700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c700a4ba0 0x7f0c701cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c75a21700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c700a4ba0 0x7f0c701cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45308/0 (socket says 172.21.15.63:45308) 2023-12-01T16:01:29.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c75a21700 1 -- 172.21.15.63:0/2658217484 learned_addr learned my addr 172.21.15.63:0/2658217484 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:01:29.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c76222700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c5c004870 0x7f0c701cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c76a23700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c701cfd70 0x7f0c70131d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c75a21700 1 -- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c701cfd70 msgr2=0x7f0c70131d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c75a21700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c701cfd70 0x7f0c70131d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c75a21700 1 -- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c5c004870 msgr2=0x7f0c701cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c75a21700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c5c004870 0x7f0c701cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c75a21700 1 -- 172.21.15.63:0/2658217484 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7006f960 con 0x7f0c700a4ba0 2023-12-01T16:01:29.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c75a21700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c700a4ba0 0x7f0c701cf830 secure :-1 s=READY pgs=2975 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c015040 tx=0x7f0c6c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:29.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c66ffd700 1 -- 172.21.15.63:0/2658217484 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0055a0 con 0x7f0c700a4ba0 2023-12-01T16:01:29.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c66ffd700 1 -- 172.21.15.63:0/2658217484 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0c6c001290 con 0x7f0c700a4ba0 2023-12-01T16:01:29.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c77224700 1 -- 172.21.15.63:0/2658217484 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c700a3c70 con 0x7f0c700a4ba0 2023-12-01T16:01:29.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c66ffd700 1 -- 172.21.15.63:0/2658217484 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c01d6e0 con 0x7f0c700a4ba0 2023-12-01T16:01:29.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c77224700 1 -- 172.21.15.63:0/2658217484 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c700a5080 con 0x7f0c700a4ba0 2023-12-01T16:01:29.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c77224700 1 -- 172.21.15.63:0/2658217484 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c70065fb0 con 0x7f0c700a4ba0 2023-12-01T16:01:29.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c66ffd700 1 -- 172.21.15.63:0/2658217484 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0c6c019040 con 0x7f0c700a4ba0 2023-12-01T16:01:29.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.127+0000 7f0c66ffd700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0c54065ad0 0x7f0c54067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.131+0000 7f0c66ffd700 1 -- 172.21.15.63:0/2658217484 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7f0c6c083840 con 0x7f0c700a4ba0 2023-12-01T16:01:29.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.131+0000 7f0c76222700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0c54065ad0 0x7f0c54067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.131+0000 7f0c76222700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0c54065ad0 0x7f0c54067f90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0c70069800 tx=0x7f0c60008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:29.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.135+0000 7f0c66ffd700 1 -- 172.21.15.63:0/2658217484 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0c6c0517b0 con 0x7f0c700a4ba0 2023-12-01T16:01:29.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.339+0000 7f0c77224700 1 -- 172.21.15.63:0/2658217484 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c700a34e0 con 0x7f0c700a4ba0 2023-12-01T16:01:29.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.339+0000 7f0c66ffd700 1 -- 172.21.15.63:0/2658217484 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3130 (secure 0 0 0) 0x7f0c6c02d090 con 0x7f0c700a4ba0 2023-12-01T16:01:29.353 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T16:01:29.353 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6817/2060518783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2060518783},{"type":"v1","addr":"172.21.15.63:6817","nonce":2060518783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T15:43:45.544844+0000","modified":"2023-12-01T15:43:48.562365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6819/2416365697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2416365697},{"type":"v1","addr":"172.21.15.66:6819","nonce":2416365697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T16:01:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 -- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0c54065ad0 msgr2=0x7f0c54067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0c54065ad0 0x7f0c54067f90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0c70069800 tx=0x7f0c60008040 comp rx=0 tx=0).stop 2023-12-01T16:01:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 -- 172.21.15.63:0/2658217484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c700a4ba0 msgr2=0x7f0c701cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c700a4ba0 0x7f0c701cf830 secure :-1 s=READY pgs=2975 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c015040 tx=0x7f0c6c001120 comp rx=0 tx=0).stop 2023-12-01T16:01:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 -- 172.21.15.63:0/2658217484 shutdown_connections 2023-12-01T16:01:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f0c54065ad0 0x7f0c54067f90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c701cfd70 0x7f0c70131d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c700a4ba0 0x7f0c701cf830 unknown :-1 s=CLOSED pgs=2975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 --2- 172.21.15.63:0/2658217484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c5c004870 0x7f0c701cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 -- 172.21.15.63:0/2658217484 >> 172.21.15.63:0/2658217484 conn(0x7f0c700a8bd0 msgr2=0x7f0c701343a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:29.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 -- 172.21.15.63:0/2658217484 shutdown_connections 2023-12-01T16:01:29.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.343+0000 7f0c77224700 1 -- 172.21.15.63:0/2658217484 wait complete. 2023-12-01T16:01:29.358 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2023-12-01T16:01:29.368 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T16:01:29.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f37408bc700 1 Processor -- start 2023-12-01T16:01:29.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f37408bc700 1 -- start start 2023-12-01T16:01:29.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f37408bc700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f373c1346b0 0x7f373c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f37408bc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c1408a0 0x7f373c142c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f37408bc700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c0a5790 con 0x7f373c1342d0 2023-12-01T16:01:29.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f37408bc700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373c0a48d0 con 0x7f373c1346b0 2023-12-01T16:01:29.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f37408bc700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c134af0 con 0x7f373c1408a0 2023-12-01T16:01:29.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373ad9d700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f373c1342d0 0x7f373c071750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48386/0 (socket says 172.21.15.63:48386) 2023-12-01T16:01:29.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373ad9d700 1 -- 172.21.15.63:0/453857843 learned_addr learned my addr 172.21.15.63:0/453857843 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T16:01:29.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373b59e700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c1408a0 0x7f373c142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373a59c700 1 --2- 172.21.15.63:0/453857843 >> v2:172.21.15.66:3300/0 conn(0x7f373c1346b0 0x7f373c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172641126 0 0) 0x7f373c0a5790 con 0x7f373c1342d0 2023-12-01T16:01:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37280035d0 con 0x7f373c1342d0 2023-12-01T16:01:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3771530985 0 0) 0x7f37280035d0 con 0x7f373c1342d0 2023-12-01T16:01:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c1408a0 msgr2=0x7f373c142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c1408a0 0x7f373c142c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 >> v2:172.21.15.66:3300/0 conn(0x7f373c1346b0 msgr2=0x7f373c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:29.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 --2- 172.21.15.63:0/453857843 >> v2:172.21.15.66:3300/0 conn(0x7f373c1346b0 0x7f373c071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c0a42d0 con 0x7f373c1342d0 2023-12-01T16:01:29.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3363315130 0 0) 0x7f37240019f0 con 0x7f373c1342d0 2023-12-01T16:01:29.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 >> v1:172.21.15.63:6789/0 conn(0x7f373c1342d0 legacy=0x7f373c071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 0x7f3728003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3728004870 0x7f3728004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c1408a0 0x7f3728005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0a48d0 con 0x7f3728003a90 2023-12-01T16:01:29.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c134af0 con 0x7f3728004870 2023-12-01T16:01:29.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372800bab0 con 0x7f373c1408a0 2023-12-01T16:01:29.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373ad9d700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 0x7f3728003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373a59c700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3728004870 0x7f3728004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373b59e700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c1408a0 0x7f3728005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373ad9d700 1 -- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c1408a0 msgr2=0x7f3728005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:29.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373ad9d700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c1408a0 0x7f3728005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373ad9d700 1 -- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3728004870 msgr2=0x7f3728004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:29.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373ad9d700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3728004870 0x7f3728004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373ad9d700 1 -- 172.21.15.63:0/453857843 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37280035d0 con 0x7f3728003a90 2023-12-01T16:01:29.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373b59e700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c1408a0 0x7f3728005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T16:01:29.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.463+0000 7f373a59c700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3728004870 0x7f3728004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T16:01:29.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f373ad9d700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 0x7f3728003ed0 secure :-1 s=READY pgs=2977 cs=0 l=1 rev1=1 crypto rx=0x7f372400a860 tx=0x7f37280058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af12c719375218ff server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:29.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37240072d0 con 0x7f3728003a90 2023-12-01T16:01:29.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3724007450 con 0x7f3728003a90 2023-12-01T16:01:29.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f3739d9b700 1 -- 172.21.15.63:0/453857843 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724007820 con 0x7f3728003a90 2023-12-01T16:01:29.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f37408bc700 1 -- 172.21.15.63:0/453857843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 msgr2=0x7f3728003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f37408bc700 1 --2- 172.21.15.63:0/453857843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 0x7f3728003ed0 secure :-1 s=READY pgs=2977 cs=0 l=1 rev1=1 crypto rx=0x7f372400a860 tx=0x7f37280058a0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f373b59e700 1 -- 172.21.15.63:0/453857843 reap_dead start 2023-12-01T16:01:29.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f37408bc700 1 -- 172.21.15.63:0/453857843 shutdown_connections 2023-12-01T16:01:29.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f37408bc700 1 -- 172.21.15.63:0/453857843 >> 172.21.15.63:0/453857843 conn(0x7f373c0a9a90 msgr2=0x7f373c0a5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:29.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f37408bc700 1 -- 172.21.15.63:0/453857843 shutdown_connections 2023-12-01T16:01:29.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f37408bc700 1 -- 172.21.15.63:0/453857843 wait complete. 2023-12-01T16:01:29.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f37408bc700 1 Processor -- start 2023-12-01T16:01:29.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.467+0000 7f37408bc700 1 -- start start 2023-12-01T16:01:29.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37408bc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 0x7f373c0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37408bc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c0a0720 0x7f373c1cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37408bc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c1cc6f0 0x7f373c1cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37408bc700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c1cbd00 con 0x7f3728003a90 2023-12-01T16:01:29.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37408bc700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0a1e80 con 0x7f373c1cc6f0 2023-12-01T16:01:29.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37408bc700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c13a200 con 0x7f373c0a0720 2023-12-01T16:01:29.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f373ad9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 0x7f373c0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f373ad9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 0x7f373c0a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45316/0 (socket says 172.21.15.63:45316) 2023-12-01T16:01:29.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f373ad9d700 1 -- 172.21.15.63:0/289275893 learned_addr learned my addr 172.21.15.63:0/289275893 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:01:29.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f373a59c700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c0a0720 0x7f373c1cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f373b59e700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c1cc6f0 0x7f373c1cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f373ad9d700 1 -- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c0a0720 msgr2=0x7f373c1cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f373ad9d700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c0a0720 0x7f373c1cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f373ad9d700 1 -- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c1cc6f0 msgr2=0x7f373c1cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f373ad9d700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c1cc6f0 0x7f373c1cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f373ad9d700 1 -- 172.21.15.63:0/289275893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c0a14b0 con 0x7f3728003a90 2023-12-01T16:01:29.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f373ad9d700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 0x7f373c0a1940 secure :-1 s=READY pgs=2978 cs=0 l=1 rev1=1 crypto rx=0x7f372400ab70 tx=0x7f3724001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:29.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37337fe700 1 -- 172.21.15.63:0/289275893 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724001250 con 0x7f3728003a90 2023-12-01T16:01:29.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37337fe700 1 -- 172.21.15.63:0/289275893 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3724012400 con 0x7f3728003a90 2023-12-01T16:01:29.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37408bc700 1 -- 172.21.15.63:0/289275893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c1cbef0 con 0x7f3728003a90 2023-12-01T16:01:29.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37337fe700 1 -- 172.21.15.63:0/289275893 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37240127d0 con 0x7f3728003a90 2023-12-01T16:01:29.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37408bc700 1 -- 172.21.15.63:0/289275893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c13aa70 con 0x7f3728003a90 2023-12-01T16:01:29.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.471+0000 7f37408bc700 1 -- 172.21.15.63:0/289275893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c065fb0 con 0x7f3728003a90 2023-12-01T16:01:29.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.475+0000 7f37337fe700 1 -- 172.21.15.63:0/289275893 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f372401a070 con 0x7f3728003a90 2023-12-01T16:01:29.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.475+0000 7f37337fe700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f371c065ad0 0x7f371c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.475+0000 7f37337fe700 1 -- 172.21.15.63:0/289275893 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7f3724084a90 con 0x7f3728003a90 2023-12-01T16:01:29.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.475+0000 7f373a59c700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f371c065ad0 0x7f371c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.475+0000 7f373a59c700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f371c065ad0 0x7f371c067f90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f373c0a3610 tx=0x7f372c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:29.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.479+0000 7f37337fe700 1 -- 172.21.15.63:0/289275893 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f3724052b20 con 0x7f3728003a90 2023-12-01T16:01:29.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.647+0000 7f37408bc700 1 -- 172.21.15.63:0/289275893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f373c0a5920 con 0x7f3728003a90 2023-12-01T16:01:29.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.647+0000 7f37337fe700 1 -- 172.21.15.63:0/289275893 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13296 (secure 0 0 0) 0x7f3724018090 con 0x7f3728003a90 2023-12-01T16:01:29.661 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-01T16:01:29.661 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":44,"fsid":"0a7c19c3-eb14-4b37-8b43-8cd4a454a0e9","created":"2023-12-01T15:43:23.087311+0000","modified":"2023-12-01T15:59:43.384841+0000","last_up_change":"2023-12-01T15:43:33.697461+0000","last_in_change":"2023-12-01T15:43:25.188448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T15:43:34.432064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-01T15:43:39.868591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-01T15:43:43.988414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-01T15:43:44.550416+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bc79556-979d-4837-8915-054bbf487d48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":29724},{"type":"v1","addr":"172.21.15.63:6809","nonce":29724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":29724},{"type":"v1","addr":"172.21.15.63:6811","nonce":29724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":29724},{"type":"v1","addr":"172.21.15.63:6815","nonce":29724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":29724},{"type":"v1","addr":"172.21.15.63:6813","nonce":29724}]},"public_addr":"172.21.15.63:6809/29724","cluster_addr":"172.21.15.63:6811/29724","heartbeat_back_addr":"172.21.15.63:6815/29724","heartbeat_front_addr":"172.21.15.63:6813/29724","state":["exists","up"]},{"osd":1,"uuid":"bdbba160-500c-4e5d-9756-01bda550eb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":29723},{"type":"v1","addr":"172.21.15.63:6801","nonce":29723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":29723},{"type":"v1","addr":"172.21.15.63:6803","nonce":29723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":29723},{"type":"v1","addr":"172.21.15.63:6807","nonce":29723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":29723},{"type":"v1","addr":"172.21.15.63:6805","nonce":29723}]},"public_addr":"172.21.15.63:6801/29723","cluster_addr":"172.21.15.63:6803/29723","heartbeat_back_addr":"172.21.15.63:6807/29723","heartbeat_front_addr":"172.21.15.63:6805/29723","state":["exists","up"]},{"osd":2,"uuid":"3165d6ee-48db-4d40-b80d-abc11f61cb96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":29906},{"type":"v1","addr":"172.21.15.66:6809","nonce":29906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":29906},{"type":"v1","addr":"172.21.15.66:6811","nonce":29906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":29906},{"type":"v1","addr":"172.21.15.66:6815","nonce":29906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":29906},{"type":"v1","addr":"172.21.15.66:6813","nonce":29906}]},"public_addr":"172.21.15.66:6809/29906","cluster_addr":"172.21.15.66:6811/29906","heartbeat_back_addr":"172.21.15.66:6815/29906","heartbeat_front_addr":"172.21.15.66:6813/29906","state":["exists","up"]},{"osd":3,"uuid":"aac87cc6-efc2-45b9-a147-f936029dcb2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":29907},{"type":"v1","addr":"172.21.15.66:6801","nonce":29907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":29907},{"type":"v1","addr":"172.21.15.66:6803","nonce":29907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":29907},{"type":"v1","addr":"172.21.15.66:6807","nonce":29907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":29907},{"type":"v1","addr":"172.21.15.66:6805","nonce":29907}]},"public_addr":"172.21.15.66:6801/29907","cluster_addr":"172.21.15.66:6803/29907","heartbeat_back_addr":"172.21.15.66:6807/29907","heartbeat_front_addr":"172.21.15.66:6805/29907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.688523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.469085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.781721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T15:43:30.451391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T16:01:29.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 -- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f371c065ad0 msgr2=0x7f371c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f371c065ad0 0x7f371c067f90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f373c0a3610 tx=0x7f372c008040 comp rx=0 tx=0).stop 2023-12-01T16:01:29.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 -- 172.21.15.63:0/289275893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 msgr2=0x7f373c0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 0x7f373c0a1940 secure :-1 s=READY pgs=2978 cs=0 l=1 rev1=1 crypto rx=0x7f372400ab70 tx=0x7f3724001d80 comp rx=0 tx=0).stop 2023-12-01T16:01:29.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 -- 172.21.15.63:0/289275893 shutdown_connections 2023-12-01T16:01:29.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f371c065ad0 0x7f371c067f90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f373c0a0720 0x7f373c1cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f373c1cc6f0 0x7f373c1cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 --2- 172.21.15.63:0/289275893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3728003a90 0x7f373c0a1940 unknown :-1 s=CLOSED pgs=2978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 -- 172.21.15.63:0/289275893 >> 172.21.15.63:0/289275893 conn(0x7f373c0a9a90 msgr2=0x7f373c137070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:29.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 -- 172.21.15.63:0/289275893 shutdown_connections 2023-12-01T16:01:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.651+0000 7f37408bc700 1 -- 172.21.15.63:0/289275893 wait complete. 2023-12-01T16:01:29.680 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-01T16:01:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22d5b7700 1 Processor -- start 2023-12-01T16:01:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22d5b7700 1 -- start start 2023-12-01T16:01:29.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22d5b7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2281344d0 0x7fd2281348b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22d5b7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd22813b190 0x7fd228142940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22d5b7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22806c970 con 0x7fd22813a600 2023-12-01T16:01:29.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22d5b7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22806db20 con 0x7fd22813b190 2023-12-01T16:01:29.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22d5b7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22806bfe0 con 0x7fd2281344d0 2023-12-01T16:01:29.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22cdb6700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd22813b190 0x7fd228142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd21ffff700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd22813a600 0x7fd22813aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48394/0 (socket says 172.21.15.63:48394) 2023-12-01T16:01:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd21ffff700 1 -- 172.21.15.63:0/2936352556 learned_addr learned my addr 172.21.15.63:0/2936352556 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T16:01:29.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd227fff700 1 --2- 172.21.15.63:0/2936352556 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2281344d0 0x7fd2281348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22cdb6700 1 -- 172.21.15.63:0/2936352556 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2281344d0 msgr2=0x7fd2281348b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:29.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22cdb6700 1 --2- 172.21.15.63:0/2936352556 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2281344d0 0x7fd2281348b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22cdb6700 1 -- 172.21.15.63:0/2936352556 >> v1:172.21.15.63:6789/0 conn(0x7fd22813a600 legacy=0x7fd22813aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22cdb6700 1 -- 172.21.15.63:0/2936352556 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22806bd00 con 0x7fd22813b190 2023-12-01T16:01:29.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd227fff700 1 --2- 172.21.15.63:0/2936352556 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2281344d0 0x7fd2281348b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T16:01:29.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd22cdb6700 1 --2- 172.21.15.63:0/2936352556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd22813b190 0x7fd228142940 secure :-1 s=READY pgs=2980 cs=0 l=1 rev1=1 crypto rx=0x7fd220009d90 tx=0x7fd22000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1c34bead27cd6f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:29.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd2277fe700 1 -- 172.21.15.63:0/2936352556 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000e070 con 0x7fd22813b190 2023-12-01T16:01:29.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd2277fe700 1 -- 172.21.15.63:0/2936352556 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd22000bbd0 con 0x7fd22813b190 2023-12-01T16:01:29.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.783+0000 7fd2277fe700 1 -- 172.21.15.63:0/2936352556 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220012430 con 0x7fd22813b190 2023-12-01T16:01:29.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 -- 172.21.15.63:0/2936352556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd22813b190 msgr2=0x7fd228142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 --2- 172.21.15.63:0/2936352556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd22813b190 0x7fd228142940 secure :-1 s=READY pgs=2980 cs=0 l=1 rev1=1 crypto rx=0x7fd220009d90 tx=0x7fd22000b330 comp rx=0 tx=0).stop 2023-12-01T16:01:29.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 -- 172.21.15.63:0/2936352556 shutdown_connections 2023-12-01T16:01:29.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 --2- 172.21.15.63:0/2936352556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd22813b190 0x7fd228142940 unknown :-1 s=CLOSED pgs=2980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 --2- 172.21.15.63:0/2936352556 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2281344d0 0x7fd2281348b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 -- 172.21.15.63:0/2936352556 >> 172.21.15.63:0/2936352556 conn(0x7fd2280a7730 msgr2=0x7fd2280aa600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 -- 172.21.15.63:0/2936352556 shutdown_connections 2023-12-01T16:01:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 -- 172.21.15.63:0/2936352556 wait complete. 2023-12-01T16:01:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 Processor -- start 2023-12-01T16:01:29.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 -- start start 2023-12-01T16:01:29.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2281344d0 0x7fd228130db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd22813a600 0x7fd2281312f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd22813b190 0x7fd228131830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22809c8b0 con 0x7fd22813b190 2023-12-01T16:01:29.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22809e080 con 0x7fd22813a600 2023-12-01T16:01:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22d5b7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22809b060 con 0x7fd2281344d0 2023-12-01T16:01:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22cdb6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd22813b190 0x7fd228131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd227fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2281344d0 0x7fd228130db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22cdb6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd22813b190 0x7fd228131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45334/0 (socket says 172.21.15.63:45334) 2023-12-01T16:01:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd22cdb6700 1 -- 172.21.15.63:0/3432830191 learned_addr learned my addr 172.21.15.63:0/3432830191 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:01:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.787+0000 7fd21ffff700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd22813a600 0x7fd2281312f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd22cdb6700 1 -- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2281344d0 msgr2=0x7fd228130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd22cdb6700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2281344d0 0x7fd228130db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd22cdb6700 1 -- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd22813a600 msgr2=0x7fd2281312f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd22cdb6700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd22813a600 0x7fd2281312f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd22cdb6700 1 -- 172.21.15.63:0/3432830191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220009a70 con 0x7fd22813b190 2023-12-01T16:01:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd22cdb6700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd22813b190 0x7fd228131830 secure :-1 s=READY pgs=2981 cs=0 l=1 rev1=1 crypto rx=0x7fd220014040 tx=0x7fd220004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd2257fa700 1 -- 172.21.15.63:0/3432830191 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220012d20 con 0x7fd22813b190 2023-12-01T16:01:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd2257fa700 1 -- 172.21.15.63:0/3432830191 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd220020070 con 0x7fd22813b190 2023-12-01T16:01:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd22d5b7700 1 -- 172.21.15.63:0/3432830191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22809ce20 con 0x7fd22813b190 2023-12-01T16:01:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd2257fa700 1 -- 172.21.15.63:0/3432830191 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220012ea0 con 0x7fd22813b190 2023-12-01T16:01:29.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd22d5b7700 1 -- 172.21.15.63:0/3432830191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22809c1d0 con 0x7fd22813b190 2023-12-01T16:01:29.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.791+0000 7fd22d5b7700 1 -- 172.21.15.63:0/3432830191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd228065fb0 con 0x7fd22813b190 2023-12-01T16:01:29.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.795+0000 7fd2257fa700 1 -- 172.21.15.63:0/3432830191 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd2200042a0 con 0x7fd22813b190 2023-12-01T16:01:29.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.795+0000 7fd2257fa700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd208065ad0 0x7fd208067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.795+0000 7fd2257fa700 1 -- 172.21.15.63:0/3432830191 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4391+0+0 (secure 0 0 0) 0x7fd220022070 con 0x7fd22813b190 2023-12-01T16:01:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.795+0000 7fd227fff700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd208065ad0 0x7fd208067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.795+0000 7fd227fff700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd208065ad0 0x7fd208067f90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd218006fd0 tx=0x7fd218008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:29.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:29.799+0000 7fd2257fa700 1 -- 172.21.15.63:0/3432830191 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd2200528c0 con 0x7fd22813b190 2023-12-01T16:01:30.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.003+0000 7fd22d5b7700 1 -- 172.21.15.63:0/3432830191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd228061d90 con 0x7fd22813b190 2023-12-01T16:01:30.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd2257fa700 1 -- 172.21.15.63:0/3432830191 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd22002c090 con 0x7fd22813b190 2023-12-01T16:01:30.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 -- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd208065ad0 msgr2=0x7fd208067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:30.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd208065ad0 0x7fd208067f90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd218006fd0 tx=0x7fd218008040 comp rx=0 tx=0).stop 2023-12-01T16:01:30.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 -- 172.21.15.63:0/3432830191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd22813b190 msgr2=0x7fd228131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:30.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd22813b190 0x7fd228131830 secure :-1 s=READY pgs=2981 cs=0 l=1 rev1=1 crypto rx=0x7fd220014040 tx=0x7fd220004af0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 -- 172.21.15.63:0/3432830191 shutdown_connections 2023-12-01T16:01:30.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fd208065ad0 0x7fd208067f90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd22813b190 0x7fd228131830 unknown :-1 s=CLOSED pgs=2981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd22813a600 0x7fd2281312f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 --2- 172.21.15.63:0/3432830191 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2281344d0 0x7fd228130db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 -- 172.21.15.63:0/3432830191 >> 172.21.15.63:0/3432830191 conn(0x7fd2280a7730 msgr2=0x7fd228132300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:30.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 -- 172.21.15.63:0/3432830191 shutdown_connections 2023-12-01T16:01:30.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.023+0000 7fd22d5b7700 1 -- 172.21.15.63:0/3432830191 wait complete. 2023-12-01T16:01:30.041 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-01T16:01:30.050 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-01T16:01:30.085 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2023-12-01T16:01:30.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 Processor -- start 2023-12-01T16:01:30.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 -- start start 2023-12-01T16:01:30.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f79a0135500 0x7f79a01358e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:30.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f79a01382f0 0x7f79a0138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:30.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a0138c40 0x7f79a013f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:30.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a00a4420 con 0x7f79a0135500 2023-12-01T16:01:30.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a009bae0 con 0x7f79a01382f0 2023-12-01T16:01:30.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00a2330 con 0x7f79a0138c40 2023-12-01T16:01:30.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f79a0135500 0x7f79a01358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:30.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799ffff700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f79a0135500 0x7f79a01358e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45338/0 (socket says 172.21.15.63:45338) 2023-12-01T16:01:30.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799ffff700 1 -- 172.21.15.63:0/1811790535 learned_addr learned my addr 172.21.15.63:0/1811790535 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:01:30.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a4ed3700 1 --2- 172.21.15.63:0/1811790535 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a0138c40 0x7f79a013f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:30.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799f7fe700 1 --2- 172.21.15.63:0/1811790535 >> v2:172.21.15.66:3300/0 conn(0x7f79a01382f0 0x7f79a0138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:30.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799ffff700 1 -- 172.21.15.63:0/1811790535 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a0138c40 msgr2=0x7f79a013f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:30.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799ffff700 1 --2- 172.21.15.63:0/1811790535 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a0138c40 0x7f79a013f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799ffff700 1 -- 172.21.15.63:0/1811790535 >> v2:172.21.15.66:3300/0 conn(0x7f79a01382f0 msgr2=0x7f79a0138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:30.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799ffff700 1 --2- 172.21.15.63:0/1811790535 >> v2:172.21.15.66:3300/0 conn(0x7f79a01382f0 0x7f79a0138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799ffff700 1 -- 172.21.15.63:0/1811790535 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a01390f0 con 0x7f79a0135500 2023-12-01T16:01:30.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799ffff700 1 --2- 172.21.15.63:0/1811790535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79a0135500 0x7f79a01358e0 secure :-1 s=READY pgs=2984 cs=0 l=1 rev1=1 crypto rx=0x7f79a0139390 tx=0x7f7988009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e399486cba623075 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:30.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799effd700 1 -- 172.21.15.63:0/1811790535 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798800b8a0 con 0x7f79a0135500 2023-12-01T16:01:30.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799effd700 1 -- 172.21.15.63:0/1811790535 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f798800ba00 con 0x7f79a0135500 2023-12-01T16:01:30.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f799effd700 1 -- 172.21.15.63:0/1811790535 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798800bdb0 con 0x7f79a0135500 2023-12-01T16:01:30.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 -- 172.21.15.63:0/1811790535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79a0135500 msgr2=0x7f79a01358e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:30.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 --2- 172.21.15.63:0/1811790535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79a0135500 0x7f79a01358e0 secure :-1 s=READY pgs=2984 cs=0 l=1 rev1=1 crypto rx=0x7f79a0139390 tx=0x7f7988009bf0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 -- 172.21.15.63:0/1811790535 shutdown_connections 2023-12-01T16:01:30.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 --2- 172.21.15.63:0/1811790535 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a0138c40 0x7f79a013f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 --2- 172.21.15.63:0/1811790535 >> v2:172.21.15.66:3300/0 conn(0x7f79a01382f0 0x7f79a0138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 --2- 172.21.15.63:0/1811790535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79a0135500 0x7f79a01358e0 unknown :-1 s=CLOSED pgs=2984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 -- 172.21.15.63:0/1811790535 >> 172.21.15.63:0/1811790535 conn(0x7f79a00a8a70 msgr2=0x7f79a00a4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:30.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 -- 172.21.15.63:0/1811790535 shutdown_connections 2023-12-01T16:01:30.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.155+0000 7f79a56d4700 1 -- 172.21.15.63:0/1811790535 wait complete. 2023-12-01T16:01:30.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a56d4700 1 Processor -- start 2023-12-01T16:01:30.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a56d4700 1 -- start start 2023-12-01T16:01:30.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a56d4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79a0135500 0x7f79a0133f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:30.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a56d4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a01382f0 0x7f79a0134460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:30.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a56d4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79a0138c40 0x7f79a01be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:30.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a56d4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a01c0250 con 0x7f79a0138c40 2023-12-01T16:01:30.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a56d4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a01c0020 con 0x7f79a0135500 2023-12-01T16:01:30.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a56d4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a01c0f50 con 0x7f79a01382f0 2023-12-01T16:01:30.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a4ed3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79a0138c40 0x7f79a01be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:30.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a4ed3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79a0138c40 0x7f79a01be0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45352/0 (socket says 172.21.15.63:45352) 2023-12-01T16:01:30.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f799ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79a0135500 0x7f79a0133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:30.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a4ed3700 1 -- 172.21.15.63:0/2946552493 learned_addr learned my addr 172.21.15.63:0/2946552493 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:01:30.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f799f7fe700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a01382f0 0x7f79a0134460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:30.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a4ed3700 1 -- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a01382f0 msgr2=0x7f79a0134460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:30.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a4ed3700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a01382f0 0x7f79a0134460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a4ed3700 1 -- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79a0135500 msgr2=0x7f79a0133f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:30.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a4ed3700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79a0135500 0x7f79a0133f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:30.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a4ed3700 1 -- 172.21.15.63:0/2946552493 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988009570 con 0x7f79a0138c40 2023-12-01T16:01:30.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a4ed3700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79a0138c40 0x7f79a01be0f0 secure :-1 s=READY pgs=2985 cs=0 l=1 rev1=1 crypto rx=0x7f799000e7e0 tx=0x7f799000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:30.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f799cff9700 1 -- 172.21.15.63:0/2946552493 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799000c070 con 0x7f79a0138c40 2023-12-01T16:01:30.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f799cff9700 1 -- 172.21.15.63:0/2946552493 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7990013610 con 0x7f79a0138c40 2023-12-01T16:01:30.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a56d4700 1 -- 172.21.15.63:0/2946552493 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a00a40e0 con 0x7f79a0138c40 2023-12-01T16:01:30.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f799cff9700 1 -- 172.21.15.63:0/2946552493 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79900139e0 con 0x7f79a0138c40 2023-12-01T16:01:30.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.159+0000 7f79a56d4700 1 -- 172.21.15.63:0/2946552493 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a0135ee0 con 0x7f79a0138c40 2023-12-01T16:01:30.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.163+0000 7f79a56d4700 1 -- 172.21.15.63:0/2946552493 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a0065fb0 con 0x7f79a0138c40 2023-12-01T16:01:30.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.163+0000 7f799cff9700 1 -- 172.21.15.63:0/2946552493 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7990013b40 con 0x7f79a0138c40 2023-12-01T16:01:30.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.163+0000 7f799cff9700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7980065ad0 0x7f7980067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:30.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.163+0000 7f799cff9700 1 -- 172.21.15.63:0/2946552493 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4449+0+0 (secure 0 0 0) 0x7f7990082940 con 0x7f79a0138c40 2023-12-01T16:01:30.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.163+0000 7f799ffff700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7980065ad0 0x7f7980067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:30.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.163+0000 7f799ffff700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7980065ad0 0x7f7980067f90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7988000c00 tx=0x7f7988008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:30.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.171+0000 7f799cff9700 1 -- 172.21.15.63:0/2946552493 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f79900507f0 con 0x7f79a0138c40 2023-12-01T16:01:30.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:30.374+0000 7f79a56d4700 1 -- 172.21.15.63:0/2946552493 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f79a0061d90 con 0x7f79a0138c40 2023-12-01T16:01:31.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.026+0000 7f799cff9700 1 -- 172.21.15.63:0/2946552493 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7990053e10 con 0x7f79a0138c40 2023-12-01T16:01:31.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 -- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7980065ad0 msgr2=0x7f7980067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:31.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7980065ad0 0x7f7980067f90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7988000c00 tx=0x7f7988008030 comp rx=0 tx=0).stop 2023-12-01T16:01:31.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 -- 172.21.15.63:0/2946552493 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79a0138c40 msgr2=0x7f79a01be0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:31.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79a0138c40 0x7f79a01be0f0 secure :-1 s=READY pgs=2985 cs=0 l=1 rev1=1 crypto rx=0x7f799000e7e0 tx=0x7f799000eaf0 comp rx=0 tx=0).stop 2023-12-01T16:01:31.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 -- 172.21.15.63:0/2946552493 shutdown_connections 2023-12-01T16:01:31.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f7980065ad0 0x7f7980067f90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:31.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a01382f0 0x7f79a0134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:31.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79a0138c40 0x7f79a01be0f0 unknown :-1 s=CLOSED pgs=2985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:31.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 --2- 172.21.15.63:0/2946552493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79a0135500 0x7f79a0133f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:31.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 -- 172.21.15.63:0/2946552493 >> 172.21.15.63:0/2946552493 conn(0x7f79a00a8a70 msgr2=0x7f79a00a6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:31.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 -- 172.21.15.63:0/2946552493 shutdown_connections 2023-12-01T16:01:31.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.030+0000 7f79a56d4700 1 -- 172.21.15.63:0/2946552493 wait complete. 2023-12-01T16:01:31.063 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-01T16:01:31.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.174+0000 7f4eb21d7700 1 Processor -- start 2023-12-01T16:01:31.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.174+0000 7f4eb21d7700 1 -- start start 2023-12-01T16:01:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4eac1347d0 0x7f4eac06e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4eac134bb0 0x7f4eac137630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eac134610 con 0x7f4eac137b70 2023-12-01T16:01:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac070010 con 0x7f4eac1347d0 2023-12-01T16:01:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac06f360 con 0x7f4eac134bb0 2023-12-01T16:01:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb19d6700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4eac137b70 0x7f4eac13e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48404/0 (socket says 172.21.15.63:48404) 2023-12-01T16:01:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb11d5700 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4eac1347d0 0x7f4eac06e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb19d6700 1 -- 172.21.15.63:0/1822111334 learned_addr learned my addr 172.21.15.63:0/1822111334 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T16:01:31.196 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb09d4700 1 --2- 172.21.15.63:0/1822111334 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4eac134bb0 0x7f4eac137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:31.196 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb11d5700 1 -- 172.21.15.63:0/1822111334 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4eac134bb0 msgr2=0x7f4eac137630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:31.196 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb11d5700 1 --2- 172.21.15.63:0/1822111334 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4eac134bb0 0x7f4eac137630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb11d5700 1 -- 172.21.15.63:0/1822111334 >> v1:172.21.15.63:6789/0 conn(0x7f4eac137b70 legacy=0x7f4eac13e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb11d5700 1 -- 172.21.15.63:0/1822111334 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac06db00 con 0x7f4eac1347d0 2023-12-01T16:01:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4ea3fff700 1 -- 172.21.15.63:0/1822111334 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085035974 0 0) 0x7f4eac134610 con 0x7f4eac137b70 2023-12-01T16:01:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb11d5700 1 --2- 172.21.15.63:0/1822111334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac1347d0 0x7f4eac06e880 secure :-1 s=READY pgs=2987 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009880 tx=0x7f4ea8009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d6b54c76da4f9c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4ea3fff700 1 -- 172.21.15.63:0/1822111334 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8011830 con 0x7f4eac1347d0 2023-12-01T16:01:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4ea3fff700 1 -- 172.21.15.63:0/1822111334 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4ea8011990 con 0x7f4eac1347d0 2023-12-01T16:01:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4ea3fff700 1 -- 172.21.15.63:0/1822111334 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8011d40 con 0x7f4eac1347d0 2023-12-01T16:01:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 -- 172.21.15.63:0/1822111334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac1347d0 msgr2=0x7f4eac06e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 --2- 172.21.15.63:0/1822111334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac1347d0 0x7f4eac06e880 secure :-1 s=READY pgs=2987 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009880 tx=0x7f4ea8009b90 comp rx=0 tx=0).stop 2023-12-01T16:01:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 -- 172.21.15.63:0/1822111334 shutdown_connections 2023-12-01T16:01:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 --2- 172.21.15.63:0/1822111334 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4eac134bb0 0x7f4eac137630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 --2- 172.21.15.63:0/1822111334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac1347d0 0x7f4eac06e880 unknown :-1 s=CLOSED pgs=2987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 -- 172.21.15.63:0/1822111334 >> 172.21.15.63:0/1822111334 conn(0x7f4eac0a96b0 msgr2=0x7f4eac0a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 -- 172.21.15.63:0/1822111334 shutdown_connections 2023-12-01T16:01:31.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.178+0000 7f4eb21d7700 1 -- 172.21.15.63:0/1822111334 wait complete. 2023-12-01T16:01:31.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb21d7700 1 Processor -- start 2023-12-01T16:01:31.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb21d7700 1 -- start start 2023-12-01T16:01:31.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb21d7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac1347d0 0x7f4eac0a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:31.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb21d7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4eac134bb0 0x7f4eac0a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:31.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb21d7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4eac137b70 0x7f4eac0a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:31.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb21d7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0a2150 con 0x7f4eac1347d0 2023-12-01T16:01:31.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb21d7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0a6440 con 0x7f4eac134bb0 2023-12-01T16:01:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb21d7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0a1f20 con 0x7f4eac137b70 2023-12-01T16:01:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb11d5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac1347d0 0x7f4eac0a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb11d5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac1347d0 0x7f4eac0a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45366/0 (socket says 172.21.15.63:45366) 2023-12-01T16:01:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb11d5700 1 -- 172.21.15.63:0/2198630901 learned_addr learned my addr 172.21.15.63:0/2198630901 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:01:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb09d4700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4eac134bb0 0x7f4eac0a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb19d6700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4eac137b70 0x7f4eac0a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:31.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb11d5700 1 -- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4eac137b70 msgr2=0x7f4eac0a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:31.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb11d5700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4eac137b70 0x7f4eac0a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:31.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb11d5700 1 -- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4eac134bb0 msgr2=0x7f4eac0a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:31.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb11d5700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4eac134bb0 0x7f4eac0a0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:31.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb11d5700 1 -- 172.21.15.63:0/2198630901 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80094b0 con 0x7f4eac1347d0 2023-12-01T16:01:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb11d5700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac1347d0 0x7f4eac0a01e0 secure :-1 s=READY pgs=2988 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8014040 tx=0x7f4ea8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4ea1ffb700 1 -- 172.21.15.63:0/2198630901 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80036c0 con 0x7f4eac1347d0 2023-12-01T16:01:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4ea1ffb700 1 -- 172.21.15.63:0/2198630901 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4ea801e070 con 0x7f4eac1347d0 2023-12-01T16:01:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb21d7700 1 -- 172.21.15.63:0/2198630901 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac0a2b20 con 0x7f4eac1347d0 2023-12-01T16:01:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4ea1ffb700 1 -- 172.21.15.63:0/2198630901 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8003a80 con 0x7f4eac1347d0 2023-12-01T16:01:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.182+0000 7f4eb21d7700 1 -- 172.21.15.63:0/2198630901 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac0a2de0 con 0x7f4eac1347d0 2023-12-01T16:01:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.186+0000 7f4eb21d7700 1 -- 172.21.15.63:0/2198630901 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eac065fb0 con 0x7f4eac1347d0 2023-12-01T16:01:31.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.186+0000 7f4ea1ffb700 1 -- 172.21.15.63:0/2198630901 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4ea8003be0 con 0x7f4eac1347d0 2023-12-01T16:01:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.186+0000 7f4ea1ffb700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4e90065ad0 0x7f4e90067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:31.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.186+0000 7f4ea1ffb700 1 -- 172.21.15.63:0/2198630901 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4449+0+0 (secure 0 0 0) 0x7f4ea8020070 con 0x7f4eac1347d0 2023-12-01T16:01:31.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.186+0000 7f4eb09d4700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4e90065ad0 0x7f4e90067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.190+0000 7f4eb09d4700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4e90065ad0 0x7f4e90067f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4eac06afa0 tx=0x7f4e9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.194+0000 7f4ea1ffb700 1 -- 172.21.15.63:0/2198630901 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f4ea80b5070 con 0x7f4eac1347d0 2023-12-01T16:01:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:31.362+0000 7f4eb21d7700 1 -- 172.21.15.63:0/2198630901 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4eac061d90 con 0x7f4eac1347d0 2023-12-01T16:01:32.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.042+0000 7f4ea1ffb700 1 -- 172.21.15.63:0/2198630901 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4ea80150d0 con 0x7f4eac1347d0 2023-12-01T16:01:32.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.050+0000 7f4eb21d7700 1 -- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4e90065ad0 msgr2=0x7f4e90067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:32.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.050+0000 7f4eb21d7700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4e90065ad0 0x7f4e90067f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4eac06afa0 tx=0x7f4e9c008040 comp rx=0 tx=0).stop 2023-12-01T16:01:32.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.050+0000 7f4eb21d7700 1 -- 172.21.15.63:0/2198630901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac1347d0 msgr2=0x7f4eac0a01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:32.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.050+0000 7f4eb21d7700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac1347d0 0x7f4eac0a01e0 secure :-1 s=READY pgs=2988 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8014040 tx=0x7f4ea8004770 comp rx=0 tx=0).stop 2023-12-01T16:01:32.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.062+0000 7f4eb21d7700 1 -- 172.21.15.63:0/2198630901 shutdown_connections 2023-12-01T16:01:32.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.062+0000 7f4eb21d7700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7f4e90065ad0 0x7f4e90067f90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:32.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.062+0000 7f4eb21d7700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4eac137b70 0x7f4eac0a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:32.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.062+0000 7f4eb21d7700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4eac134bb0 0x7f4eac0a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:32.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.062+0000 7f4eb21d7700 1 --2- 172.21.15.63:0/2198630901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac1347d0 0x7f4eac0a01e0 unknown :-1 s=CLOSED pgs=2988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:32.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.062+0000 7f4eb21d7700 1 -- 172.21.15.63:0/2198630901 >> 172.21.15.63:0/2198630901 conn(0x7f4eac0a96b0 msgr2=0x7f4eac1bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:32.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.062+0000 7f4eb21d7700 1 -- 172.21.15.63:0/2198630901 shutdown_connections 2023-12-01T16:01:32.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.062+0000 7f4eb21d7700 1 -- 172.21.15.63:0/2198630901 wait complete. 2023-12-01T16:01:32.076 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2023-12-01T16:01:32.096 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-01T16:01:32.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 Processor -- start 2023-12-01T16:01:32.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 -- start start 2023-12-01T16:01:32.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e01343b0 0x7fb9e00a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:32.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb9e0134790 0x7fb9e0069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:32.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e00a7dc0 con 0x7fb9e006a400 2023-12-01T16:01:32.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e0071f10 con 0x7fb9e0134790 2023-12-01T16:01:32.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00a80a0 con 0x7fb9e01343b0 2023-12-01T16:01:32.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e555a700 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb9e006a400 0x7fb9e0141ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:48408/0 (socket says 172.21.15.63:48408) 2023-12-01T16:01:32.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e555a700 1 -- 172.21.15.63:0/2855639087 learned_addr learned my addr 172.21.15.63:0/2855639087 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-01T16:01:32.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e4d59700 1 --2- 172.21.15.63:0/2855639087 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e01343b0 0x7fb9e00a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:32.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9dffff700 1 --2- 172.21.15.63:0/2855639087 >> v2:172.21.15.66:3300/0 conn(0x7fb9e0134790 0x7fb9e0069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:32.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e4d59700 1 -- 172.21.15.63:0/2855639087 >> v2:172.21.15.66:3300/0 conn(0x7fb9e0134790 msgr2=0x7fb9e0069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T16:01:32.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9df7fe700 1 -- 172.21.15.63:0/2855639087 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078098009 0 0) 0x7fb9e00a7dc0 con 0x7fb9e006a400 2023-12-01T16:01:32.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e4d59700 1 --2- 172.21.15.63:0/2855639087 >> v2:172.21.15.66:3300/0 conn(0x7fb9e0134790 0x7fb9e0069ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:32.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e4d59700 1 -- 172.21.15.63:0/2855639087 >> v1:172.21.15.63:6789/0 conn(0x7fb9e006a400 legacy=0x7fb9e0141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:32.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e4d59700 1 -- 172.21.15.63:0/2855639087 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e0134b90 con 0x7fb9e01343b0 2023-12-01T16:01:32.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9dffff700 1 --2- 172.21.15.63:0/2855639087 >> v2:172.21.15.66:3300/0 conn(0x7fb9e0134790 0x7fb9e0069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T16:01:32.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e4d59700 1 --2- 172.21.15.63:0/2855639087 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e01343b0 0x7fb9e00a74a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009850 tx=0x7fb9d0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=851d8f889b00ab0b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:32.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9df7fe700 1 -- 172.21.15.63:0/2855639087 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0011830 con 0x7fb9e01343b0 2023-12-01T16:01:32.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9df7fe700 1 -- 172.21.15.63:0/2855639087 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb9d0011990 con 0x7fb9e01343b0 2023-12-01T16:01:32.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9df7fe700 1 -- 172.21.15.63:0/2855639087 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0011d60 con 0x7fb9e01343b0 2023-12-01T16:01:32.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/2855639087 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e01343b0 msgr2=0x7fb9e00a74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:32.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 --2- 172.21.15.63:0/2855639087 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e01343b0 0x7fb9e00a74a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009850 tx=0x7fb9d0009b60 comp rx=0 tx=0).stop 2023-12-01T16:01:32.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/2855639087 shutdown_connections 2023-12-01T16:01:32.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 --2- 172.21.15.63:0/2855639087 >> v2:172.21.15.66:3300/0 conn(0x7fb9e0134790 0x7fb9e0069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:32.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 --2- 172.21.15.63:0/2855639087 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e01343b0 0x7fb9e00a74a0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:32.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/2855639087 >> 172.21.15.63:0/2855639087 conn(0x7fb9e00a9580 msgr2=0x7fb9e00a9960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:32.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/2855639087 shutdown_connections 2023-12-01T16:01:32.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/2855639087 wait complete. 2023-12-01T16:01:32.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.206+0000 7fb9e5d5b700 1 Processor -- start 2023-12-01T16:01:32.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e5d5b700 1 -- start start 2023-12-01T16:01:32.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e5d5b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e006a400 0x7fb9e01cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:32.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e5d5b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e01343b0 0x7fb9e01cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:32.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e5d5b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0134790 0x7fb9e01d0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:32.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e5d5b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00a1ea0 con 0x7fb9e0134790 2023-12-01T16:01:32.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e5d5b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e0139960 con 0x7fb9e01343b0 2023-12-01T16:01:32.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e5d5b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00a8830 con 0x7fb9e006a400 2023-12-01T16:01:32.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e555a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0134790 0x7fb9e01d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:32.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e4d59700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e006a400 0x7fb9e01cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:32.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e555a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0134790 0x7fb9e01d0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45370/0 (socket says 172.21.15.63:45370) 2023-12-01T16:01:32.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9dffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e01343b0 0x7fb9e01cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e555a700 1 -- 172.21.15.63:0/1498575280 learned_addr learned my addr 172.21.15.63:0/1498575280 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-01T16:01:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e4d59700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e006a400 0x7fb9e01cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:48260/0 (socket says 172.21.15.63:48260) 2023-12-01T16:01:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e4d59700 1 -- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e01343b0 msgr2=0x7fb9e01cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e4d59700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e01343b0 0x7fb9e01cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e4d59700 1 -- 172.21.15.63:0/1498575280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0134790 msgr2=0x7fb9e01d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e4d59700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0134790 0x7fb9e01d0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e4d59700 1 -- 172.21.15.63:0/1498575280 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c80094b0 con 0x7fb9e006a400 2023-12-01T16:01:32.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e4d59700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e006a400 0x7fb9e01cf710 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0016000 tx=0x7fb9d0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9dd7fa700 1 -- 172.21.15.63:0/1498575280 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d00044d0 con 0x7fb9e006a400 2023-12-01T16:01:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9dd7fa700 1 -- 172.21.15.63:0/1498575280 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb9d001f070 con 0x7fb9e006a400 2023-12-01T16:01:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9dd7fa700 1 -- 172.21.15.63:0/1498575280 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0003920 con 0x7fb9e006a400 2023-12-01T16:01:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/1498575280 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d00094b0 con 0x7fb9e006a400 2023-12-01T16:01:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/1498575280 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e0071ce0 con 0x7fb9e006a400 2023-12-01T16:01:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/1498575280 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e0139410 con 0x7fb9e006a400 2023-12-01T16:01:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.210+0000 7fb9dd7fa700 1 -- 172.21.15.63:0/1498575280 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 6) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb9d0003a80 con 0x7fb9e006a400 2023-12-01T16:01:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.214+0000 7fb9dd7fa700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb9c0065ad0 0x7fb9c0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T16:01:32.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.214+0000 7fb9dd7fa700 1 -- 172.21.15.63:0/1498575280 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4011+0+0 (secure 0 0 0) 0x7fb9d0021070 con 0x7fb9e006a400 2023-12-01T16:01:32.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.214+0000 7fb9dffff700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb9c0065ad0 0x7fb9c0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T16:01:32.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.214+0000 7fb9dffff700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb9c0065ad0 0x7fb9c0067f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00a39a0 tx=0x7fb9c8009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T16:01:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.222+0000 7fb9dd7fa700 1 -- 172.21.15.63:0/1498575280 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb9d0052720 con 0x7fb9e006a400 2023-12-01T16:01:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:32.386+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/1498575280 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9e0065fb0 con 0x7fb9e006a400 2023-12-01T16:01:33.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.062+0000 7fb9dd7fa700 1 -- 172.21.15.63:0/1498575280 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb9d0055d40 con 0x7fb9e006a400 2023-12-01T16:01:33.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.062+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb9c0065ad0 msgr2=0x7fb9c0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:33.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.062+0000 7fb9e5d5b700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb9c0065ad0 0x7fb9c0067f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00a39a0 tx=0x7fb9c8009240 comp rx=0 tx=0).stop 2023-12-01T16:01:33.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.062+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e006a400 msgr2=0x7fb9e01cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T16:01:33.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.062+0000 7fb9e5d5b700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e006a400 0x7fb9e01cf710 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0016000 tx=0x7fb9d0004770 comp rx=0 tx=0).stop 2023-12-01T16:01:33.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.066+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/1498575280 shutdown_connections 2023-12-01T16:01:33.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.066+0000 7fb9e5d5b700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:6816/29681,v1:172.21.15.66:6817/29681] conn(0x7fb9c0065ad0 0x7fb9c0067f90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:33.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.066+0000 7fb9e5d5b700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e0134790 0x7fb9e01d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:33.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.066+0000 7fb9e5d5b700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e01343b0 0x7fb9e01cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:33.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.066+0000 7fb9e5d5b700 1 --2- 172.21.15.63:0/1498575280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9e006a400 0x7fb9e01cf710 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T16:01:33.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.066+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/1498575280 >> 172.21.15.63:0/1498575280 conn(0x7fb9e00a9580 msgr2=0x7fb9e00a5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T16:01:33.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.066+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/1498575280 shutdown_connections 2023-12-01T16:01:33.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-01T16:01:33.066+0000 7fb9e5d5b700 1 -- 172.21.15.63:0/1498575280 wait complete. 2023-12-01T16:01:33.080 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2023-12-01T16:01:33.092 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-01T16:01:33.092 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-01T16:01:33.092 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T16:01:33.104 INFO:tasks.ceph.mds.a:Stopped 2023-12-01T16:01:33.105 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-01T16:01:33.105 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T16:01:33.120 INFO:tasks.ceph.mds.b:Stopped 2023-12-01T16:01:33.120 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-01T16:01:33.121 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-01T16:01:33.121 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T16:01:34.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-01T16:01:39.223 INFO:tasks.ceph.osd.0:Stopped 2023-12-01T16:01:39.223 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-01T16:01:39.223 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T16:01:39.304 INFO:tasks.ceph.osd.1:Stopped 2023-12-01T16:01:39.305 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-01T16:01:39.305 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T16:01:40.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-01T16:01:40.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-01T16:01:45.407 INFO:tasks.ceph.osd.2:Stopped 2023-12-01T16:01:45.407 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-01T16:01:45.407 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T16:01:45.507 INFO:tasks.ceph.osd.3:Stopped 2023-12-01T16:01:45.508 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-01T16:01:45.508 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-01T16:01:45.508 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T16:01:45.541 INFO:tasks.ceph.mgr.x:Stopped 2023-12-01T16:01:45.541 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-01T16:01:45.542 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T16:01:45.572 INFO:tasks.ceph.mgr.y:Stopped 2023-12-01T16:01:45.572 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-01T16:01:45.573 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-01T16:01:45.573 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T16:01:45.604 INFO:tasks.ceph.mon.a:Stopped 2023-12-01T16:01:45.604 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-01T16:01:45.605 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T16:01:45.624 INFO:tasks.ceph.mon.b:Stopped 2023-12-01T16:01:45.624 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-01T16:01:45.624 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T16:01:45.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2023-12-01T16:01:45.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-12-01T16:01:45.641 INFO:tasks.ceph.mon.c:Stopped 2023-12-01T16:01:45.642 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-01T16:01:45.642 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-12-01T16:01:45.662 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi063.front.sepia.ceph.com 2023-12-01T16:01:45.662 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-01T16:01:46.149 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi063.front.sepia.ceph.com 2023-12-01T16:01:46.149 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-01T16:01:46.495 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi066.front.sepia.ceph.com 2023-12-01T16:01:46.495 DEBUG:teuthology.orchestra.run.smithi066:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-01T16:01:46.981 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi066.front.sepia.ceph.com 2023-12-01T16:01:46.981 DEBUG:teuthology.orchestra.run.smithi066:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-01T16:01:47.191 INFO:tasks.ceph:Archiving mon data... 2023-12-01T16:01:47.193 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/data/mon.a.tgz 2023-12-01T16:01:47.193 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2023-12-01T16:01:47.200 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.E7DtAv8Ywa 2023-12-01T16:01:47.200 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.E7DtAv8Ywa 2023-12-01T16:01:47.280 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.E7DtAv8Ywa 2023-12-01T16:01:47.305 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.E7DtAv8Ywa is 292KB 2023-12-01T16:01:47.369 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.E7DtAv8Ywa 2023-12-01T16:01:47.376 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/data/mon.b.tgz 2023-12-01T16:01:47.377 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2023-12-01T16:01:47.384 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.rpKLiTPJHb 2023-12-01T16:01:47.384 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.rpKLiTPJHb 2023-12-01T16:01:47.506 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.rpKLiTPJHb 2023-12-01T16:01:47.534 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.rpKLiTPJHb is 300KB 2023-12-01T16:01:47.594 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.rpKLiTPJHb 2023-12-01T16:01:47.601 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/data/mon.c.tgz 2023-12-01T16:01:47.601 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2023-12-01T16:01:47.608 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.BGnDyd9JJZ 2023-12-01T16:01:47.608 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.BGnDyd9JJZ 2023-12-01T16:01:47.688 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.BGnDyd9JJZ 2023-12-01T16:01:47.711 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.BGnDyd9JJZ is 300KB 2023-12-01T16:01:47.774 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.BGnDyd9JJZ 2023-12-01T16:01:47.781 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-01T16:01:47.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-01T16:01:47.784 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-01T16:01:47.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-01T16:01:47.803 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-01T16:01:47.803 DEBUG:teuthology.orchestra.run.smithi063:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-01T16:01:47.807 DEBUG:teuthology.orchestra.run.smithi066:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-01T16:01:47.830 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-01T16:01:47.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-01T16:01:47.871 INFO:teuthology.orchestra.run.smithi066.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-01T16:01:47.881 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-01T16:01:47.883 INFO:tasks.ceph:Archiving crash dumps... 2023-12-01T16:01:47.885 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/remote/smithi063/crash 2023-12-01T16:01:47.886 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-01T16:01:47.902 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/remote/smithi066/crash 2023-12-01T16:01:47.903 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-01T16:01:47.919 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/remote/smithi146/crash 2023-12-01T16:01:47.920 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-01T16:01:47.937 INFO:tasks.ceph:Shutting down logrotate 2023-12-01T16:01:47.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:01:47.940 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:01:47.942 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T16:01:48.021 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-01T16:01:48.041 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-01T16:01:48.058 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-01T16:01:48.075 INFO:tasks.ceph:Compressing logs... 2023-12-01T16:01:48.075 DEBUG:teuthology.orchestra.run.smithi063:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T16:01:48.078 DEBUG:teuthology.orchestra.run.smithi066:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T16:01:48.080 DEBUG:teuthology.orchestra.run.smithi146:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T16:01:50.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-12-01T16:01:50.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-12-01T16:03:22.232 INFO:tasks.ceph:Archiving logs... 2023-12-01T16:03:22.233 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/remote/smithi063/log 2023-12-01T16:03:22.234 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-01T16:03:33.598 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/remote/smithi066/log 2023-12-01T16:03:33.599 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-01T16:03:58.830 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/remote/smithi146/log 2023-12-01T16:03:58.831 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-01T16:04:02.859 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-01T16:04:02.870 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-01T16:04:02.870 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-01T16:04:02.873 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-01T16:04:02.875 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-01T16:04:02.933 INFO:teuthology.task.install.deb:Removing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on Debian system. 2023-12-01T16:04:02.933 DEBUG:teuthology.orchestra.run.smithi063:> for d in ceph cephadm ceph-mds ceph-mgr ceph-common ceph-fuse ceph-test ceph-volume radosgw python3-rados python3-rgw python3-cephfs python3-rbd libcephfs2 libcephfs-dev librados2 librbd1 rbd-fuse ; do sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" purge $d || true ; done 2023-12-01T16:04:02.957 INFO:teuthology.task.install.deb:Removing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on Debian system. 2023-12-01T16:04:02.957 DEBUG:teuthology.orchestra.run.smithi066:> for d in ceph cephadm ceph-mds ceph-mgr ceph-common ceph-fuse ceph-test ceph-volume radosgw python3-rados python3-rgw python3-cephfs python3-rbd libcephfs2 libcephfs-dev librados2 librbd1 rbd-fuse ; do sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" purge $d || true ; done 2023-12-01T16:04:02.980 INFO:teuthology.task.install.deb:Removing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on Debian system. 2023-12-01T16:04:02.980 DEBUG:teuthology.orchestra.run.smithi146:> for d in ceph cephadm ceph-mds ceph-mgr ceph-common ceph-fuse ceph-test ceph-volume radosgw python3-rados python3-rgw python3-cephfs python3-rbd libcephfs2 libcephfs-dev librados2 librbd1 rbd-fuse ; do sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" purge $d || true ; done 2023-12-01T16:04:03.013 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:03.038 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:03.057 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:03.229 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:03.230 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:03.251 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:03.251 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:03.264 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:03.265 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:03.411 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:03.412 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-01T16:04:03.412 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:03.437 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:03.442 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-01T16:04:03.443 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:03.443 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2023-12-01T16:04:03.443 INFO:teuthology.orchestra.run.smithi063.stdout: ceph* 2023-12-01T16:04:03.445 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:03.446 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-01T16:04:03.446 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:03.466 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be REMOVED: 2023-12-01T16:04:03.467 INFO:teuthology.orchestra.run.smithi146.stdout: ceph* 2023-12-01T16:04:03.473 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be REMOVED: 2023-12-01T16:04:03.474 INFO:teuthology.orchestra.run.smithi066.stdout: ceph* 2023-12-01T16:04:03.820 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:03.820 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 47.1 kB disk space will be freed. 2023-12-01T16:04:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 47.1 kB disk space will be freed. 2023-12-01T16:04:03.900 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:03.901 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 47.1 kB disk space will be freed. 2023-12-01T16:04:03.944 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152706 files and directories currently installed.) 2023-12-01T16:04:03.949 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152706 files and directories currently installed.) 2023-12-01T16:04:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:04.325 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152706 files and directories currently installed.) 2023-12-01T16:04:04.330 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:04.828 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:04.893 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:04.929 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:04.998 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:05.078 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:05.079 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:05.207 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:05.208 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:05.249 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:05.250 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon libboost-iostreams1.71.0 libboost-thread1.71.0 python-asyncssh-doc 2023-12-01T16:04:05.251 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-jinja2 2023-12-01T16:04:05.251 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:05.265 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:05.290 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be REMOVED: 2023-12-01T16:04:05.291 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm* cephadm* 2023-12-01T16:04:05.335 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:05.429 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:05.430 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon libboost-iostreams1.71.0 libboost-thread1.71.0 python-asyncssh-doc 2023-12-01T16:04:05.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-jinja2 2023-12-01T16:04:05.430 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:05.475 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2023-12-01T16:04:05.476 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm* cephadm* 2023-12-01T16:04:05.547 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:05.547 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:05.646 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 2 to remove and 259 not upgraded. 2023-12-01T16:04:05.646 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 1,057 kB disk space will be freed. 2023-12-01T16:04:05.763 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152704 files and directories currently installed.) 2023-12-01T16:04:05.768 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:05.773 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:05.774 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon libboost-iostreams1.71.0 libboost-thread1.71.0 python-asyncssh-doc 2023-12-01T16:04:05.774 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-jinja2 2023-12-01T16:04:05.775 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:05.814 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be REMOVED: 2023-12-01T16:04:05.815 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm* cephadm* 2023-12-01T16:04:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 2 to remove and 259 not upgraded. 2023-12-01T16:04:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 1,057 kB disk space will be freed. 2023-12-01T16:04:05.965 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152704 files and directories currently installed.) 2023-12-01T16:04:05.970 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:06.172 INFO:teuthology.orchestra.run.smithi146.stdout:Removing cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:06.188 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 2 to remove and 259 not upgraded. 2023-12-01T16:04:06.188 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 1,057 kB disk space will be freed. 2023-12-01T16:04:06.202 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-cephadm, directory '/usr/share/ceph/mgr/cephadm/services' not empty so not removed 2023-12-01T16:04:06.301 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152704 files and directories currently installed.) 2023-12-01T16:04:06.305 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:06.387 INFO:teuthology.orchestra.run.smithi063.stdout:Removing cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:06.406 INFO:teuthology.orchestra.run.smithi146.stdout:Looking for files to backup/remove ... 2023-12-01T16:04:06.410 INFO:teuthology.orchestra.run.smithi146.stdout:Removing files ... 2023-12-01T16:04:06.416 INFO:teuthology.orchestra.run.smithi146.stdout:Removing user `cephadm' ... 2023-12-01T16:04:06.417 INFO:teuthology.orchestra.run.smithi146.stdout:Warning: group `nogroup' has no more members. 2023-12-01T16:04:06.546 INFO:teuthology.orchestra.run.smithi146.stdout:Done. 2023-12-01T16:04:06.711 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-cephadm, directory '/usr/share/ceph/mgr/cephadm/services' not empty so not removed 2023-12-01T16:04:06.760 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:06.795 INFO:teuthology.orchestra.run.smithi063.stdout:Looking for files to backup/remove ... 2023-12-01T16:04:06.799 INFO:teuthology.orchestra.run.smithi063.stdout:Removing files ... 2023-12-01T16:04:06.812 INFO:teuthology.orchestra.run.smithi063.stdout:Removing user `cephadm' ... 2023-12-01T16:04:06.813 INFO:teuthology.orchestra.run.smithi063.stdout:Warning: group `nogroup' has no more members. 2023-12-01T16:04:06.898 INFO:teuthology.orchestra.run.smithi066.stdout:Removing cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:06.936 INFO:teuthology.orchestra.run.smithi063.stdout:Done. 2023-12-01T16:04:07.149 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:07.175 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152634 files and directories currently installed.) 2023-12-01T16:04:07.179 INFO:teuthology.orchestra.run.smithi146.stdout:Purging configuration files for cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:07.191 INFO:teuthology.orchestra.run.smithi066.stdout:Looking for files to backup/remove ... 2023-12-01T16:04:07.195 INFO:teuthology.orchestra.run.smithi066.stdout:Removing files ... 2023-12-01T16:04:07.201 INFO:teuthology.orchestra.run.smithi066.stdout:Removing user `cephadm' ... 2023-12-01T16:04:07.201 INFO:teuthology.orchestra.run.smithi066.stdout:Warning: group `nogroup' has no more members. 2023-12-01T16:04:07.366 INFO:teuthology.orchestra.run.smithi066.stdout:Done. 2023-12-01T16:04:07.574 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:07.589 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152634 files and directories currently installed.) 2023-12-01T16:04:07.593 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:07.968 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:08.030 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152634 files and directories currently installed.) 2023-12-01T16:04:08.035 INFO:teuthology.orchestra.run.smithi066.stdout:Purging configuration files for cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:08.173 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:08.173 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:08.321 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:08.354 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:08.359 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon libboost-iostreams1.71.0 libboost-thread1.71.0 python-asyncssh-doc 2023-12-01T16:04:08.360 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-jinja2 2023-12-01T16:04:08.361 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:08.380 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be REMOVED: 2023-12-01T16:04:08.381 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds* 2023-12-01T16:04:08.392 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:08.603 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:08.604 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:08.746 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:08.746 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 7,985 kB disk space will be freed. 2023-12-01T16:04:08.815 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:08.821 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon libboost-iostreams1.71.0 libboost-thread1.71.0 python-asyncssh-doc 2023-12-01T16:04:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-jinja2 2023-12-01T16:04:08.824 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:08.850 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2023-12-01T16:04:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds* 2023-12-01T16:04:08.862 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152634 files and directories currently installed.) 2023-12-01T16:04:08.866 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:08.889 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:09.101 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:09.102 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:09.228 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:09.228 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 7,985 kB disk space will be freed. 2023-12-01T16:04:09.331 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:09.333 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon libboost-iostreams1.71.0 libboost-thread1.71.0 python-asyncssh-doc 2023-12-01T16:04:09.333 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-jinja2 2023-12-01T16:04:09.333 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:09.359 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be REMOVED: 2023-12-01T16:04:09.361 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds* 2023-12-01T16:04:09.463 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152634 files and directories currently installed.) 2023-12-01T16:04:09.467 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:09.736 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:09.736 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 7,985 kB disk space will be freed. 2023-12-01T16:04:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:09.906 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152634 files and directories currently installed.) 2023-12-01T16:04:09.911 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:10.283 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152626 files and directories currently installed.) 2023-12-01T16:04:10.288 INFO:teuthology.orchestra.run.smithi146.stdout:Purging configuration files for ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:10.602 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:11.034 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152627 files and directories currently installed.) 2023-12-01T16:04:11.038 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:11.122 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:11.577 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152627 files and directories currently installed.) 2023-12-01T16:04:11.581 INFO:teuthology.orchestra.run.smithi066.stdout:Purging configuration files for ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:11.755 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:11.960 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:11.967 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mds, directory '/var/lib/ceph/mds' not empty so not removed 2023-12-01T16:04:12.155 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:12.155 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core ceph-mon fonts-mathjax libboost-iostreams1.71.0 2023-12-01T16:04:12.156 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:12.156 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:12.157 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:12.157 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-cherrypy3 python3-google-auth python3-html5lib 2023-12-01T16:04:12.157 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-12-01T16:04:12.158 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-12-01T16:04:12.158 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort python3-oauthlib python3-paste python3-pastedeploy 2023-12-01T16:04:12.159 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pastescript python3-pecan python3-psutil python3-pyasn1 2023-12-01T16:04:12.159 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules python3-pyinotify python3-repoze.lru 2023-12-01T16:04:12.159 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-01T16:04:12.160 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-01T16:04:12.160 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-12-01T16:04:12.161 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2023-12-01T16:04:12.161 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug 2023-12-01T16:04:12.162 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:12.216 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be REMOVED: 2023-12-01T16:04:12.217 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr* ceph-mgr-dashboard* ceph-mgr-diskprediction-local* 2023-12-01T16:04:12.218 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-k8sevents* 2023-12-01T16:04:12.484 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:12.556 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:12.586 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 4 to remove and 259 not upgraded. 2023-12-01T16:04:12.586 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 82.5 MB disk space will be freed. 2023-12-01T16:04:12.693 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mds, directory '/var/lib/ceph/mds' not empty so not removed 2023-12-01T16:04:12.701 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152626 files and directories currently installed.) 2023-12-01T16:04:12.706 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:12.766 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:12.767 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:12.955 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:12.955 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core ceph-mon fonts-mathjax libboost-iostreams1.71.0 2023-12-01T16:04:12.956 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:12.956 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:12.956 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:12.957 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-cherrypy3 python3-google-auth python3-html5lib 2023-12-01T16:04:12.957 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-12-01T16:04:12.957 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-12-01T16:04:12.957 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort python3-oauthlib python3-paste python3-pastedeploy 2023-12-01T16:04:12.957 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pastescript python3-pecan python3-psutil python3-pyasn1 2023-12-01T16:04:12.958 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules python3-pyinotify python3-repoze.lru 2023-12-01T16:04:12.958 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-01T16:04:12.958 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-01T16:04:12.959 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-12-01T16:04:12.959 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2023-12-01T16:04:12.959 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug 2023-12-01T16:04:12.959 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:13.015 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2023-12-01T16:04:13.015 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr* ceph-mgr-dashboard* ceph-mgr-diskprediction-local* 2023-12-01T16:04:13.016 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-k8sevents* 2023-12-01T16:04:13.077 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:13.241 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:13.311 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:13.391 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 4 to remove and 259 not upgraded. 2023-12-01T16:04:13.391 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 82.5 MB disk space will be freed. 2023-12-01T16:04:13.508 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152626 files and directories currently installed.) 2023-12-01T16:04:13.513 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:13.522 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:13.523 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:13.532 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:13.735 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:13.736 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core ceph-mon fonts-mathjax libboost-iostreams1.71.0 2023-12-01T16:04:13.736 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:13.736 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:13.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:13.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-cherrypy3 python3-google-auth python3-html5lib 2023-12-01T16:04:13.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-12-01T16:04:13.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-12-01T16:04:13.736 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort python3-oauthlib python3-paste python3-pastedeploy 2023-12-01T16:04:13.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pastescript python3-pecan python3-psutil python3-pyasn1 2023-12-01T16:04:13.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules python3-pyinotify python3-repoze.lru 2023-12-01T16:04:13.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-01T16:04:13.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-01T16:04:13.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-12-01T16:04:13.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2023-12-01T16:04:13.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug 2023-12-01T16:04:13.737 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:13.803 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be REMOVED: 2023-12-01T16:04:13.803 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr* ceph-mgr-dashboard* ceph-mgr-diskprediction-local* 2023-12-01T16:04:13.804 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-k8sevents* 2023-12-01T16:04:13.925 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:13.938 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:14.168 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-diskprediction-local, directory '/usr/share/ceph/mgr/diskprediction_local' not empty so not removed 2023-12-01T16:04:14.176 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 4 to remove and 259 not upgraded. 2023-12-01T16:04:14.176 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 82.5 MB disk space will be freed. 2023-12-01T16:04:14.398 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:14.410 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152626 files and directories currently installed.) 2023-12-01T16:04:14.415 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:14.647 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/services' not empty so not removed 2023-12-01T16:04:14.647 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/plugins' not empty so not removed 2023-12-01T16:04:14.647 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/controllers' not empty so not removed 2023-12-01T16:04:14.647 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/api' not empty so not removed 2023-12-01T16:04:14.832 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:14.851 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:15.135 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-diskprediction-local, directory '/usr/share/ceph/mgr/diskprediction_local' not empty so not removed 2023-12-01T16:04:15.159 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152374 files and directories currently installed.) 2023-12-01T16:04:15.163 INFO:teuthology.orchestra.run.smithi146.stdout:Purging configuration files for ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:15.363 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:15.639 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/services' not empty so not removed 2023-12-01T16:04:15.640 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/plugins' not empty so not removed 2023-12-01T16:04:15.640 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/controllers' not empty so not removed 2023-12-01T16:04:15.640 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/api' not empty so not removed 2023-12-01T16:04:15.878 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:16.127 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152375 files and directories currently installed.) 2023-12-01T16:04:16.132 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:16.556 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:16.625 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:16.829 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:16.830 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:17.027 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:17.027 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:17.028 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:17.028 INFO:teuthology.orchestra.run.smithi146.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:17.028 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:17.029 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:17.029 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:17.029 INFO:teuthology.orchestra.run.smithi146.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:17.029 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:17.029 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:17.029 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:17.029 INFO:teuthology.orchestra.run.smithi146.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:17.030 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:17.030 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:17.030 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:17.030 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:17.030 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:17.030 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:17.031 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr, directory '/var/lib/ceph/mgr' not empty so not removed 2023-12-01T16:04:17.137 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be REMOVED: 2023-12-01T16:04:17.138 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base* ceph-common* ceph-mon* ceph-osd* ceph-test* ceph-volume* radosgw* 2023-12-01T16:04:17.214 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152375 files and directories currently installed.) 2023-12-01T16:04:17.218 INFO:teuthology.orchestra.run.smithi066.stdout:Purging configuration files for ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:17.506 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 7 to remove and 259 not upgraded. 2023-12-01T16:04:17.507 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 700 MB disk space will be freed. 2023-12-01T16:04:17.579 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:17.621 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152374 files and directories currently installed.) 2023-12-01T16:04:17.625 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:17.654 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:17.864 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:17.865 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:18.080 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:18.081 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:18.081 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:18.082 INFO:teuthology.orchestra.run.smithi063.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:18.082 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:18.082 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:18.082 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:18.082 INFO:teuthology.orchestra.run.smithi063.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:18.083 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:18.083 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:18.083 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:18.083 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:18.083 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:18.083 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:18.083 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:18.084 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:18.084 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:18.084 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:18.147 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr, directory '/var/lib/ceph/mgr' not empty so not removed 2023-12-01T16:04:18.178 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:18.179 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2023-12-01T16:04:18.180 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base* ceph-common* ceph-mon* ceph-osd* ceph-test* ceph-volume* radosgw* 2023-12-01T16:04:18.551 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 7 to remove and 259 not upgraded. 2023-12-01T16:04:18.551 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 700 MB disk space will be freed. 2023-12-01T16:04:18.667 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152374 files and directories currently installed.) 2023-12-01T16:04:18.672 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:18.708 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:18.781 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:18.993 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:18.994 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:19.190 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:19.204 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:19.213 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:19.214 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:19.214 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:19.214 INFO:teuthology.orchestra.run.smithi066.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:19.215 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:19.215 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:19.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:19.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:19.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:19.216 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:19.217 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:19.217 INFO:teuthology.orchestra.run.smithi066.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:19.217 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:19.217 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:19.218 INFO:teuthology.orchestra.run.smithi066.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:19.218 INFO:teuthology.orchestra.run.smithi066.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:19.218 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:19.218 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:19.319 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be REMOVED: 2023-12-01T16:04:19.321 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base* ceph-common* ceph-mon* ceph-osd* ceph-test* ceph-volume* radosgw* 2023-12-01T16:04:19.748 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 7 to remove and 259 not upgraded. 2023-12-01T16:04:19.748 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 700 MB disk space will be freed. 2023-12-01T16:04:19.872 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152374 files and directories currently installed.) 2023-12-01T16:04:19.877 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:20.165 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:20.251 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:20.483 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:21.178 INFO:teuthology.orchestra.run.smithi146.stdout:Removing radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:21.223 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:21.703 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:22.156 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:22.257 INFO:teuthology.orchestra.run.smithi063.stdout:Removing radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:22.575 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:22.693 INFO:teuthology.orchestra.run.smithi146.stdout:dpkg: warning: while removing ceph-common, unable to remove directory '/var/lib/ceph': Device or resource busy - directory may be a mount point? 2023-12-01T16:04:22.705 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:23.237 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:23.391 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:23.549 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:04:23.689 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:23.935 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151922 files and directories currently installed.) 2023-12-01T16:04:23.940 INFO:teuthology.orchestra.run.smithi146.stdout:Purging configuration files for radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:23.967 INFO:teuthology.orchestra.run.smithi066.stdout:Removing radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:24.541 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:24.712 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:04:25.107 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151924 files and directories currently installed.) 2023-12-01T16:04:25.112 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:25.128 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:25.191 INFO:teuthology.orchestra.run.smithi146.stdout:Purging configuration files for ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:25.591 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:26.209 INFO:teuthology.orchestra.run.smithi146.stdout:Purging configuration files for ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:26.435 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:26.602 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:26.788 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:04:27.236 INFO:teuthology.orchestra.run.smithi146.stdout:Purging configuration files for ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:27.242 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151924 files and directories currently installed.) 2023-12-01T16:04:27.247 INFO:teuthology.orchestra.run.smithi066.stdout:Purging configuration files for radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:27.335 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mon, directory '/var/lib/ceph/mon' not empty so not removed 2023-12-01T16:04:27.479 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:28.272 INFO:teuthology.orchestra.run.smithi146.stdout:dpkg: warning: while removing ceph-common, unable to remove directory '/var/lib/ceph': Device or resource busy - directory may be a mount point? 2023-12-01T16:04:28.425 INFO:teuthology.orchestra.run.smithi146.stdout:Purging configuration files for ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:28.575 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:28.671 INFO:teuthology.orchestra.run.smithi066.stdout:Purging configuration files for ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:29.506 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-01T16:04:29.629 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mon, directory '/var/lib/ceph/mon' not empty so not removed 2023-12-01T16:04:29.775 INFO:teuthology.orchestra.run.smithi066.stdout:Purging configuration files for ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:29.813 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:30.305 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:30.578 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:30.578 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:30.752 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:30.752 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:30.752 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:30.753 INFO:teuthology.orchestra.run.smithi146.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:30.753 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:30.753 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:30.754 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:30.754 INFO:teuthology.orchestra.run.smithi146.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:30.754 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:30.754 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:30.754 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:30.754 INFO:teuthology.orchestra.run.smithi146.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:30.754 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:30.755 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:30.755 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:30.755 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:30.755 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:30.755 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:30.755 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-osd, directory '/var/lib/ceph/osd' not empty so not removed 2023-12-01T16:04:30.778 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be REMOVED: 2023-12-01T16:04:30.779 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse* 2023-12-01T16:04:30.984 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-01T16:04:31.134 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:31.134 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 2,898 kB disk space will be freed. 2023-12-01T16:04:31.186 INFO:teuthology.orchestra.run.smithi066.stdout:Purging configuration files for ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:31.258 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151908 files and directories currently installed.) 2023-12-01T16:04:31.262 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:31.617 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:31.688 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:31.898 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:31.898 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:32.107 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:32.108 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:32.110 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:32.137 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2023-12-01T16:04:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse* 2023-12-01T16:04:32.514 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:32.514 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 2,898 kB disk space will be freed. 2023-12-01T16:04:32.524 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151899 files and directories currently installed.) 2023-12-01T16:04:32.527 INFO:teuthology.orchestra.run.smithi146.stdout:Purging configuration files for ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:32.610 INFO:teuthology.orchestra.run.smithi066.stdout:Purging configuration files for ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:32.631 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151908 files and directories currently installed.) 2023-12-01T16:04:32.636 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:33.537 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:33.643 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-osd, directory '/var/lib/ceph/osd' not empty so not removed 2023-12-01T16:04:33.872 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:33.919 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-01T16:04:33.942 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:33.943 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151899 files and directories currently installed.) 2023-12-01T16:04:33.948 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:34.149 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:34.150 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout:Package 'ceph-test' is not installed, so not removed 2023-12-01T16:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:34.334 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:34.335 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:34.336 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:34.337 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:34.388 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:34.388 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:34.454 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:34.515 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:34.589 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:34.758 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:34.758 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:34.799 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:34.800 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:34.810 INFO:teuthology.orchestra.run.smithi146.stdout:Package 'ceph-volume' is not installed, so not removed 2023-12-01T16:04:34.811 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:34.811 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:34.811 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:34.811 INFO:teuthology.orchestra.run.smithi146.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:34.812 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:34.812 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:34.812 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:34.812 INFO:teuthology.orchestra.run.smithi146.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:34.812 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:34.813 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:34.813 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:34.813 INFO:teuthology.orchestra.run.smithi146.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:34.813 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:34.813 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:34.813 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:34.814 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:34.814 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:34.814 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:34.864 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:34.865 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:34.932 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:35.009 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:35.010 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:35.010 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:35.012 INFO:teuthology.orchestra.run.smithi066.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:35.012 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:35.012 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:35.012 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:35.012 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:35.012 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:35.013 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:35.013 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:35.013 INFO:teuthology.orchestra.run.smithi066.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:35.013 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:35.013 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:35.013 INFO:teuthology.orchestra.run.smithi066.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:35.014 INFO:teuthology.orchestra.run.smithi066.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:35.014 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:35.014 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:35.038 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be REMOVED: 2023-12-01T16:04:35.040 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse* 2023-12-01T16:04:35.140 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:35.141 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:35.317 INFO:teuthology.orchestra.run.smithi146.stdout:Package 'radosgw' is not installed, so not removed 2023-12-01T16:04:35.317 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:35.317 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:35.318 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:35.318 INFO:teuthology.orchestra.run.smithi146.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:35.319 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:35.319 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:35.319 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:35.319 INFO:teuthology.orchestra.run.smithi146.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:35.319 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:35.319 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:35.319 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:35.320 INFO:teuthology.orchestra.run.smithi146.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:35.320 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:35.320 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:35.320 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:35.320 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:35.320 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:35.320 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:35.370 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:35.370 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:35.437 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:35.588 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:35.588 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 2,898 kB disk space will be freed. 2023-12-01T16:04:35.620 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:35.621 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:35.729 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151908 files and directories currently installed.) 2023-12-01T16:04:35.734 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:35.797 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:35.797 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:35.797 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:35.797 INFO:teuthology.orchestra.run.smithi146.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:35.798 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:35.798 INFO:teuthology.orchestra.run.smithi146.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:35.798 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:35.798 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:35.799 INFO:teuthology.orchestra.run.smithi146.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:35.799 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:35.799 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:35.799 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:35.799 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:35.799 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:35.799 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:35.800 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:35.800 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:35.800 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:35.845 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be REMOVED: 2023-12-01T16:04:35.845 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs* python3-rados* python3-rgw* 2023-12-01T16:04:35.850 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:35.921 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:36.131 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:36.131 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:36.202 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 3 to remove and 259 not upgraded. 2023-12-01T16:04:36.202 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 2,381 kB disk space will be freed. 2023-12-01T16:04:36.315 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151899 files and directories currently installed.) 2023-12-01T16:04:36.319 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:36.341 INFO:teuthology.orchestra.run.smithi063.stdout:Package 'ceph-test' is not installed, so not removed 2023-12-01T16:04:36.341 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:36.341 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:36.341 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:36.341 INFO:teuthology.orchestra.run.smithi063.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:36.342 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:36.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:36.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:36.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:36.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:36.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:36.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:36.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:36.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:36.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:36.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:36.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:36.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:36.343 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:36.397 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:36.467 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:36.678 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:36.679 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:36.698 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:36.778 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:36.868 INFO:teuthology.orchestra.run.smithi063.stdout:Package 'ceph-volume' is not installed, so not removed 2023-12-01T16:04:36.869 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:36.869 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:36.869 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:36.870 INFO:teuthology.orchestra.run.smithi063.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:36.870 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:36.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:36.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:36.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:36.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:36.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:36.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:36.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:36.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:36.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:36.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:36.872 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:36.872 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:36.872 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:36.926 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:36.926 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:36.994 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:37.092 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:37.201 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:37.202 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:37.232 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151899 files and directories currently installed.) 2023-12-01T16:04:37.236 INFO:teuthology.orchestra.run.smithi066.stdout:Purging configuration files for ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:37.391 INFO:teuthology.orchestra.run.smithi063.stdout:Package 'radosgw' is not installed, so not removed 2023-12-01T16:04:37.392 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:37.396 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:37.446 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:37.447 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:37.515 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:37.703 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:37.705 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:37.854 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:37.888 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:37.889 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:37.889 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:37.889 INFO:teuthology.orchestra.run.smithi063.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:37.890 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:37.890 INFO:teuthology.orchestra.run.smithi063.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:37.890 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:37.890 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:37.892 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:37.921 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:37.939 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2023-12-01T16:04:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs* python3-rados* python3-rgw* 2023-12-01T16:04:38.124 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:38.124 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:38.307 INFO:teuthology.orchestra.run.smithi146.stdout:Package 'python3-rgw' is not installed, so not removed 2023-12-01T16:04:38.307 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:38.307 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:38.307 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:38.307 INFO:teuthology.orchestra.run.smithi146.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:38.308 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 3 to remove and 259 not upgraded. 2023-12-01T16:04:38.308 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 2,381 kB disk space will be freed. 2023-12-01T16:04:38.309 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:38.309 INFO:teuthology.orchestra.run.smithi146.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:38.309 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:38.309 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:38.309 INFO:teuthology.orchestra.run.smithi146.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:38.310 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:38.310 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:38.310 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:38.310 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:38.310 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:38.310 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:38.310 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:38.311 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:38.312 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:38.358 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:38.358 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:38.429 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:38.456 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151899 files and directories currently installed.) 2023-12-01T16:04:38.461 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:38.638 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:38.640 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:38.801 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:38.818 INFO:teuthology.orchestra.run.smithi146.stdout:Package 'python3-cephfs' is not installed, so not removed 2023-12-01T16:04:38.818 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:38.818 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:38.818 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:38.818 INFO:teuthology.orchestra.run.smithi146.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:38.819 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:38.820 INFO:teuthology.orchestra.run.smithi146.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:38.820 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:38.820 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:38.821 INFO:teuthology.orchestra.run.smithi146.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:38.821 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:38.821 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:38.822 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:38.823 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:38.823 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:38.823 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:38.824 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:38.824 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:38.824 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:38.860 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:38.872 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:38.873 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:38.874 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:38.940 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:39.081 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:39.082 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:39.121 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:39.122 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:39.263 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:39.283 INFO:teuthology.orchestra.run.smithi066.stdout:Package 'ceph-test' is not installed, so not removed 2023-12-01T16:04:39.284 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:39.284 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:39.284 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:39.286 INFO:teuthology.orchestra.run.smithi066.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:39.286 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:39.286 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:39.286 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:39.286 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:39.286 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:39.287 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:39.287 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:39.287 INFO:teuthology.orchestra.run.smithi066.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:39.287 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:39.287 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:39.287 INFO:teuthology.orchestra.run.smithi066.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:39.287 INFO:teuthology.orchestra.run.smithi066.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:39.288 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:39.288 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:39.290 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:39.291 INFO:teuthology.orchestra.run.smithi146.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:39.292 INFO:teuthology.orchestra.run.smithi146.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:39.293 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:39.295 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:39.319 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be REMOVED: 2023-12-01T16:04:39.320 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd* 2023-12-01T16:04:39.336 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:39.336 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:39.404 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:39.615 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:39.616 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 1,343 kB disk space will be freed. 2023-12-01T16:04:39.793 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151875 files and directories currently installed.) 2023-12-01T16:04:39.797 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:39.815 INFO:teuthology.orchestra.run.smithi066.stdout:Package 'ceph-volume' is not installed, so not removed 2023-12-01T16:04:39.815 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:39.816 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:39.816 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:39.817 INFO:teuthology.orchestra.run.smithi066.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:39.817 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:39.817 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:39.817 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:39.817 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:39.818 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:39.818 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:39.818 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:39.818 INFO:teuthology.orchestra.run.smithi066.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:39.818 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:39.819 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:39.819 INFO:teuthology.orchestra.run.smithi066.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:39.819 INFO:teuthology.orchestra.run.smithi066.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:39.819 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:39.819 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:39.872 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:39.942 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:40.108 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:40.131 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:40.132 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:40.178 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:40.317 INFO:teuthology.orchestra.run.smithi066.stdout:Package 'radosgw' is not installed, so not removed 2023-12-01T16:04:40.317 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:40.318 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:40.318 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:40.319 INFO:teuthology.orchestra.run.smithi066.stdout: liboath0 libonig5 libradosstriper1 libsqlite3-mod-ceph nvme-cli 2023-12-01T16:04:40.319 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:40.320 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:40.320 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-ceph-common python3-cherrypy3 python3-google-auth 2023-12-01T16:04:40.320 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-01T16:04:40.320 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-01T16:04:40.320 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-paste 2023-12-01T16:04:40.320 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-prettytable 2023-12-01T16:04:40.320 INFO:teuthology.orchestra.run.smithi066.stdout: python3-psutil python3-pyasn1 python3-pyasn1-modules python3-pyinotify 2023-12-01T16:04:40.320 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-01T16:04:40.321 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-01T16:04:40.321 INFO:teuthology.orchestra.run.smithi066.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-12-01T16:04:40.321 INFO:teuthology.orchestra.run.smithi066.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2023-12-01T16:04:40.321 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:40.321 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:40.371 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:40.371 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:40.373 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:40.374 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:40.441 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:40.556 INFO:teuthology.orchestra.run.smithi063.stdout:Package 'python3-rgw' is not installed, so not removed 2023-12-01T16:04:40.556 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:40.557 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:40.557 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:40.557 INFO:teuthology.orchestra.run.smithi063.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:40.557 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:40.557 INFO:teuthology.orchestra.run.smithi063.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:40.557 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:40.557 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:40.558 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:40.558 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:40.558 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:40.559 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:40.559 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:40.559 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:40.559 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:40.560 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:40.560 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:40.560 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:40.581 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:40.608 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:40.609 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:40.630 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:40.630 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:40.645 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:40.677 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:40.818 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:40.818 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:40.818 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:40.819 INFO:teuthology.orchestra.run.smithi066.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:40.819 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:40.819 INFO:teuthology.orchestra.run.smithi066.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:40.819 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:40.820 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:40.820 INFO:teuthology.orchestra.run.smithi066.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:40.820 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:40.820 INFO:teuthology.orchestra.run.smithi066.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:40.821 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:40.821 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:40.821 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:40.821 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:40.822 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:40.822 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:40.822 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:40.829 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:40.830 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:40.865 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:40.866 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:40.873 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be REMOVED: 2023-12-01T16:04:40.873 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs* python3-rados* python3-rgw* 2023-12-01T16:04:41.003 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:41.003 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:41.004 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:41.004 INFO:teuthology.orchestra.run.smithi146.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:41.004 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:41.004 INFO:teuthology.orchestra.run.smithi146.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:41.005 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:41.005 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:41.005 INFO:teuthology.orchestra.run.smithi146.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:41.005 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:41.005 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:41.006 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:41.006 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:41.006 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:41.006 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:41.006 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:41.006 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:41.007 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:41.043 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be REMOVED: 2023-12-01T16:04:41.044 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-dev* libcephfs2* 2023-12-01T16:04:41.047 INFO:teuthology.orchestra.run.smithi063.stdout:Package 'python3-cephfs' is not installed, so not removed 2023-12-01T16:04:41.047 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:41.048 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:41.048 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:41.048 INFO:teuthology.orchestra.run.smithi063.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:41.049 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:41.050 INFO:teuthology.orchestra.run.smithi063.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:41.050 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:41.050 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:41.050 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:41.050 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:41.051 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:41.051 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:41.051 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:41.051 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:41.051 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:41.051 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:41.052 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:41.052 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:41.104 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:41.104 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:41.173 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:41.308 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 3 to remove and 259 not upgraded. 2023-12-01T16:04:41.308 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 2,381 kB disk space will be freed. 2023-12-01T16:04:41.361 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:41.361 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 2 to remove and 259 not upgraded. 2023-12-01T16:04:41.397 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 2,618 kB disk space will be freed. 2023-12-01T16:04:41.433 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151899 files and directories currently installed.) 2023-12-01T16:04:41.438 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:41.513 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151867 files and directories currently installed.) 2023-12-01T16:04:41.516 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:41.542 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:41.542 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:41.542 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:41.543 INFO:teuthology.orchestra.run.smithi063.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:41.543 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:41.544 INFO:teuthology.orchestra.run.smithi063.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:41.544 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:41.544 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:41.544 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:41.544 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:41.544 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:41.544 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:41.545 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:41.545 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:41.545 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:41.545 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:41.545 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:41.545 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:41.571 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2023-12-01T16:04:41.571 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd* 2023-12-01T16:04:41.857 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:41.900 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:41.971 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:41.971 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 1,343 kB disk space will be freed. 2023-12-01T16:04:42.096 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151875 files and directories currently installed.) 2023-12-01T16:04:42.100 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:42.361 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:42.371 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:04:42.890 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:42.920 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:42.955 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:42.988 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:43.158 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:43.159 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:43.175 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:43.180 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:43.180 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:43.245 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:43.341 INFO:teuthology.orchestra.run.smithi146.stdout:Package 'libcephfs-dev' is not installed, so not removed 2023-12-01T16:04:43.341 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:43.341 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:43.341 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:43.341 INFO:teuthology.orchestra.run.smithi146.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:43.342 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:43.342 INFO:teuthology.orchestra.run.smithi146.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:43.343 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:43.343 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:43.343 INFO:teuthology.orchestra.run.smithi146.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:43.343 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:43.343 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:43.343 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:43.343 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:43.343 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:43.344 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:43.344 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:43.344 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:43.344 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:43.365 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:43.365 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:43.365 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:43.365 INFO:teuthology.orchestra.run.smithi063.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:43.366 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:43.366 INFO:teuthology.orchestra.run.smithi063.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:43.367 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:43.367 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:43.367 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:43.367 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:43.367 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:43.367 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:43.368 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:43.368 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:43.368 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:43.368 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:43.368 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:43.368 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:43.393 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:43.393 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:43.403 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2023-12-01T16:04:43.404 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-dev* libcephfs2* 2023-12-01T16:04:43.436 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:43.437 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:43.464 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:43.614 INFO:teuthology.orchestra.run.smithi066.stdout:Package 'python3-rgw' is not installed, so not removed 2023-12-01T16:04:43.615 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:43.615 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:43.615 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:43.615 INFO:teuthology.orchestra.run.smithi066.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:43.616 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:43.616 INFO:teuthology.orchestra.run.smithi066.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:43.616 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:43.616 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:43.617 INFO:teuthology.orchestra.run.smithi066.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:43.617 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:43.617 INFO:teuthology.orchestra.run.smithi066.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:43.617 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:43.617 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:43.617 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:43.617 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:43.618 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:43.618 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:43.618 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:43.666 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:43.667 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:43.671 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:43.672 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:43.742 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:43.777 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 2 to remove and 259 not upgraded. 2023-12-01T16:04:43.778 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 2,618 kB disk space will be freed. 2023-12-01T16:04:43.849 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:43.849 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:04:43.849 INFO:teuthology.orchestra.run.smithi146.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:04:43.849 INFO:teuthology.orchestra.run.smithi146.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:04:43.850 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:04:43.850 INFO:teuthology.orchestra.run.smithi146.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:04:43.850 INFO:teuthology.orchestra.run.smithi146.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:04:43.850 INFO:teuthology.orchestra.run.smithi146.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:04:43.850 INFO:teuthology.orchestra.run.smithi146.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:04:43.850 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:04:43.851 INFO:teuthology.orchestra.run.smithi146.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:04:43.852 INFO:teuthology.orchestra.run.smithi146.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:04:43.852 INFO:teuthology.orchestra.run.smithi146.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:04:43.852 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:43.853 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:43.853 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:43.853 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:43.853 INFO:teuthology.orchestra.run.smithi146.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:43.853 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:43.853 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:43.853 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:43.853 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:43.854 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:43.854 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:43.854 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:43.854 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:04:43.854 INFO:teuthology.orchestra.run.smithi146.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:04:43.854 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:43.895 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151867 files and directories currently installed.) 2023-12-01T16:04:43.900 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:43.930 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:43.931 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:43.977 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be REMOVED: 2023-12-01T16:04:43.977 INFO:teuthology.orchestra.run.smithi146.stdout: librados2* libradosstriper1* librbd1* librgw2* libsqlite3-mod-ceph* 2023-12-01T16:04:43.978 INFO:teuthology.orchestra.run.smithi146.stdout: qemu-block-extra* qemu-system-common* qemu-system-x86* qemu-utils* rbd-fuse* 2023-12-01T16:04:44.109 INFO:teuthology.orchestra.run.smithi066.stdout:Package 'python3-cephfs' is not installed, so not removed 2023-12-01T16:04:44.109 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:44.109 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:44.109 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:44.109 INFO:teuthology.orchestra.run.smithi066.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:44.110 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:44.110 INFO:teuthology.orchestra.run.smithi066.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:44.111 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:44.111 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:44.111 INFO:teuthology.orchestra.run.smithi066.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:44.111 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:44.111 INFO:teuthology.orchestra.run.smithi066.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:44.111 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:44.111 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:44.111 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:44.112 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:44.112 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:44.112 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:44.112 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:44.166 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:44.311 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:44.325 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 10 to remove and 259 not upgraded. 2023-12-01T16:04:44.326 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 105 MB disk space will be freed. 2023-12-01T16:04:44.423 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:44.424 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:44.439 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151852 files and directories currently installed.) 2023-12-01T16:04:44.443 INFO:teuthology.orchestra.run.smithi146.stdout:Removing rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:44.602 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:44.602 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:44.602 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:44.602 INFO:teuthology.orchestra.run.smithi066.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:44.603 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:44.603 INFO:teuthology.orchestra.run.smithi066.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:44.604 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:44.604 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:44.604 INFO:teuthology.orchestra.run.smithi066.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:44.604 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:44.604 INFO:teuthology.orchestra.run.smithi066.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:44.604 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:44.605 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:44.605 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:44.605 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:44.605 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:44.605 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:44.606 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be REMOVED: 2023-12-01T16:04:44.633 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd* 2023-12-01T16:04:44.840 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:04:44.861 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:45.001 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 1 to remove and 259 not upgraded. 2023-12-01T16:04:45.002 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 1,343 kB disk space will be freed. 2023-12-01T16:04:45.124 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151875 files and directories currently installed.) 2023-12-01T16:04:45.128 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:45.341 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:45.342 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:45.417 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:45.628 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:45.628 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:45.722 INFO:teuthology.orchestra.run.smithi146.stdout:Removing qemu-utils (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:45.827 INFO:teuthology.orchestra.run.smithi063.stdout:Package 'libcephfs-dev' is not installed, so not removed 2023-12-01T16:04:45.828 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:45.828 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:45.828 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:45.828 INFO:teuthology.orchestra.run.smithi063.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:45.830 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:45.830 INFO:teuthology.orchestra.run.smithi063.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:45.830 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:45.830 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:45.830 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:45.830 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:45.830 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:45.831 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:45.831 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:45.831 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:45.831 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:45.831 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:45.833 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:45.833 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:45.880 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:45.951 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:46.002 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:46.074 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:46.105 INFO:teuthology.orchestra.run.smithi146.stdout:Removing qemu-system-x86 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:46.161 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:46.162 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:46.266 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:46.267 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:46.352 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:46.352 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:04:46.352 INFO:teuthology.orchestra.run.smithi063.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:04:46.352 INFO:teuthology.orchestra.run.smithi063.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:04:46.352 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:04:46.353 INFO:teuthology.orchestra.run.smithi063.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:04:46.353 INFO:teuthology.orchestra.run.smithi063.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:04:46.353 INFO:teuthology.orchestra.run.smithi063.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:04:46.353 INFO:teuthology.orchestra.run.smithi063.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:04:46.353 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:04:46.354 INFO:teuthology.orchestra.run.smithi063.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:04:46.354 INFO:teuthology.orchestra.run.smithi063.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:04:46.354 INFO:teuthology.orchestra.run.smithi063.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:04:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:46.355 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:46.356 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:46.356 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:46.356 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:46.356 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:46.356 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:04:46.357 INFO:teuthology.orchestra.run.smithi063.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:04:46.357 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:46.456 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:46.456 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:46.456 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:46.456 INFO:teuthology.orchestra.run.smithi066.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:46.457 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:46.457 INFO:teuthology.orchestra.run.smithi066.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:46.457 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:46.457 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:46.458 INFO:teuthology.orchestra.run.smithi066.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:46.458 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:46.458 INFO:teuthology.orchestra.run.smithi066.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:46.458 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:46.458 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:46.458 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:46.459 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:46.459 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:46.459 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:46.459 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:46.482 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2023-12-01T16:04:46.482 INFO:teuthology.orchestra.run.smithi063.stdout: librados2* libradosstriper1* librbd1* librgw2* libsqlite3-mod-ceph* 2023-12-01T16:04:46.482 INFO:teuthology.orchestra.run.smithi063.stdout: qemu-block-extra* qemu-system-common* qemu-system-x86* qemu-utils* rbd-fuse* 2023-12-01T16:04:46.495 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be REMOVED: 2023-12-01T16:04:46.496 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-dev* libcephfs2* 2023-12-01T16:04:46.526 INFO:teuthology.orchestra.run.smithi146.stdout:Removing qemu-system-common (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:46.868 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 2 to remove and 259 not upgraded. 2023-12-01T16:04:46.868 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 2,618 kB disk space will be freed. 2023-12-01T16:04:46.891 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 10 to remove and 259 not upgraded. 2023-12-01T16:04:46.891 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 105 MB disk space will be freed. 2023-12-01T16:04:46.990 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151867 files and directories currently installed.) 2023-12-01T16:04:46.994 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:47.005 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151852 files and directories currently installed.) 2023-12-01T16:04:47.009 INFO:teuthology.orchestra.run.smithi063.stdout:Removing rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:47.418 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:47.440 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:47.523 INFO:teuthology.orchestra.run.smithi146.stdout:Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:Removing librbd1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:47.935 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:47.978 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:04:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:Removing librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:48.364 INFO:teuthology.orchestra.run.smithi063.stdout:Removing qemu-utils (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:48.535 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:Removing librados2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:48.603 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:48.751 INFO:teuthology.orchestra.run.smithi063.stdout:Removing qemu-system-x86 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:48.795 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:48.796 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:48.978 INFO:teuthology.orchestra.run.smithi066.stdout:Package 'libcephfs-dev' is not installed, so not removed 2023-12-01T16:04:48.978 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:48.978 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core fonts-mathjax jq libboost-iostreams1.71.0 2023-12-01T16:04:48.979 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-01T16:04:48.979 INFO:teuthology.orchestra.run.smithi066.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-01T16:04:48.980 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-asyncssh-doc python-natsort-doc 2023-12-01T16:04:48.981 INFO:teuthology.orchestra.run.smithi066.stdout: python-pastedeploy-tpl python3-asyncssh python3-bcrypt python3-blinker 2023-12-01T16:04:48.981 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bs4 python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:48.981 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:48.981 INFO:teuthology.orchestra.run.smithi066.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:48.982 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:48.982 INFO:teuthology.orchestra.run.smithi066.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:48.982 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:48.983 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:48.983 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:48.983 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:48.983 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:48.984 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-12-01T16:04:48.984 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:49.032 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:49.033 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:49.102 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:49.204 INFO:teuthology.orchestra.run.smithi063.stdout:Removing qemu-system-common (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:49.312 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:49.313 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:49.512 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:49.512 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:04:49.512 INFO:teuthology.orchestra.run.smithi066.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:04:49.513 INFO:teuthology.orchestra.run.smithi066.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:04:49.513 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:04:49.513 INFO:teuthology.orchestra.run.smithi066.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:04:49.513 INFO:teuthology.orchestra.run.smithi066.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:04:49.514 INFO:teuthology.orchestra.run.smithi066.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:04:49.514 INFO:teuthology.orchestra.run.smithi066.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:04:49.514 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:04:49.515 INFO:teuthology.orchestra.run.smithi066.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:04:49.515 INFO:teuthology.orchestra.run.smithi066.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:04:49.516 INFO:teuthology.orchestra.run.smithi066.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:04:49.516 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:49.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:49.517 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:49.517 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:49.517 INFO:teuthology.orchestra.run.smithi066.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:49.518 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:49.518 INFO:teuthology.orchestra.run.smithi066.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:49.519 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:49.519 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:49.519 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:49.520 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:49.521 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:49.521 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:04:49.521 INFO:teuthology.orchestra.run.smithi066.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:04:49.522 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:04:49.635 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be REMOVED: 2023-12-01T16:04:49.636 INFO:teuthology.orchestra.run.smithi066.stdout: librados2* libradosstriper1* librbd1* librgw2* libsqlite3-mod-ceph* 2023-12-01T16:04:49.636 INFO:teuthology.orchestra.run.smithi066.stdout: qemu-block-extra* qemu-system-common* qemu-system-x86* qemu-utils* rbd-fuse* 2023-12-01T16:04:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151751 files and directories currently installed.) 2023-12-01T16:04:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:Purging configuration files for qemu-system-common (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:50.012 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 10 to remove and 259 not upgraded. 2023-12-01T16:04:50.013 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 105 MB disk space will be freed. 2023-12-01T16:04:50.159 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151852 files and directories currently installed.) 2023-12-01T16:04:50.164 INFO:teuthology.orchestra.run.smithi066.stdout:Removing rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:50.227 INFO:teuthology.orchestra.run.smithi063.stdout:Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:50.547 INFO:teuthology.orchestra.run.smithi063.stdout:Removing librbd1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:50.629 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:50.913 INFO:teuthology.orchestra.run.smithi063.stdout:Removing librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:51.184 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:Purging configuration files for qemu-block-extra:amd64 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:51.341 INFO:teuthology.orchestra.run.smithi063.stdout:Removing librados2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:51.629 INFO:teuthology.orchestra.run.smithi066.stdout:Removing qemu-utils (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:51.804 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:51.884 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:52.074 INFO:teuthology.orchestra.run.smithi066.stdout:Removing qemu-system-x86 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:52.323 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:04:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:Package 'librbd1' is not installed, so not removed 2023-12-01T16:04:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:04:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:04:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:04:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:04:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:04:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:04:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:04:52.327 INFO:teuthology.orchestra.run.smithi146.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:04:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:04:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:04:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:04:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:04:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:52.328 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:52.329 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:04:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:04:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:52.552 INFO:teuthology.orchestra.run.smithi066.stdout:Removing qemu-system-common (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:52.648 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:52.649 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:52.758 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151751 files and directories currently installed.) 2023-12-01T16:04:52.762 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for qemu-system-common (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:52.836 INFO:teuthology.orchestra.run.smithi146.stdout:Package 'rbd-fuse' is not installed, so not removed 2023-12-01T16:04:52.836 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:52.836 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:04:52.837 INFO:teuthology.orchestra.run.smithi146.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:04:52.837 INFO:teuthology.orchestra.run.smithi146.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:04:52.837 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:04:52.837 INFO:teuthology.orchestra.run.smithi146.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:04:52.837 INFO:teuthology.orchestra.run.smithi146.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:04:52.837 INFO:teuthology.orchestra.run.smithi146.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:04:52.837 INFO:teuthology.orchestra.run.smithi146.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:04:52.837 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:04:52.838 INFO:teuthology.orchestra.run.smithi146.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:04:52.838 INFO:teuthology.orchestra.run.smithi146.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:04:52.838 INFO:teuthology.orchestra.run.smithi146.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:04:52.838 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:52.839 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:52.839 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:52.839 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:52.839 INFO:teuthology.orchestra.run.smithi146.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:52.839 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:52.840 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:52.840 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:52.840 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:52.841 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:52.841 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:52.841 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:52.842 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:04:52.842 INFO:teuthology.orchestra.run.smithi146.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:04:52.842 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:52.887 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:52.890 DEBUG:teuthology.orchestra.run.smithi146:> dpkg -l | grep '^.\(U\|H\)R' | awk '{print $2}' | sudo xargs --no-run-if-empty dpkg -P --force-remove-reinstreq 2023-12-01T16:04:52.920 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" autoremove 2023-12-01T16:04:53.035 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:04:53.220 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-01T16:04:53.220 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-01T16:04:53.418 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be REMOVED: 2023-12-01T16:04:53.419 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:04:53.419 INFO:teuthology.orchestra.run.smithi146.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:04:53.419 INFO:teuthology.orchestra.run.smithi146.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:04:53.419 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:04:53.419 INFO:teuthology.orchestra.run.smithi146.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:04:53.419 INFO:teuthology.orchestra.run.smithi146.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:04:53.420 INFO:teuthology.orchestra.run.smithi146.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:04:53.420 INFO:teuthology.orchestra.run.smithi146.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:04:53.420 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:04:53.420 INFO:teuthology.orchestra.run.smithi146.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:04:53.420 INFO:teuthology.orchestra.run.smithi146.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:04:53.420 INFO:teuthology.orchestra.run.smithi146.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:04:53.420 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:53.420 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:53.421 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:53.421 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:53.421 INFO:teuthology.orchestra.run.smithi146.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:53.421 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:53.421 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:53.421 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:53.421 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:53.421 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:53.422 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:53.422 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:53.422 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:04:53.422 INFO:teuthology.orchestra.run.smithi146.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:04:53.631 INFO:teuthology.orchestra.run.smithi066.stdout:Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:53.765 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 111 to remove and 251 not upgraded. 2023-12-01T16:04:53.766 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 174 MB disk space will be freed. 2023-12-01T16:04:53.899 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151748 files and directories currently installed.) 2023-12-01T16:04:53.904 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:53.969 INFO:teuthology.orchestra.run.smithi066.stdout:Removing librbd1 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:54.107 INFO:teuthology.orchestra.run.smithi063.stdout:Purging configuration files for qemu-block-extra:amd64 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:54.285 INFO:teuthology.orchestra.run.smithi146.stdout:Removing cpu-checker (0.7-1.1) ... 2023-12-01T16:04:54.395 INFO:teuthology.orchestra.run.smithi066.stdout:Removing librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:54.721 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python-natsort-doc (7.0.1-1) ... 2023-12-01T16:04:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:54.840 INFO:teuthology.orchestra.run.smithi066.stdout:Removing librados2 (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:54.903 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:55.109 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-01T16:04:55.113 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:55.114 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:55.302 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:04:55.313 INFO:teuthology.orchestra.run.smithi063.stdout:Package 'librbd1' is not installed, so not removed 2023-12-01T16:04:55.313 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:55.313 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:04:55.313 INFO:teuthology.orchestra.run.smithi063.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:04:55.313 INFO:teuthology.orchestra.run.smithi063.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:04:55.313 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:04:55.314 INFO:teuthology.orchestra.run.smithi063.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:04:55.314 INFO:teuthology.orchestra.run.smithi063.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:04:55.314 INFO:teuthology.orchestra.run.smithi063.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:04:55.314 INFO:teuthology.orchestra.run.smithi063.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:04:55.315 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:04:55.315 INFO:teuthology.orchestra.run.smithi063.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:04:55.315 INFO:teuthology.orchestra.run.smithi063.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:04:55.315 INFO:teuthology.orchestra.run.smithi063.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:04:55.315 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:55.315 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:55.315 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:55.316 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:55.316 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:55.316 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:55.316 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:55.316 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:55.316 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:55.316 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:55.316 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:55.317 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:55.317 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:04:55.317 INFO:teuthology.orchestra.run.smithi063.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:04:55.317 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:55.365 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:55.365 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:55.434 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:55.584 INFO:teuthology.orchestra.run.smithi146.stdout:Removing fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-01T16:04:55.620 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:55.621 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:Package 'rbd-fuse' is not installed, so not removed 2023-12-01T16:04:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:55.803 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:04:55.803 INFO:teuthology.orchestra.run.smithi063.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:04:55.803 INFO:teuthology.orchestra.run.smithi063.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:04:55.803 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:04:55.804 INFO:teuthology.orchestra.run.smithi063.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:04:55.804 INFO:teuthology.orchestra.run.smithi063.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:04:55.804 INFO:teuthology.orchestra.run.smithi063.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:04:55.804 INFO:teuthology.orchestra.run.smithi063.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:04:55.804 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:04:55.804 INFO:teuthology.orchestra.run.smithi063.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:04:55.804 INFO:teuthology.orchestra.run.smithi063.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:04:55.804 INFO:teuthology.orchestra.run.smithi063.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:04:55.805 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:55.805 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:55.805 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:55.805 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:55.805 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:55.805 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:55.806 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:55.806 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:55.806 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:55.806 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:55.806 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:55.806 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:55.807 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:04:55.807 INFO:teuthology.orchestra.run.smithi063.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:04:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:55.857 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:55.858 DEBUG:teuthology.orchestra.run.smithi063:> dpkg -l | grep '^.\(U\|H\)R' | awk '{print $2}' | sudo xargs --no-run-if-empty dpkg -P --force-remove-reinstreq 2023-12-01T16:04:55.861 INFO:teuthology.orchestra.run.smithi146.stdout:dpkg: warning: while removing fonts-mathjax, directory '/usr/share/javascript/mathjax/fonts/HTML-CSS/TeX/otf' not empty so not removed 2023-12-01T16:04:55.861 INFO:teuthology.orchestra.run.smithi146.stdout:dpkg: warning: while removing fonts-mathjax, directory '/usr/share/fonts/opentype' not empty so not removed 2023-12-01T16:04:55.872 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:04:55.888 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" autoremove 2023-12-01T16:04:55.962 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:04:56.038 INFO:teuthology.orchestra.run.smithi146.stdout:Removing gstreamer1.0-plugins-good:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:04:56.150 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2023-12-01T16:04:56.151 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2023-12-01T16:04:56.309 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151751 files and directories currently installed.) 2023-12-01T16:04:56.313 INFO:teuthology.orchestra.run.smithi066.stdout:Purging configuration files for qemu-system-common (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:56.356 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be REMOVED: 2023-12-01T16:04:56.356 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:04:56.356 INFO:teuthology.orchestra.run.smithi063.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:04:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:04:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:04:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:04:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:04:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:04:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:04:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:04:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:04:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:04:56.359 INFO:teuthology.orchestra.run.smithi063.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:04:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:04:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:04:56.459 INFO:teuthology.orchestra.run.smithi146.stdout:Removing gstreamer1.0-plugins-base:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:04:56.759 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 111 to remove and 251 not upgraded. 2023-12-01T16:04:56.759 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 174 MB disk space will be freed. 2023-12-01T16:04:56.829 INFO:teuthology.orchestra.run.smithi146.stdout:Removing gstreamer1.0-x:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:04:56.885 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151748 files and directories currently installed.) 2023-12-01T16:04:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:04:57.127 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/zabbix' not empty so not removed 2023-12-01T16:04:57.128 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/volumes/fs/operations/versions' not empty so not removed 2023-12-01T16:04:57.128 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/test_orchestrator' not empty so not removed 2023-12-01T16:04:57.128 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/telemetry' not empty so not removed 2023-12-01T16:04:57.128 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/telegraf' not empty so not removed 2023-12-01T16:04:57.128 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/status' not empty so not removed 2023-12-01T16:04:57.128 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/stats/fs' not empty so not removed 2023-12-01T16:04:57.128 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/snap_schedule/fs' not empty so not removed 2023-12-01T16:04:57.129 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/selftest' not empty so not removed 2023-12-01T16:04:57.129 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/restful' not empty so not removed 2023-12-01T16:04:57.129 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/rbd_support' not empty so not removed 2023-12-01T16:04:57.129 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/prometheus' not empty so not removed 2023-12-01T16:04:57.129 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/progress' not empty so not removed 2023-12-01T16:04:57.129 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/pg_autoscaler' not empty so not removed 2023-12-01T16:04:57.129 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/osd_support' not empty so not removed 2023-12-01T16:04:57.129 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/osd_perf_query' not empty so not removed 2023-12-01T16:04:57.130 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/orchestrator' not empty so not removed 2023-12-01T16:04:57.130 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/nfs' not empty so not removed 2023-12-01T16:04:57.130 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/mirroring/fs/dir_map' not empty so not removed 2023-12-01T16:04:57.130 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/localpool' not empty so not removed 2023-12-01T16:04:57.130 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/iostat' not empty so not removed 2023-12-01T16:04:57.130 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/insights' not empty so not removed 2023-12-01T16:04:57.130 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/influx' not empty so not removed 2023-12-01T16:04:57.131 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/devicehealth' not empty so not removed 2023-12-01T16:04:57.131 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/crash' not empty so not removed 2023-12-01T16:04:57.131 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/balancer' not empty so not removed 2023-12-01T16:04:57.131 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/alerts' not empty so not removed 2023-12-01T16:04:57.240 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ipxe-qemu (1.0.0+git-20190109.133f4c4-0ubuntu3.2) ... 2023-12-01T16:04:57.304 INFO:teuthology.orchestra.run.smithi063.stdout:Removing cpu-checker (0.7-1.1) ... 2023-12-01T16:04:57.627 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ipxe-qemu-256k-compat-efi-roms (1.0.0+git-20150424.a25a16d-0ubuntu4) ... 2023-12-01T16:04:57.689 INFO:teuthology.orchestra.run.smithi066.stdout:Purging configuration files for qemu-block-extra:amd64 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:04:57.733 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python-natsort-doc (7.0.1-1) ... 2023-12-01T16:04:57.989 INFO:teuthology.orchestra.run.smithi146.stdout:Removing jq (1.6-1ubuntu0.20.04.1) ... 2023-12-01T16:04:58.161 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-01T16:04:58.359 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libaa1:amd64 (1.4p5-46) ... 2023-12-01T16:04:58.481 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:58.550 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:58.644 INFO:teuthology.orchestra.run.smithi063.stdout:Removing fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-01T16:04:58.761 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:58.761 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:58.804 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libboost-iostreams1.71.0:amd64 (1.71.0-6ubuntu6) ... 2023-12-01T16:04:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing fonts-mathjax, directory '/usr/share/javascript/mathjax/fonts/HTML-CSS/TeX/otf' not empty so not removed 2023-12-01T16:04:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:dpkg: warning: while removing fonts-mathjax, directory '/usr/share/fonts/opentype' not empty so not removed 2023-12-01T16:04:58.958 INFO:teuthology.orchestra.run.smithi066.stdout:Package 'librbd1' is not installed, so not removed 2023-12-01T16:04:58.958 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:58.958 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:04:58.959 INFO:teuthology.orchestra.run.smithi066.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:04:58.959 INFO:teuthology.orchestra.run.smithi066.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:04:58.959 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:04:58.959 INFO:teuthology.orchestra.run.smithi066.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:04:58.959 INFO:teuthology.orchestra.run.smithi066.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:04:58.959 INFO:teuthology.orchestra.run.smithi066.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:04:58.959 INFO:teuthology.orchestra.run.smithi066.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:04:58.960 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:04:58.960 INFO:teuthology.orchestra.run.smithi066.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:04:58.960 INFO:teuthology.orchestra.run.smithi066.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:04:58.960 INFO:teuthology.orchestra.run.smithi066.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:04:58.960 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:58.960 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:58.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:58.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:58.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:58.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:58.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:58.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:58.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:58.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:58.963 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:58.963 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:58.963 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:04:58.963 INFO:teuthology.orchestra.run.smithi066.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:04:58.963 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:59.010 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:59.010 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:59.080 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:59.091 INFO:teuthology.orchestra.run.smithi063.stdout:Removing gstreamer1.0-plugins-good:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:04:59.174 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libboost-thread1.71.0:amd64 (1.71.0-6ubuntu6) ... 2023-12-01T16:04:59.267 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:59.268 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:59.450 INFO:teuthology.orchestra.run.smithi066.stdout:Package 'rbd-fuse' is not installed, so not removed 2023-12-01T16:04:59.450 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2023-12-01T16:04:59.450 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:04:59.451 INFO:teuthology.orchestra.run.smithi066.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:04:59.451 INFO:teuthology.orchestra.run.smithi066.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:04:59.451 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:04:59.452 INFO:teuthology.orchestra.run.smithi066.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:04:59.452 INFO:teuthology.orchestra.run.smithi066.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:04:59.452 INFO:teuthology.orchestra.run.smithi066.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:04:59.453 INFO:teuthology.orchestra.run.smithi066.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:04:59.453 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:04:59.454 INFO:teuthology.orchestra.run.smithi066.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:04:59.454 INFO:teuthology.orchestra.run.smithi066.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:04:59.455 INFO:teuthology.orchestra.run.smithi066.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:04:59.455 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:04:59.455 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:04:59.456 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:04:59.458 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:04:59.459 INFO:teuthology.orchestra.run.smithi066.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:04:59.459 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:04:59.459 INFO:teuthology.orchestra.run.smithi066.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:04:59.460 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:04:59.460 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:04:59.460 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:04:59.460 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:04:59.461 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:04:59.461 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:04:59.461 INFO:teuthology.orchestra.run.smithi066.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:04:59.461 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-01T16:04:59.477 INFO:teuthology.orchestra.run.smithi063.stdout:Removing gstreamer1.0-plugins-base:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:04:59.506 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 259 not upgraded. 2023-12-01T16:04:59.508 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:04:59.509 DEBUG:teuthology.orchestra.run.smithi066:> dpkg -l | grep '^.\(U\|H\)R' | awk '{print $2}' | sudo xargs --no-run-if-empty dpkg -P --force-remove-reinstreq 2023-12-01T16:04:59.537 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" autoremove 2023-12-01T16:04:59.561 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libbrlapi0.7:amd64 (6.0+dfsg-4ubuntu6) ... 2023-12-01T16:04:59.650 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:04:59.837 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2023-12-01T16:04:59.838 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2023-12-01T16:04:59.905 INFO:teuthology.orchestra.run.smithi063.stdout:Removing gstreamer1.0-x:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:04:59.923 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libcacard0:amd64 (1:2.6.1-1) ... 2023-12-01T16:05:00.057 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be REMOVED: 2023-12-01T16:05:00.058 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core cpu-checker fonts-mathjax gstreamer1.0-plugins-base 2023-12-01T16:05:00.059 INFO:teuthology.orchestra.run.smithi066.stdout: gstreamer1.0-plugins-good gstreamer1.0-x ipxe-qemu 2023-12-01T16:05:00.059 INFO:teuthology.orchestra.run.smithi066.stdout: ipxe-qemu-256k-compat-efi-roms jq libaa1 libboost-iostreams1.71.0 2023-12-01T16:05:00.059 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-thread1.71.0 libbrlapi0.7 libcacard0 libcdparanoia0 2023-12-01T16:05:00.059 INFO:teuthology.orchestra.run.smithi066.stdout: libdouble-conversion3 libdv4 libgbm1 libgstreamer-plugins-base1.0-0 2023-12-01T16:05:00.060 INFO:teuthology.orchestra.run.smithi066.stdout: libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libjq1 libjs-mathjax 2023-12-01T16:05:00.060 INFO:teuthology.orchestra.run.smithi066.stdout: libjs-sphinxdoc libjs-underscore liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-01T16:05:00.060 INFO:teuthology.orchestra.run.smithi066.stdout: liborc-0.4-0 libpcre2-16-0 libpmem1 libqt5core5a libqt5dbus5 libqt5network5 2023-12-01T16:05:00.063 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq4 librdkafka1 libshout3 libslirp0 libspice-server1 libtag1v5 2023-12-01T16:05:00.063 INFO:teuthology.orchestra.run.smithi066.stdout: libtag1v5-vanilla libthrift-0.13.0 libusbredirparser1 libv4l-0 2023-12-01T16:05:00.063 INFO:teuthology.orchestra.run.smithi066.stdout: libv4lconvert0 libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 2023-12-01T16:05:00.063 INFO:teuthology.orchestra.run.smithi066.stdout: libvte-2.91-common libwayland-server0 msr-tools nvme-cli ovmf 2023-12-01T16:05:00.064 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-01T16:05:00.064 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-bcrypt python3-blinker python3-bs4 2023-12-01T16:05:00.065 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-01T16:05:00.065 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-html5lib python3-jinja2 2023-12-01T16:05:00.065 INFO:teuthology.orchestra.run.smithi066.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-01T16:05:00.065 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-12-01T16:05:00.066 INFO:teuthology.orchestra.run.smithi066.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-01T16:05:00.066 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable python3-psutil python3-pyasn1 python3-pyasn1-modules 2023-12-01T16:05:00.066 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyinotify python3-repoze.lru python3-requests-oauthlib 2023-12-01T16:05:00.067 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-01T16:05:00.067 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-01T16:05:00.069 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempita python3-waitress python3-webencodings python3-webob 2023-12-01T16:05:00.069 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket python3-webtest python3-werkzeug qemu-system-data 2023-12-01T16:05:00.070 INFO:teuthology.orchestra.run.smithi066.stdout: qemu-system-gui qttranslations5-l10n seabios sharutils socat xmlstarlet 2023-12-01T16:05:00.291 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ipxe-qemu (1.0.0+git-20190109.133f4c4-0ubuntu3.2) ... 2023-12-01T16:05:00.293 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libcdparanoia0:amd64 (3.10.2+debian-13) ... 2023-12-01T16:05:00.435 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 111 to remove and 251 not upgraded. 2023-12-01T16:05:00.436 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 174 MB disk space will be freed. 2023-12-01T16:05:00.549 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 151748 files and directories currently installed.) 2023-12-01T16:05:00.554 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:05:00.678 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ipxe-qemu-256k-compat-efi-roms (1.0.0+git-20150424.a25a16d-0ubuntu4) ... 2023-12-01T16:05:01.011 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/zabbix' not empty so not removed 2023-12-01T16:05:01.012 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/volumes/fs/operations/versions' not empty so not removed 2023-12-01T16:05:01.012 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/test_orchestrator' not empty so not removed 2023-12-01T16:05:01.012 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/telemetry' not empty so not removed 2023-12-01T16:05:01.013 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/telegraf' not empty so not removed 2023-12-01T16:05:01.013 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/status' not empty so not removed 2023-12-01T16:05:01.013 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/stats/fs' not empty so not removed 2023-12-01T16:05:01.014 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/snap_schedule/fs' not empty so not removed 2023-12-01T16:05:01.014 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/selftest' not empty so not removed 2023-12-01T16:05:01.014 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/restful' not empty so not removed 2023-12-01T16:05:01.014 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/rbd_support' not empty so not removed 2023-12-01T16:05:01.015 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/prometheus' not empty so not removed 2023-12-01T16:05:01.015 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/progress' not empty so not removed 2023-12-01T16:05:01.015 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/pg_autoscaler' not empty so not removed 2023-12-01T16:05:01.015 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/osd_support' not empty so not removed 2023-12-01T16:05:01.016 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/osd_perf_query' not empty so not removed 2023-12-01T16:05:01.016 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/orchestrator' not empty so not removed 2023-12-01T16:05:01.016 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/nfs' not empty so not removed 2023-12-01T16:05:01.017 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/mirroring/fs/dir_map' not empty so not removed 2023-12-01T16:05:01.017 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/localpool' not empty so not removed 2023-12-01T16:05:01.018 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/iostat' not empty so not removed 2023-12-01T16:05:01.018 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/insights' not empty so not removed 2023-12-01T16:05:01.018 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/influx' not empty so not removed 2023-12-01T16:05:01.019 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/devicehealth' not empty so not removed 2023-12-01T16:05:01.019 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/crash' not empty so not removed 2023-12-01T16:05:01.019 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/balancer' not empty so not removed 2023-12-01T16:05:01.020 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/alerts' not empty so not removed 2023-12-01T16:05:01.090 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-01T16:05:01.097 INFO:teuthology.orchestra.run.smithi063.stdout:Removing jq (1.6-1ubuntu0.20.04.1) ... 2023-12-01T16:05:01.187 INFO:teuthology.orchestra.run.smithi066.stdout:Removing cpu-checker (0.7-1.1) ... 2023-12-01T16:05:01.467 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libaa1:amd64 (1.4p5-46) ... 2023-12-01T16:05:01.533 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T16:05:01.707 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python-natsort-doc (7.0.1-1) ... 2023-12-01T16:05:01.920 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T16:05:01.930 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libboost-iostreams1.71.0:amd64 (1.71.0-6ubuntu6) ... 2023-12-01T16:05:02.161 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-01T16:05:02.265 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T16:05:02.334 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libboost-thread1.71.0:amd64 (1.71.0-6ubuntu6) ... 2023-12-01T16:05:02.574 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-01T16:05:02.686 INFO:teuthology.orchestra.run.smithi066.stdout:Removing fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-01T16:05:02.713 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libbrlapi0.7:amd64 (6.0+dfsg-4ubuntu6) ... 2023-12-01T16:05:02.914 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libdv4:amd64 (1.0.0-12) ... 2023-12-01T16:05:03.005 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing fonts-mathjax, directory '/usr/share/javascript/mathjax/fonts/HTML-CSS/TeX/otf' not empty so not removed 2023-12-01T16:05:03.005 INFO:teuthology.orchestra.run.smithi066.stdout:dpkg: warning: while removing fonts-mathjax, directory '/usr/share/fonts/opentype' not empty so not removed 2023-12-01T16:05:03.108 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libcacard0:amd64 (1:2.6.1-1) ... 2023-12-01T16:05:03.223 INFO:teuthology.orchestra.run.smithi066.stdout:Removing gstreamer1.0-plugins-good:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:05:03.301 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libvirglrenderer1:amd64 (0.8.2-1ubuntu1.1) ... 2023-12-01T16:05:03.494 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libcdparanoia0:amd64 (3.10.2+debian-13) ... 2023-12-01T16:05:03.677 INFO:teuthology.orchestra.run.smithi066.stdout:Removing gstreamer1.0-plugins-base:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:05:03.688 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libgbm1:amd64 (21.2.6-0ubuntu0.1~20.04.2) ... 2023-12-01T16:05:03.914 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-01T16:05:04.058 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libgstreamer-plugins-good1.0-0:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:05:04.089 INFO:teuthology.orchestra.run.smithi066.stdout:Removing gstreamer1.0-x:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:05:04.267 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T16:05:04.445 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libspice-server1:amd64 (0.14.2-4ubuntu3.1) ... 2023-12-01T16:05:04.577 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ipxe-qemu (1.0.0+git-20190109.133f4c4-0ubuntu3.2) ... 2023-12-01T16:05:04.688 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T16:05:04.798 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libgstreamer-plugins-base1.0-0:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:05:05.004 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ipxe-qemu-256k-compat-efi-roms (1.0.0+git-20150424.a25a16d-0ubuntu4) ... 2023-12-01T16:05:05.074 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T16:05:05.169 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libgudev-1.0-0:amd64 (1:233-1) ... 2023-12-01T16:05:05.466 INFO:teuthology.orchestra.run.smithi066.stdout:Removing jq (1.6-1ubuntu0.20.04.1) ... 2023-12-01T16:05:05.555 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libiscsi7:amd64 (1.18.0-2) ... 2023-12-01T16:05:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-01T16:05:05.944 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libaa1:amd64 (1.4p5-46) ... 2023-12-01T16:05:05.975 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-01T16:05:06.306 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libdv4:amd64 (1.0.0-12) ... 2023-12-01T16:05:06.404 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python-asyncssh-doc (1.12.2-1) ... 2023-12-01T16:05:06.725 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libvirglrenderer1:amd64 (0.8.2-1ubuntu1.1) ... 2023-12-01T16:05:06.790 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-routes (2.4.1-2) ... 2023-12-01T16:05:06.856 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libboost-iostreams1.71.0:amd64 (1.71.0-6ubuntu6) ... 2023-12-01T16:05:07.146 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libgbm1:amd64 (21.2.6-0ubuntu0.1~20.04.2) ... 2023-12-01T16:05:07.258 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-01T16:05:07.302 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libboost-thread1.71.0:amd64 (1.71.0-6ubuntu6) ... 2023-12-01T16:05:07.574 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libgstreamer-plugins-good1.0-0:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:05:07.641 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-01T16:05:07.772 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libbrlapi0.7:amd64 (6.0+dfsg-4ubuntu6) ... 2023-12-01T16:05:07.994 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libspice-server1:amd64 (0.14.2-4ubuntu3.1) ... 2023-12-01T16:05:08.028 INFO:teuthology.orchestra.run.smithi146.stdout:Removing liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-01T16:05:08.183 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libcacard0:amd64 (1:2.6.1-1) ... 2023-12-01T16:05:08.381 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libgstreamer-plugins-base1.0-0:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:05:08.516 INFO:teuthology.orchestra.run.smithi146.stdout:Removing liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-01T16:05:08.636 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libcdparanoia0:amd64 (3.10.2+debian-13) ... 2023-12-01T16:05:08.810 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libgudev-1.0-0:amd64 (1:233-1) ... 2023-12-01T16:05:08.920 INFO:teuthology.orchestra.run.smithi146.stdout:Removing liboath0 (2.6.1-1.3) ... 2023-12-01T16:05:09.124 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-01T16:05:09.205 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libiscsi7:amd64 (1.18.0-2) ... 2023-12-01T16:05:09.300 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libonig5:amd64 (6.9.4-1) ... 2023-12-01T16:05:09.560 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T16:05:09.625 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-01T16:05:09.686 INFO:teuthology.orchestra.run.smithi146.stdout:Removing liborc-0.4-0:amd64 (1:0.4.31-1) ... 2023-12-01T16:05:09.982 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T16:05:10.011 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python-asyncssh-doc (1.12.2-1) ... 2023-12-01T16:05:10.073 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-01T16:05:10.418 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-01T16:05:10.448 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-routes (2.4.1-2) ... 2023-12-01T16:05:10.459 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libpmem1:amd64 (1.8-1ubuntu1) ... 2023-12-01T16:05:10.762 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-01T16:05:10.855 INFO:teuthology.orchestra.run.smithi146.stdout:Removing librabbitmq4:amd64 (0.10.0-1) ... 2023-12-01T16:05:11.010 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-01T16:05:11.174 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libdv4:amd64 (1.0.0-12) ... 2023-12-01T16:05:11.233 INFO:teuthology.orchestra.run.smithi146.stdout:Removing librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-01T16:05:11.382 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-01T16:05:11.636 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libshout3:amd64 (2.4.3-1) ... 2023-12-01T16:05:11.669 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libvirglrenderer1:amd64 (0.8.2-1ubuntu1.1) ... 2023-12-01T16:05:11.817 INFO:teuthology.orchestra.run.smithi063.stdout:Removing liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-01T16:05:12.024 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libslirp0:amd64 (4.1.0-2ubuntu2.2) ... 2023-12-01T16:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libgbm1:amd64 (21.2.6-0ubuntu0.1~20.04.2) ... 2023-12-01T16:05:12.340 INFO:teuthology.orchestra.run.smithi063.stdout:Removing liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-01T16:05:12.419 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libtag1v5:amd64 (1.11.1+dfsg.1-0.3ubuntu2) ... 2023-12-01T16:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libgstreamer-plugins-good1.0-0:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:05:12.727 INFO:teuthology.orchestra.run.smithi063.stdout:Removing liboath0 (2.6.1-1.3) ... 2023-12-01T16:05:12.789 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libtag1v5-vanilla:amd64 (1.11.1+dfsg.1-0.3ubuntu2) ... 2023-12-01T16:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libspice-server1:amd64 (0.14.2-4ubuntu3.1) ... 2023-12-01T16:05:13.147 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libonig5:amd64 (6.9.4-1) ... 2023-12-01T16:05:13.176 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libusbredirparser1:amd64 (0.8.0-1) ... 2023-12-01T16:05:13.475 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libgstreamer-plugins-base1.0-0:amd64 (1.16.3-0ubuntu1.1) ... 2023-12-01T16:05:13.526 INFO:teuthology.orchestra.run.smithi063.stdout:Removing liborc-0.4-0:amd64 (1:0.4.31-1) ... 2023-12-01T16:05:13.588 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libv4l-0:amd64 (1.18.0-2build1) ... 2023-12-01T16:05:13.920 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libgudev-1.0-0:amd64 (1:233-1) ... 2023-12-01T16:05:13.971 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-01T16:05:13.982 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libv4lconvert0:amd64 (1.18.0-2build1) ... 2023-12-01T16:05:14.378 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libvisual-0.4-0:amd64 (0.4.0-17) ... 2023-12-01T16:05:14.382 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libpmem1:amd64 (1.8-1ubuntu1) ... 2023-12-01T16:05:14.406 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libiscsi7:amd64 (1.18.0-2) ... 2023-12-01T16:05:14.785 INFO:teuthology.orchestra.run.smithi146.stdout:Removing qemu-system-gui:amd64 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:05:14.794 INFO:teuthology.orchestra.run.smithi063.stdout:Removing librabbitmq4:amd64 (0.10.0-1) ... 2023-12-01T16:05:14.860 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-01T16:05:15.171 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libvte-2.91-0:amd64 (0.60.3-0ubuntu1~20.04) ... 2023-12-01T16:05:15.222 INFO:teuthology.orchestra.run.smithi063.stdout:Removing librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-01T16:05:15.289 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python-asyncssh-doc (1.12.2-1) ... 2023-12-01T16:05:15.567 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libvte-2.91-common (0.60.3-0ubuntu1~20.04) ... 2023-12-01T16:05:15.593 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libshout3:amd64 (2.4.3-1) ... 2023-12-01T16:05:15.717 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-routes (2.4.1-2) ... 2023-12-01T16:05:15.869 INFO:teuthology.orchestra.run.smithi146.stdout:Removing libwayland-server0:amd64 (1.18.0-1) ... 2023-12-01T16:05:16.021 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libslirp0:amd64 (4.1.0-2ubuntu2.2) ... 2023-12-01T16:05:16.264 INFO:teuthology.orchestra.run.smithi146.stdout:Removing msr-tools (1.3-3) ... 2023-12-01T16:05:16.317 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-01T16:05:16.440 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libtag1v5:amd64 (1.11.1+dfsg.1-0.3ubuntu2) ... 2023-12-01T16:05:16.651 INFO:teuthology.orchestra.run.smithi146.stdout:Removing nvme-cli (1.9-1ubuntu0.1) ... 2023-12-01T16:05:16.734 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-01T16:05:16.828 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libtag1v5-vanilla:amd64 (1.11.1+dfsg.1-0.3ubuntu2) ... 2023-12-01T16:05:16.982 INFO:teuthology.orchestra.run.smithi146.stdout:Removing ovmf (0~20191122.bd85bf54-2ubuntu3.3) ... 2023-12-01T16:05:17.221 INFO:teuthology.orchestra.run.smithi066.stdout:Removing liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-01T16:05:17.248 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libusbredirparser1:amd64 (0.8.0-1) ... 2023-12-01T16:05:17.365 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-pecan (1.3.3-3ubuntu1) ... 2023-12-01T16:05:17.634 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libv4l-0:amd64 (1.18.0-2build1) ... 2023-12-01T16:05:17.734 INFO:teuthology.orchestra.run.smithi066.stdout:Removing liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-01T16:05:17.872 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-webtest (2.0.32-2) ... 2023-12-01T16:05:18.088 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libv4lconvert0:amd64 (1.18.0-2build1) ... 2023-12-01T16:05:18.162 INFO:teuthology.orchestra.run.smithi066.stdout:Removing liboath0 (2.6.1-1.3) ... 2023-12-01T16:05:18.360 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-pastescript (2.0.2-4) ... 2023-12-01T16:05:18.458 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libvisual-0.4-0:amd64 (0.4.0-17) ... 2023-12-01T16:05:18.558 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libonig5:amd64 (6.9.4-1) ... 2023-12-01T16:05:18.866 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-pastedeploy (2.1.0-1) ... 2023-12-01T16:05:18.894 INFO:teuthology.orchestra.run.smithi063.stdout:Removing qemu-system-gui:amd64 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:05:19.037 INFO:teuthology.orchestra.run.smithi066.stdout:Removing liborc-0.4-0:amd64 (1:0.4.31-1) ... 2023-12-01T16:05:19.289 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libvte-2.91-0:amd64 (0.60.3-0ubuntu1~20.04) ... 2023-12-01T16:05:19.343 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python-pastedeploy-tpl (2.1.0-1) ... 2023-12-01T16:05:19.449 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-01T16:05:19.684 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libvte-2.91-common (0.60.3-0ubuntu1~20.04) ... 2023-12-01T16:05:19.728 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-asyncssh (1.12.2-1) ... 2023-12-01T16:05:19.860 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libpmem1:amd64 (1.8-1ubuntu1) ... 2023-12-01T16:05:20.012 INFO:teuthology.orchestra.run.smithi063.stdout:Removing libwayland-server0:amd64 (1.18.0-1) ... 2023-12-01T16:05:20.218 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-01T16:05:20.322 INFO:teuthology.orchestra.run.smithi066.stdout:Removing librabbitmq4:amd64 (0.10.0-1) ... 2023-12-01T16:05:20.407 INFO:teuthology.orchestra.run.smithi063.stdout:Removing msr-tools (1.3-3) ... 2023-12-01T16:05:20.702 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-kubernetes (7.0.0~a1-2) ... 2023-12-01T16:05:20.792 INFO:teuthology.orchestra.run.smithi066.stdout:Removing librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-01T16:05:20.834 INFO:teuthology.orchestra.run.smithi063.stdout:Removing nvme-cli (1.9-1ubuntu0.1) ... 2023-12-01T16:05:21.181 INFO:teuthology.orchestra.run.smithi063.stdout:Removing ovmf (0~20191122.bd85bf54-2ubuntu3.3) ... 2023-12-01T16:05:21.222 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libshout3:amd64 (2.4.3-1) ... 2023-12-01T16:05:21.503 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-01T16:05:21.609 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-pecan (1.3.3-3ubuntu1) ... 2023-12-01T16:05:21.651 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libslirp0:amd64 (4.1.0-2ubuntu2.2) ... 2023-12-01T16:05:22.021 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-01T16:05:22.147 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libtag1v5:amd64 (1.11.1+dfsg.1-0.3ubuntu2) ... 2023-12-01T16:05:22.156 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-webtest (2.0.32-2) ... 2023-12-01T16:05:22.517 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-01T16:05:22.567 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libtag1v5-vanilla:amd64 (1.11.1+dfsg.1-0.3ubuntu2) ... 2023-12-01T16:05:22.634 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-pastescript (2.0.2-4) ... 2023-12-01T16:05:22.987 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libusbredirparser1:amd64 (0.8.0-1) ... 2023-12-01T16:05:23.012 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-bs4 (4.8.2-1) ... 2023-12-01T16:05:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-pastedeploy (2.1.0-1) ... 2023-12-01T16:05:23.423 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libv4l-0:amd64 (1.18.0-2build1) ... 2023-12-01T16:05:23.486 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-google-auth (1.5.1-2) ... 2023-12-01T16:05:23.669 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python-pastedeploy-tpl (2.1.0-1) ... 2023-12-01T16:05:23.927 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libv4lconvert0:amd64 (1.18.0-2build1) ... 2023-12-01T16:05:24.053 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-asyncssh (1.12.2-1) ... 2023-12-01T16:05:24.055 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-cachetools (4.0.0-1) ... 2023-12-01T16:05:24.358 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libvisual-0.4-0:amd64 (0.4.0-17) ... 2023-12-01T16:05:24.549 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:05:24.550 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-01T16:05:24.785 INFO:teuthology.orchestra.run.smithi066.stdout:Removing qemu-system-gui:amd64 (1:4.2-3ubuntu6.27) ... 2023-12-01T16:05:25.036 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:05:25.070 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-kubernetes (7.0.0~a1-2) ... 2023-12-01T16:05:25.230 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libvte-2.91-0:amd64 (0.60.3-0ubuntu1~20.04) ... 2023-12-01T16:05:25.527 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-cherrypy3 (8.9.1-6) ... 2023-12-01T16:05:25.700 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libvte-2.91-common (0.60.3-0ubuntu1~20.04) ... 2023-12-01T16:05:25.909 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-01T16:05:26.020 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-html5lib (1.0.1-2) ... 2023-12-01T16:05:26.028 INFO:teuthology.orchestra.run.smithi066.stdout:Removing libwayland-server0:amd64 (1.18.0-1) ... 2023-12-01T16:05:26.482 INFO:teuthology.orchestra.run.smithi066.stdout:Removing msr-tools (1.3-3) ... 2023-12-01T16:05:26.498 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-jinja2 (2.10.1-2) ... 2023-12-01T16:05:26.788 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-01T16:05:26.910 INFO:teuthology.orchestra.run.smithi066.stdout:Removing nvme-cli (1.9-1ubuntu0.1) ... 2023-12-01T16:05:27.290 INFO:teuthology.orchestra.run.smithi066.stdout:Removing ovmf (0~20191122.bd85bf54-2ubuntu3.3) ... 2023-12-01T16:05:27.309 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-01T16:05:27.346 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-01T16:05:27.776 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-pecan (1.3.3-3ubuntu1) ... 2023-12-01T16:05:27.829 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-bs4 (4.8.2-1) ... 2023-12-01T16:05:27.944 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-joblib (0.14.0-3) ... 2023-12-01T16:05:28.310 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-google-auth (1.5.1-2) ... 2023-12-01T16:05:28.317 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-webtest (2.0.32-2) ... 2023-12-01T16:05:28.448 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-01T16:05:28.856 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-pastescript (2.0.2-4) ... 2023-12-01T16:05:28.879 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-cachetools (4.0.0-1) ... 2023-12-01T16:05:28.947 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-logutils (0.3.3-7) ... 2023-12-01T16:05:29.392 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:05:29.415 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-pastedeploy (2.1.0-1) ... 2023-12-01T16:05:29.436 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-01T16:05:29.904 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-01T16:05:29.905 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:05:29.944 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python-pastedeploy-tpl (2.1.0-1) ... 2023-12-01T16:05:30.371 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-asyncssh (1.12.2-1) ... 2023-12-01T16:05:30.399 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-cherrypy3 (8.9.1-6) ... 2023-12-01T16:05:30.408 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-markupsafe (1.1.0-1build2) ... 2023-12-01T16:05:30.902 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-natsort (7.0.1-1) ... 2023-12-01T16:05:30.929 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-01T16:05:30.944 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-html5lib (1.0.1-2) ... 2023-12-01T16:05:31.394 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-paste (3.4.0+dfsg1-1) ... 2023-12-01T16:05:31.460 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-jinja2 (2.10.1-2) ... 2023-12-01T16:05:31.489 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-kubernetes (7.0.0~a1-2) ... 2023-12-01T16:05:31.927 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-prettytable (0.7.2-5) ... 2023-12-01T16:05:31.988 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-01T16:05:32.604 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-joblib (0.14.0-3) ... 2023-12-01T16:05:32.737 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-01T16:05:32.790 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-psutil (5.5.1-1ubuntu4) ... 2023-12-01T16:05:33.134 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-01T16:05:33.265 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-rsa (4.0-3) ... 2023-12-01T16:05:33.356 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-01T16:05:33.656 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-logutils (0.3.3-7) ... 2023-12-01T16:05:33.755 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-01T16:05:33.894 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-01T16:05:34.177 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-01T16:05:34.240 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-pyasn1 (0.4.2-3build1) ... 2023-12-01T16:05:34.439 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-bs4 (4.8.2-1) ... 2023-12-01T16:05:34.673 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-01T16:05:34.718 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-01T16:05:35.029 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-google-auth (1.5.1-2) ... 2023-12-01T16:05:35.193 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-markupsafe (1.1.0-1build2) ... 2023-12-01T16:05:35.198 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-repoze.lru (0.7-2) ... 2023-12-01T16:05:35.676 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-simplegeneric (0.8.1-3) ... 2023-12-01T16:05:35.700 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-cachetools (4.0.0-1) ... 2023-12-01T16:05:35.746 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-natsort (7.0.1-1) ... 2023-12-01T16:05:36.153 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-01T16:05:36.250 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-paste (3.4.0+dfsg1-1) ... 2023-12-01T16:05:36.307 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:05:36.649 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-singledispatch (3.4.0.3-2build1) ... 2023-12-01T16:05:36.845 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-12-01T16:05:37.091 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-prettytable (0.7.2-5) ... 2023-12-01T16:05:37.128 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-01T16:05:37.377 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-cherrypy3 (8.9.1-6) ... 2023-12-01T16:05:37.523 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-01T16:05:37.569 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-psutil (5.5.1-1ubuntu4) ... 2023-12-01T16:05:38.014 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-tempita (0.5.2-6) ... 2023-12-01T16:05:38.021 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-html5lib (1.0.1-2) ... 2023-12-01T16:05:38.097 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-rsa (4.0-3) ... 2023-12-01T16:05:38.490 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-01T16:05:38.625 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-01T16:05:38.790 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-jinja2 (2.10.1-2) ... 2023-12-01T16:05:38.984 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-01T16:05:39.154 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-pyasn1 (0.4.2-3build1) ... 2023-12-01T16:05:39.327 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-01T16:05:39.475 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-webob (1:1.8.5-2) ... 2023-12-01T16:05:39.641 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-01T16:05:39.943 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-websocket (0.53.0-2ubuntu1) ... 2023-12-01T16:05:39.984 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-joblib (0.14.0-3) ... 2023-12-01T16:05:40.137 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-repoze.lru (0.7-2) ... 2023-12-01T16:05:40.431 INFO:teuthology.orchestra.run.smithi146.stdout:Removing python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-01T16:05:40.547 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-01T16:05:40.658 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-simplegeneric (0.8.1-3) ... 2023-12-01T16:05:40.898 INFO:teuthology.orchestra.run.smithi146.stdout:Removing qemu-system-data (1:4.2-3ubuntu6.27) ... 2023-12-01T16:05:41.077 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-logutils (0.3.3-7) ... 2023-12-01T16:05:41.182 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-01T16:05:41.361 INFO:teuthology.orchestra.run.smithi146.stdout:Removing qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-01T16:05:41.623 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-01T16:05:41.693 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-singledispatch (3.4.0.3-2build1) ... 2023-12-01T16:05:41.714 INFO:teuthology.orchestra.run.smithi146.stdout:Removing seabios (1.13.0-1ubuntu1.1) ... 2023-12-01T16:05:42.187 INFO:teuthology.orchestra.run.smithi146.stdout:Removing sharutils (1:4.15.2-4build1) ... 2023-12-01T16:05:42.194 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-01T16:05:42.195 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-01T16:05:42.591 INFO:teuthology.orchestra.run.smithi146.stdout:Removing socat (1.7.3.3-2) ... 2023-12-01T16:05:42.622 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-01T16:05:42.783 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-markupsafe (1.1.0-1build2) ... 2023-12-01T16:05:42.985 INFO:teuthology.orchestra.run.smithi146.stdout:Removing xmlstarlet (1.6.1-2build1) ... 2023-12-01T16:05:43.102 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-tempita (0.5.2-6) ... 2023-12-01T16:05:43.337 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-natsort (7.0.1-1) ... 2023-12-01T16:05:43.406 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-12-01T16:05:43.515 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-01T16:05:43.607 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-01T16:05:43.625 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:05:43.759 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:05:43.871 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-paste (3.4.0+dfsg1-1) ... 2023-12-01T16:05:44.109 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-01T16:05:44.237 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-12-01T16:05:44.434 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-prettytable (0.7.2-5) ... 2023-12-01T16:05:44.604 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-webob (1:1.8.5-2) ... 2023-12-01T16:05:44.813 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-12-01T16:05:44.963 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-psutil (5.5.1-1ubuntu4) ... 2023-12-01T16:05:45.058 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-websocket (0.53.0-2ubuntu1) ... 2023-12-01T16:05:45.222 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:05:45.223 DEBUG:teuthology.parallel:result is None 2023-12-01T16:05:45.535 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-rsa (4.0-3) ... 2023-12-01T16:05:45.578 INFO:teuthology.orchestra.run.smithi063.stdout:Removing python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-01T16:05:46.051 INFO:teuthology.orchestra.run.smithi063.stdout:Removing qemu-system-data (1:4.2-3ubuntu6.27) ... 2023-12-01T16:05:46.081 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-01T16:05:46.537 INFO:teuthology.orchestra.run.smithi063.stdout:Removing qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-01T16:05:46.675 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-pyasn1 (0.4.2-3build1) ... 2023-12-01T16:05:46.933 INFO:teuthology.orchestra.run.smithi063.stdout:Removing seabios (1.13.0-1ubuntu1.1) ... 2023-12-01T16:05:47.229 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-01T16:05:47.405 INFO:teuthology.orchestra.run.smithi063.stdout:Removing sharutils (1:4.15.2-4build1) ... 2023-12-01T16:05:47.755 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-repoze.lru (0.7-2) ... 2023-12-01T16:05:47.851 INFO:teuthology.orchestra.run.smithi063.stdout:Removing socat (1.7.3.3-2) ... 2023-12-01T16:05:48.272 INFO:teuthology.orchestra.run.smithi063.stdout:Removing xmlstarlet (1.6.1-2build1) ... 2023-12-01T16:05:48.310 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-simplegeneric (0.8.1-3) ... 2023-12-01T16:05:48.703 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-12-01T16:05:48.815 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-01T16:05:48.839 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-01T16:05:48.969 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:05:49.123 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:05:49.383 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-singledispatch (3.4.0.3-2build1) ... 2023-12-01T16:05:49.640 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-12-01T16:05:49.906 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-01T16:05:50.175 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-12-01T16:05:50.384 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-01T16:05:50.618 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:05:50.621 DEBUG:teuthology.parallel:result is None 2023-12-01T16:05:50.911 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-tempita (0.5.2-6) ... 2023-12-01T16:05:51.452 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-01T16:05:51.978 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-01T16:05:52.531 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-webob (1:1.8.5-2) ... 2023-12-01T16:05:53.051 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-websocket (0.53.0-2ubuntu1) ... 2023-12-01T16:05:53.631 INFO:teuthology.orchestra.run.smithi066.stdout:Removing python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-01T16:05:54.186 INFO:teuthology.orchestra.run.smithi066.stdout:Removing qemu-system-data (1:4.2-3ubuntu6.27) ... 2023-12-01T16:05:54.738 INFO:teuthology.orchestra.run.smithi066.stdout:Removing qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-01T16:05:55.195 INFO:teuthology.orchestra.run.smithi066.stdout:Removing seabios (1.13.0-1ubuntu1.1) ... 2023-12-01T16:05:55.799 INFO:teuthology.orchestra.run.smithi066.stdout:Removing sharutils (1:4.15.2-4build1) ... 2023-12-01T16:05:56.287 INFO:teuthology.orchestra.run.smithi066.stdout:Removing socat (1.7.3.3-2) ... 2023-12-01T16:05:56.783 INFO:teuthology.orchestra.run.smithi066.stdout:Removing xmlstarlet (1.6.1-2build1) ... 2023-12-01T16:05:57.253 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-12-01T16:05:57.363 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-01T16:05:57.539 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-01T16:05:57.690 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-01T16:05:58.218 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-12-01T16:05:58.753 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-12-01T16:05:59.200 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-01T16:05:59.202 DEBUG:teuthology.parallel:result is None 2023-12-01T16:05:59.203 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi063.front.sepia.ceph.com 2023-12-01T16:05:59.203 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi066.front.sepia.ceph.com 2023-12-01T16:05:59.203 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi146.front.sepia.ceph.com 2023-12-01T16:05:59.204 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/apt/sources.list.d/ceph.list 2023-12-01T16:05:59.204 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/apt/sources.list.d/ceph.list 2023-12-01T16:05:59.205 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f /etc/apt/sources.list.d/ceph.list 2023-12-01T16:05:59.217 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2023-12-01T16:05:59.222 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2023-12-01T16:05:59.223 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2023-12-01T16:05:59.383 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-01T16:05:59.393 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-01T16:05:59.414 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T16:05:59.414 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-01T16:05:59.456 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-12-01T16:05:59.464 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T16:05:59.512 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-01T16:05:59.546 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-12-01T16:05:59.594 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-12-01T16:05:59.676 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-01T16:05:59.888 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-01T16:05:59.938 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-01T16:06:00.078 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 114 kB in 1s (162 kB/s) 2023-12-01T16:06:00.178 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 114 kB in 1s (141 kB/s) 2023-12-01T16:06:00.239 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 114 kB in 1s (140 kB/s) 2023-12-01T16:06:01.131 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-01T16:06:01.158 DEBUG:teuthology.parallel:result is None 2023-12-01T16:06:01.280 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2023-12-01T16:06:01.307 DEBUG:teuthology.parallel:result is None 2023-12-01T16:06:01.339 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2023-12-01T16:06:01.365 DEBUG:teuthology.parallel:result is None 2023-12-01T16:06:01.366 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-01T16:06:01.376 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-01T16:06:01.376 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T16:06:01.379 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T16:06:01.382 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T16:06:01.398 INFO:teuthology.orchestra.run.smithi066.stdout: remote refid st t when poll reach delay offset jitter 2023-12-01T16:06:01.398 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================== 2023-12-01T16:06:01.398 INFO:teuthology.orchestra.run.smithi066.stdout:*hv01.front.sepi 44.4.53.2 2 u 41 64 377 0.086 4.704 1.487 2023-12-01T16:06:01.398 INFO:teuthology.orchestra.run.smithi066.stdout:+hv02.front.sepi 63.231.80.2 3 u 42 64 377 0.098 4.042 2.322 2023-12-01T16:06:01.398 INFO:teuthology.orchestra.run.smithi066.stdout:+hv03.front.sepi 74.6.168.72 3 u 40 64 377 0.089 6.318 1.803 2023-12-01T16:06:01.399 INFO:teuthology.orchestra.run.smithi066.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-12-01T16:06:01.400 INFO:teuthology.orchestra.run.smithi063.stdout: remote refid st t when poll reach delay offset jitter 2023-12-01T16:06:01.400 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================== 2023-12-01T16:06:01.400 INFO:teuthology.orchestra.run.smithi063.stdout:*hv01.front.sepi 44.4.53.2 2 u 36 64 377 0.106 6.176 1.201 2023-12-01T16:06:01.400 INFO:teuthology.orchestra.run.smithi063.stdout:+hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.100 8.717 1.124 2023-12-01T16:06:01.401 INFO:teuthology.orchestra.run.smithi063.stdout:+hv03.front.sepi 74.6.168.72 3 u 38 64 377 0.089 10.374 1.165 2023-12-01T16:06:01.401 INFO:teuthology.orchestra.run.smithi063.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-12-01T16:06:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2023-12-01T16:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2023-12-01T16:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout:*hv01.front.sepi 44.4.53.2 2 u 52 64 377 0.074 2.787 0.814 2023-12-01T16:06:01.410 INFO:teuthology.orchestra.run.smithi146.stdout:+hv02.front.sepi 63.231.80.2 3 u 34 64 377 0.082 3.749 0.825 2023-12-01T16:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout:+hv03.front.sepi 74.6.168.72 3 u 39 64 377 0.098 5.355 0.788 2023-12-01T16:06:01.411 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-12-01T16:06:01.411 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-01T16:06:01.421 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-01T16:06:01.422 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-01T16:06:01.439 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-01T16:06:01.459 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-01T16:06:01.470 INFO:teuthology.task.internal:Duration was 2329.824245 seconds 2023-12-01T16:06:01.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-01T16:06:01.486 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-01T16:06:01.487 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-01T16:06:01.490 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-01T16:06:01.492 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-01T16:06:01.546 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-01T16:06:01.546 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2023-12-01T16:06:01.547 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-01T16:06:01.559 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2023-12-01T16:06:01.560 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-01T16:06:01.574 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2023-12-01T16:06:01.574 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-01T16:06:01.593 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-01T16:06:01.594 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T16:06:01.597 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T16:06:01.620 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T16:06:01.657 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-01T16:06:01.658 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-01T16:06:01.660 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-01T16:06:01.662 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-01T16:06:01.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-01T16:06:01.775 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-01T16:06:01.775 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-01T16:06:01.792 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-01T16:06:01.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-01T16:06:01.827 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-01T16:06:01.838 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-01T16:06:01.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-01T16:06:01.853 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2023-12-01T16:06:01.856 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-01T16:06:01.868 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2023-12-01T16:06:01.886 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2023-12-01T16:06:01.910 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-01T16:06:01.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T16:06:01.918 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-01T16:06:01.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T16:06:01.926 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-01T16:06:01.932 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi146.front.sepia.ceph.com, flagging run as failed 2023-12-01T16:06:01.932 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-01T16:06:01.944 INFO:teuthology.task.internal:Transferring archived files... 2023-12-01T16:06:01.945 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/remote/smithi063 2023-12-01T16:06:01.945 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-01T16:06:01.982 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/remote/smithi066 2023-12-01T16:06:01.982 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-01T16:06:02.007 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/remote/smithi146 2023-12-01T16:06:02.007 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-01T16:06:02.146 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-12-01T16:06:02.159 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692/remote/smithi146/coredump/1701446377.67355.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph_test_libcephfs_reclaim', real uid: 1000, effective uid: 1000, real gid: 1267, effective gid: 1267, execfn: '/usr/bin/ceph_test_libcephfs_reclaim', platform: 'x86_64' 2023-12-01T16:06:02.160 INFO:teuthology.task.internal: dump_program: ceph_test_libcephfs_reclaim 2023-12-01T16:06:02.160 DEBUG:teuthology.orchestra.run.smithi146:> which ceph_test_libcephfs_reclaim 2023-12-01T16:06:02.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T16:06:02.183 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 1: 'which ceph_test_libcephfs_reclaim' 2023-12-01T16:06:02.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-01T16:06:02.207 INFO:teuthology.task.internal:Not uploading archives. 2023-12-01T16:06:02.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-01T16:06:02.224 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-01T16:06:02.224 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-01T16:06:02.242 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-01T16:06:02.243 INFO:teuthology.orchestra.run.smithi063.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 1 16:04 /home/ubuntu/cephtest 2023-12-01T16:06:02.243 INFO:teuthology.orchestra.run.smithi063.stdout: 924113 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 1 16:06 /home/ubuntu/cephtest/archive 2023-12-01T16:06:02.243 INFO:teuthology.orchestra.run.smithi063.stdout: 924115 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 1 16:06 /home/ubuntu/cephtest/archive/syslog 2023-12-01T16:06:02.243 INFO:teuthology.orchestra.run.smithi063.stdout: 924742 4 -rw-rw-rw- 1 ubuntu ubuntu 440 Dec 1 16:01 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-01T16:06:02.243 INFO:teuthology.orchestra.run.smithi063.stdout: 924116 84 -rw-rw-rw- 1 ubuntu ubuntu 85874 Dec 1 16:06 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-01T16:06:02.243 INFO:teuthology.orchestra.run.smithi063.stdout: 924117 100 -rw-rw-r-- 1 ubuntu ubuntu 99786 Dec 1 16:06 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-01T16:06:02.244 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-12-01T16:06:02.247 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-01T16:06:02.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T16:06:02.252 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 1: 'which ceph_test_libcephfs_reclaim' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-12-01T16:06:02.268 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-01T16:06:02.285 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-01T16:06:02.301 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi146 with status 1: 'which ceph_test_libcephfs_reclaim' 2023-12-01T16:06:02.301 INFO:teuthology.nuke:Checking targets against current locks 2023-12-01T16:06:02.310 INFO:teuthology.orchestra.run.smithi066.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 1 16:04 /home/ubuntu/cephtest 2023-12-01T16:06:02.310 INFO:teuthology.orchestra.run.smithi066.stdout: 924113 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 1 16:06 /home/ubuntu/cephtest/archive 2023-12-01T16:06:02.310 INFO:teuthology.orchestra.run.smithi066.stdout: 924115 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 1 16:06 /home/ubuntu/cephtest/archive/syslog 2023-12-01T16:06:02.311 INFO:teuthology.orchestra.run.smithi066.stdout: 924098 4 -rw-rw-rw- 1 ubuntu ubuntu 447 Dec 1 16:01 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-01T16:06:02.311 INFO:teuthology.orchestra.run.smithi066.stdout: 924099 84 -rw-rw-rw- 1 ubuntu ubuntu 83094 Dec 1 16:06 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-01T16:06:02.311 INFO:teuthology.orchestra.run.smithi066.stdout: 924100 96 -rw-rw-r-- 1 ubuntu ubuntu 97899 Dec 1 16:06 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-01T16:06:02.311 INFO:teuthology.orchestra.run.smithi146.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 1 16:04 /home/ubuntu/cephtest 2023-12-01T16:06:02.311 INFO:teuthology.orchestra.run.smithi146.stdout: 924113 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Dec 1 15:27 /home/ubuntu/cephtest/archive 2023-12-01T16:06:02.312 INFO:teuthology.orchestra.run.smithi146.stdout: 924115 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 1 16:06 /home/ubuntu/cephtest/archive/syslog 2023-12-01T16:06:02.312 INFO:teuthology.orchestra.run.smithi146.stdout: 924742 4 -rw-rw-rw- 1 ubuntu ubuntu 715 Dec 1 15:59 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-01T16:06:02.312 INFO:teuthology.orchestra.run.smithi146.stdout: 924116 84 -rw-rw-rw- 1 ubuntu ubuntu 83458 Dec 1 16:06 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-01T16:06:02.312 INFO:teuthology.orchestra.run.smithi146.stdout: 924117 100 -rw-rw-r-- 1 ubuntu ubuntu 98615 Dec 1 16:06 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-01T16:06:02.312 INFO:teuthology.orchestra.run.smithi146.stdout: 924114 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 1 15:59 /home/ubuntu/cephtest/archive/coredump 2023-12-01T16:06:02.312 INFO:teuthology.orchestra.run.smithi146.stdout: 951095 4484 -rw------- 1 ubuntu ubuntu 5517312 Dec 1 15:59 /home/ubuntu/cephtest/archive/coredump/1701446377.67355.core 2023-12-01T16:06:02.313 INFO:teuthology.orchestra.run.smithi066.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-12-01T16:06:02.314 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-12-01T16:06:02.339 DEBUG:teuthology.nuke:shortname: smithi063 2023-12-01T16:06:02.339 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T16:06:02.363 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:12:13.120736', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-01T16:06:02.369 DEBUG:teuthology.nuke:shortname: smithi066 2023-12-01T16:06:02.370 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T16:06:02.397 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:12:13.119260', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-01T16:06:02.398 DEBUG:teuthology.nuke:shortname: smithi146 2023-12-01T16:06:02.399 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T16:06:02.434 INFO:teuthology.orchestra.console.smithi063:Power off 2023-12-01T16:06:02.435 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T16:06:02.455 INFO:teuthology.orchestra.console.smithi066:Power off 2023-12-01T16:06:02.456 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T16:06:02.466 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:11:02-smoke-reef-release-distro-default-smithi/7473692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:12:13.116679', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-01T16:06:02.472 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2023-12-01T16:06:02.472 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:06:02.484 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2023-12-01T16:06:02.485 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:06:02.499 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2023-12-01T16:06:02.507 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-12-01T16:06:02.527 INFO:teuthology.orchestra.console.smithi146:Power off 2023-12-01T16:06:02.528 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T16:06:02.554 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-12-01T16:06:02.555 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:06:02.586 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-12-01T16:06:06.500 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:06:06.509 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:06:06.587 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:06:06.611 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2023-12-01T16:06:06.620 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-12-01T16:06:06.699 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-12-01T16:06:10.615 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:06:10.632 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:06:10.701 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:06:10.734 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2023-12-01T16:06:10.744 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-12-01T16:06:10.812 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-12-01T16:06:10.836 INFO:teuthology.orchestra.console.smithi063:Power off completed 2023-12-01T16:06:14.746 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:06:14.814 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:06:14.857 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-12-01T16:06:14.927 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-12-01T16:06:14.958 INFO:teuthology.orchestra.console.smithi066:Power off completed 2023-12-01T16:06:15.029 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-12-01T16:06:15.139 INFO:teuthology.run:Summary data: description: smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/ubuntu_20.04 tasks/{0-install test/libcephfs_interface_tests}} duration: 2329.824244737625 failure_reason: 'Command failed (workunit test libcephfs/test.sh) on smithi146 with status 139: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6f82997ac57b70a895455dfed6256360a1e4c32 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=da0bbe0e30e14a748d40208492c77710 status: fail success: false 2023-12-01T16:06:15.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:06:15.227 INFO:teuthology.run:FAIL